I have heard from friends that have had to have a father's or mother's licence taken away. Never a good day. The doctor strategy is usually the easiest way.
The risk of harm to them and innocent bystanders has to drive the action. Can't imagine how I would deal with the guilt of doing nothing if someone was injured or worse killed.