There are also countries that reduce the time a license is valid starting at a certain age and that require a medical test for renewal at all ages. IIRC Spain does that.
To do that you have to first recognize that current city designs are 100% for car manufacturers, not people. To take away the olds licenses is to restrict them in their homes, like people under already are. It's freedom they're after.
Change the culture around freedom of movement, and I guarantee the olds will give up their keys before they're even old.