I leave it on voluntarily with my family. We all have the ability to see where each other is, but no one uses it for nefarious reasons because we trust each other. My brother will check where I am before calling because he knows I can't always answer. I will check quickly and see if my wife is at work when I finish to see if I have time for a dog walk or should consider starting dinner. It's nice to see how close my aunt is before picking me up for a football game.

I also share location with some friends. I have one who is a professional photographer, and it's neat to see the interesting places she gets to go. Her mother also finds it comforting that I can find her if she's ever unresponsive for a long period of time. Another friend of mine was passing through my town, and saw I was home, so stopped by to visit. Unexpected and pleasant.

Your last point is key - it's totally fine to not want this feature, but it's nice for those of us who do. To each their own.