There are things you are not allowed to do even on your own property for very good reasons, e.g. storing radioactive waste.

Limits on building height can make sense in some places, even if not in this particular case.