>If one of those act up, people can unstake and leave. It's really not that different from mining pools in PoW.

Can they? I know that Coinbase already blocks users from unstaking. What's stopping the other brokers from taking the same approach?