If your values are non-violent and you're value producers, that doesn't happen. Sure, there can be situations where the land itself is valuable and the people on it are only a liability, but usually the value is in the people themselves.

Sometimes, people aren't valued. Consider the Holocaust, Rwanda and the Culture Revolution.