"If you tried taxing capital that much they'd flee the country."

I keep encountering various forms of this. Can someone explain why rich people who do not significantly spend, invest, pay taxes or otherwise contribute "fleeing the country" is bad?