You wonder what would have happened if you took the other job, your peers resent you for "playing the game", people think you're not loyal, etc. You make the highest amount of money that your employer will currently pay you, but that's about it.