One's honor is not dependent on those one interacts with.

For example, stealing from a thief may be considered karmic justice, but it still makes one a thief.