I still stand by my point, that symmetrical actions should have symmetrical meaning. If upvote is used for agreement, downvote should be used for disagreement. Would you enjoy if your right arrow were to move cursor to the right, and the left arrow to move it up?
If you don't want downvotes as the sign of disagreement then remove that arrow altogether and leave just "flag".
On the other hand, I don't really get how is the system where showing only agreement is allowed is any better.
The current problem is that while both arrows have a similar effect on positioning, down voting also causes the post to sort of disappear, which is ok for lousy posts but tragic for good, but unpopular posts.