Yes and no. Yes
Yes, it's wrong, because I feel you should vote based on the quality of the post alone, not on what other people think of it. No
No, because you can still vote however you want for whatever reason. If everyone does it, it should balance out in the long run. The
The good answers should rise to the top by means of mass voting.
This was relevant without taking reputation points into account. Your upvote will change the user's reputation positively even if the post ends up at 0. So you actually do change something.
I feel that the linear link between reputation points and votes makes voting different as your impact isn't just on the topic at hand. You influence user privileges at the same time. Maybe this was your intent (impact on user and not on question)?