I've discovered that if you down vote a answer then you lose reputation. I don't understand why this happens as it just discourages me from down voting answers that are completely wrong. Because of this you just end up getting completely random answers at the top of a question page that users don't want to down vote because they then lose reputation.
I can understand this may be because users can start having down vote wars and that but I'm sure Stack Overflow could simply implement a feature where you can have a down vote reviewed if you think it's wrong.