What can you do against a downvote on your question/answer? Nothing. People vote based on their own interpretation of what is a good question and what isn't. The best you can do is make sure that your question (or answer) is indeed a good question, and stop worrying about *one* user who downvoted your question.

If this doesn't convince you, you can always consider that the [highest voted question][1] on SO has 30-odds downvotes, compared to the 10k upvotes it received.

The system works. It won't be adapted to prevent a insignificant number of downvotes which aren't deserved.

  [1]: http://stackoverflow.com/questions/11227809/