At the moment it is not possible to retract a downvote when the answer was not edited.

I have DV-ted the answer by mistake (I wanted to upvote it). But system does not let me change it.

> You last voted on this answer 15 mins ago. Your vote is now locked in
> unless this answer is edited.

I feel bad as the answer is good and for sure it does not deserve a DV. I do not see any rational reason for this restriction.


-------------------

After reading the links I understand the reason. I think you should lift this restriction for high-rank users. I do not think that they will abuse the reputation system.