At the moment it is not possible to retract a downvote when the answer was not edited.
I have DV-ted the answer by mistake (I wanted to upvote it). But system does not let me change it.
You last voted on this answer 15 mins ago. Your vote is now locked in unless this answer is edited.
I feel bad as the answer is good and for sure it does not deserve a DV. I do not see any rational reason for this restriction.
After reading the links I understand the reason. I think you should lift this restriction for high-rank users. I do not think that they will abuse the reputation system.