It seems like we should allow changing on answer votes when a question is edited (at least by the OP), not just when the answer is edited.
I recently downvoted an answer in which the answerer hadn't read the OP's question clearly, and responded with something that was the opposite of what the OP was trying to do. The answerer even acknowledged that this seemed to be the case in the comments.
However, presumably after reading that answer/comments, the OP edited his question to the ask for the opposite of what he'd previously asked, thereby rendering the now down-voted answer perfectly reasonable (and the answer that I had subsequently posted to be the one that now didn't properly address the question).
I could not remove the down-vote at the time because the answer hadn't been edited.
Subsequently, the answerer did edit his post and the down-vote was reversed, but it seems like it would be appropriate to allow re-voting in cases where there are substantive changes to the question, especially by the OP, as our understanding of their question is critical in terms of deciding which answers are useful or not.