When reputation drops below the threshold to allow for voting (such as after issuing a bounty), any voted-on answers to a question still show as being upvoted, though the score does appear to change after your ability to vote has been stripped (pretty neat actually.)
The above image shows an answer that was voted on before a reputation change. Then, a bounty was issued which lowered reputation, which appears to have brought the score to 0 (or, perhaps someone else downvoted this person, I don't know). Either way, clicking the down arrow gives the error "Thanks for voting! Votes with less than 125 reputation...," while clicking the up arrow gives the error "You have already voted on this issue on 10/17...."
I'm not sure if this behavior is intended or what is expected, but it does seem a bit odd to me.
Here is the Q/A I noticed this in.