It happened to me a few times that I upvoted a question or answer, and then thought it was actually not really worth it. However if I want to cancel my upvote, the post will get a downvote.
For example, this morning I upvoted an answer that I didn't actually use. I should have only upvoted the answer I tried, instead of the answer of someone else which looked good, but maybe didn't answer my issue.