While the right to upvote/downvote/ignore remains with the individuals in the community, I would like to remind you all that community is expected to evaluate the content, not the people.
If a particular individual's content is persistently low in quality, he will be banned. That's another issue.
So I think that we all should take a to evaluate the post at hand, rather than history, even if it is the history of the same post. Then again, it's your right to vote.