Let's say there are three answers to a question. One is -1, and the two are -20. With your original proposal they would all say downvoted, but there's one of those answers I might give a shot to on the grounds that that one downvote could have been wrong, and the others I certainly ought to skip over.
We then have a progress bar suggestion, but that also suffers from granularity and comparability problems. It seems much more difficult to tell at a glance which is the best answer.
How do I know the voting breakdown? There is a difference between a post that's had 10 upvotes and 10 downvotes, (particularly here on Meta) as compared to a post that's not been voted on at all. Perhaps the first post was wrong and has been corrected, but the second has simply not been tried at all by anyone.
Voting is not about positivity or negativity at all; it’s about content rating. Is the answer useful, or not, or actively harmful. That's what we need to know here in as a simple and obvious a way as possible. We need to be able to compare answers and try the best one first without squinting at a set of progress bars to try to figure it out.