My hunch (limited experience) is that there are two very different types of people commenting "Why the downvote?"
- People worried about the reputation, and little else
These people post low-quality answers, trying to get Upvotes/Reputation by being the first, even if not the best. Or they post answers that are incomplete, but "barely good enough". Etc. These are the ones where, when they complain ask about the downvotes, they basically already know the reason. These should be flagged and deleted.
- People who post quality answers and don't understand the downvotes.
I see this quite a bit on DIY. Often with some of the top users of the site. They don't care much about the reputation (they've already got all the reputation they could ever need) but they do care about providing quality answers.
They get downvotes with no comment/explanation. Something they missed? Something they wrote offended someone? Revenge downvotes? Something else? They honestly want to know what is going on. Sometimes other high-rep users will actually +1 deliberately to compensate, where they otherwise would not bother to vote on the post (not because they think it is a bad post but just "why +1 90% of the posts on the site").
Admittedly, most of the time this second group gets no serious answer to "why the downvote", but once in a while they might, and it is a valid question for them to ask.
I think the real problem is that a lot of users simply don't understand how to use the system well. Maybe they truly disagree with something in an Answer, but rather than commenting to ask for clarification, or writing their own Answer as an alternative, they just -1 and move on. That downvote helps nobody.
The goal here should not be "only positive votes" - that leads to a cultural problem experienced on many sites, and the "you can vote up but not down on comments" feeds into that mentality. But when the posts are legitimate and serious and there are downvotes, explaining those downvotes is key to improving the quality of those posts.
Quality posts is what this should be about, not a bunch of rules.