Let us consider the types of comments that this would allow for:
- -1 comment to avoid -1 rep. -SomeUser
- -1 comment to avoid -1 rep... because upvotes on other comments don't count. -OtherUser
- I like ponies. -Bob
- -1 I like ponies too. -Will
Some deleted comment. -SnarkyUser
F* This. -ObsceneUser (deleted by mod)
The problem with this, and many 'encourage comments in association with votes' suggestions is that they make no guarantees about the quality of that information.
Comments already have a low enough signal to noise ratio. People try to figure out how to show fewer comments... and its a hard problem. Encouraging pointless comments (see above) makes this an even harder problem to solve while at the same time not providing any good feedback to the OP who is getting down voted (they'll likely think that Stack Overflow is full of negative snarky elitists... and I shouldn't need to link that text).
Further consider that reputation loss from down voting answers is already refunded - if the answer is deleted. This then leads us to a number of "do we refund the rep" situations and ugly business logic:
- How long between comment and vote (before? after?) for a refund?
- What happens if a comment is deleted by the user? by a mod? by flags?
- What happens when the answer is deleted and the reputation is already refunded (yes, that should be obvious... but start thinking about the logic)
- What happens if a down vote is reversed? through a serial down vote detection?
- Does a comment from a custom close message count?
All of this makes it a complete mess to try to have a way to refund down votes. Instead, consider down votes as an investment in the quality of the site - they help filter good posts from poor posts, provide signal into the low quality rate limits and low quality review queue. And if the post is some day deleted, the reputation is refunded.
Additional, leaving comments as they are rather than encouraging additional noise and snark in the system is likely a good thing. Users can leave comments and down vote if they want, or not. Comments themselves are "second class citizens" in many parts of the site design that are intended for more transient information (such as clarifications and improvements) that should find their way the body of the post. While the clarification comments could be such, they may also not be clarifications and thus additional unintended use of comments should be avoided.
I will also point out the 'down vote witch hunts' that sometimes go on. Having someone comment and then someone else anonymously down vote would can lead to incorrect reprisals (not that one should ever attempt to down vote for reprisals) - this doesn't need to be encouraged by giving the suggestion that down votes come from commenters.
Related MSE posts: