In my opinion, downvotes on answers are way more rare than downvotes on questions, yet you suggest to increase the penalty on the downvoter of the answer rather than suggest a rework on question downvotes (which would have at least a little more success than this one.)
- Currently, it costs 0 rep to downvote a question.
- It also costs 1 rep to downvote an answer.
- Downvoted material causes the poster to lose 2 rep per downvote.
Therefore, the way I see it, your suggestion should be to increase the penalty on the poster whenever an answer is downvoted because currently, answers are only downvoted for the following reasons:
- Revenge Voting
- Very wrong answers
- Answers that do nothing to answer the question
- Incomplete Answers
- Spam / Offensive
- Answers with only code/links without a speck of explanation.
- Unreadable Text (Including, but not limited to: lack of punctuation, ALL CAPS, several spelling issues, severe formatting issues (especially with code), etc)
- (On Meta Only) Disagreement with the answer
Otherwise, downvotes on answers are very few for any other reason. Therefore, if you have a ton of frequently downvoted answers, it is probably because your answers contribute almost nothing; the -1 rep penalty is enough to dissuade most people from just downvoting answers because they can.