First, while it's a piddly amount, you can get a headstart on this by giving back the 25 rep you've earned from this answer.
Second, if I've said this once I've said it a hundred times by now: the mob can get it wrong. Just because a question is downvoted doesn't always mean that the question is bad. I realize and respect that this is the held convention, but again, because people can vote on their feelings rather than logic, it becomes problematic when decent questions get obliterated.
Third, you haven't worked out the mechanics for this. At any point in time if a question dips negative, would that mean that hundreds or thousands of reputation gets calved from an account? Using Mystical's venerable example, if this question were to mysteriously be downvoted below zero, how much rep would be lost from each answerer? It scares me to think that potentially thousands of reputation could disappear in an instant.
Lastly, this kind of thing projects an opinion of quality unto others, something I've made noise about before, which isn't really a good side-effect. You should vote for a question based on its merits, and answer a question if it's on-topic based on its merits, not based on what a group of people think of it at any given time. The mob can be fickle at times.