Spurred on by this question and subsequent discussion, I decided to do a bit of research into what would happen if we let the Roomba loose on poorly received answers.
The results are interesting, to say the least.
Negatively scored answers on Stack Overflow - aggregation by last edit date
The rule being followed for now: the answer has been edited in the last X days, where X is 30, 60, 90, 180, or 365 days. I can edit the query to incorporate other rules if we want to see that.
The main thing to call out is that I doubt we'd be losing any substantial answers with a move like this. Notice that after a year of no edits and a score of -3 or below, there are lots of answers (roughly 33K) that could be culled because they could be really poor.
Of course, this doesn't take into account the fact that the question may be on a low-traffic tag or that the question itself was particularly heinous (although that's even more impetus to make the question and answer pair go away), but it does offer something.
I'm interested in something like this since it seems that there's a bit of tension as to when we should use our delete votes, and whether or not using them on posts that really don't answer the question (but are attempts at an answer, as is a very heated topic in these parts) is a valid action. My gut tells me that the system should be able to cull crappy answers from the site instead of relying on a gang of 20K+ users who have a ton of free time on their hands.
I've also put together a follow-up query to answer some other questions:
- What about accepted answers?
- What about a breakout between upvotes and downvotes?
That query is here:
Negatively scored answers on Stack Overflow - upvote, downvote, and acceptance breakouts
Determining if an answer is "tightly" scored is entirely too tedious to do, and the key point we want to discover is the average between the upvotes and downvotes across all answers scored at a specific value. I've provided that, and the trend is what I'd expect: as the score total gets lower, the likelihood of the answer being upvoted increases, which may not have any ultimate bearing on its quality at all.
Also, the breakout on accepted answers indicates to me that the most likely scenario you'll see an answer with a negative score that's accepted is one that has a score of -1. The likelihood of occurrence is practically cut in half with any other scores. That said, the fact that an answer may be accepted doesn't factor in a lot, but I'm not sure that the script should be allowed to delete an answer that's accepted without really considering more edge cases.
Thoughts? Concerns? Issues with the query?