We've just about hit equilibrium here: Fuzzy the number of questions in the close review queue, a dopamine for the shutterers
The number of questions in the queue is falling slowly, but I don't think we're going to clear it out any time soon. And even if we did, that would just mean re-introducing a gigantic backlog of questions with only 1 vote or flag on them - thus bringing us back to where we started.
This was intended to be a temporary solution, to catch what fell through the cracks - I think it's safe to say we've done that, but continuing this way long-term is actively harmful to the goal of getting bad questions closed quickly.
So let's try a more focused approach...
Once upon a time, all close votes aged away after 4 days. This was great for not having a backlog - but terrible for folks active in obscure topics where the number of close voters was small. The current vote-aging system was put into place to address this, at the cost of a perpetual backlog.
I think we can have the best of both worlds. Here's what I propose:
- Two parameters:
- FlagsAgeDaysThreshold: the number of days old the newest vote or flag must be for a question to remain under review. Default value: 4
- FlagsThreshold: the number of votes or flags required for a question to remain under review once FlagsAgeDaysThreshold has been exceeded. Default value: 3.
- A single vote or flag on a question will send it into /review.
- After FlagsAgeDaysThreshold has been exceeded, the question will be removed from review if FlagsThreshold has not been met.
- Existing aging rules will still apply - votes will not be discarded until they are met.
- If a question aged out of review and later attracts another vote or flag, it will re-enter review until either FlagsAgeDaysThreshold or FlagsThreshold are no longer met.
If this were implemented today, the queue length would immediately drop to 7,531, and I suspect remain fairly stable at that level - we would want to adjust FlagsThreshold as necessary to keep a reasonable backlog however (1-2 thousand at minimum), so as to encourage filtering and discourage review-racing.
This would allow egregiously-bad questions to be closed more quickly, while preventing borderline questions from hanging around in limbo waiting for votes.
Unlike the current system, I believe this could be operated indefinitely (with proper adjustments to the parameters) without negatively impacting the community's ability to quickly close poor questions.