Five 'Close' votes* from regular users are needed to close a question (or put it 'on hold') (reference).
*Close votes can be of types: 'Close' (can be cast from inside or outside the review queue); and 'Do Not Close' (aka 'Leave Open'), besides 'Edit' or 'Skip' (all cast from inside the review queue).
Proposal:
Close a question (sooner than collecting 5 'Close' votes total), when there are 3 leading 'Close' votes ('Close' votes cast both from inside and outside the review queue).
By '3 leading Close votes' it is meant the first 3 votes cast to close a question without them being intervened by an edit (from inside or outside the review queue) or by a 'Leave Open' vote in the Close Votes review queue.
If there are edits or 'Leave Open' votes among first 3 'Close' votes, then continue applying current rule (5 votes threshold).
Some examples. Consider the following order/sequence of events in question:
- [1st vote: 'Close', 2nd vote: 'Close', 3rd vote: 'Close'] --> apply the new rule (close sooner).
- [1st vote: 'Close', 2nd vote: 'Edit' (from the queue), ... ] --> don't apply the new rule.
- [1st vote: 'Close', 2nd vote: 'Close', edit occurs (from outside the queue), ...] --> don't apply the new rule.
- [1st vote: 'Close', 2nd vote: 'Close', 3rd vote: 'Leave Open', ...] --> don't apply the new rule.
- [1st vote: 'Close', 2nd vote: 'Leave Open', ...] --> don't apply the new rule.
- etc.
Again, all types of 'Close' votes are valid (cast from inside or outside the Close Votes review queue).
Reasoning:
Most questions which receive 3 leading 'Close' votes end up getting closed anyway (Table 1). Why not redirect the surplus of review votes on currently approximate 8k questions waiting for review in the Close Votes review queue?
Motivation for asking:
Many close votes I have cast are aging away (i.e., expiring without the review process is completed). It feels my volunteer time trying to curate the site is not being fully availed. Actually, this is corroborated by this SEDE query (which is discussed here) where up to 94% of close vote review tasks do not get completed. Amazing!
Data showed we can be more efficient using close votes without being less or more rigorous in closing than we already are. It could take effect immediately, without prejudice to other proposals of the like being implemented now or in the future.
Data (and method) for supporting proposal:
Here is a query which measures the amount of questions which ended up closed after it received 3 leading 'Close' votes in the Close Votes review queue**.
**I used data only from the review queue, because it is what is available in SEDE (i.e. wanted to use data from 'Close' votes cast outside the queue as well, but I don't think it is possible).
There are some highlights and limitations from this query, worth of listing:
- It considers as the first 'Close' vote, the one which triggered the review task (so, it is always the amount of votes in the
ReviewTaskResults
table + 1 'Close' vote). It happens a review task can be triggered by a close vote or a flag, and here we are considering a flag as a close vote (as if the user had the privilege). This is a conservative criterion because it bias the final result of the review towards not closing (one additional close vote is required if review task was triggered by flag). It seems there is no way to query in SEDE for reviews triggered only by close votes (see here). - As mentioned above, the query is not considering 'Close' votes cast from outside the review queue, except the vote/flag which triggered the review (but they are part of this proposal). I am not sure how I could add those to the query above.
- The query also takes into account posts which had an 'Edit' close vote in the queue (this means if there was an 'Edit' vote among the leading ones, the post is not qualifying for a sooner closure). As mentioned before, it is also part of this proposal, when OP or someone else also edit the question outside from the queue (after one or more close votes are cast), the leading close votes rule should not be applied as well.
- The query is only considering review tasks which had at least 5 'Close' or 'Leave Open' votes total (i.e., 1 'Close' vote which triggered the review plus at least more 4 reviews in the queue). This is to minimize the effect of binding votes from moderators or users with tag gold badges.
Results:
Table 1. Proportion of closed questions as a function of number of leading 'Close' votes cast (the 1st one cast from outside the review queue, and the others from inside the queue).
Amount of leading 'Close' votes Closed_(amount) Closed_(% of total)
------------------------------- --------------- -------------------
2 164789 83.6
3 133819 93.4
4 111451 97.7
Table 1 means that if a question gets 3 leading 'Close' votes, chances of it ending up closed is 93.4% (4 leading 'Close' votes increases closing chances to almost 98%).
Final considerations
With that in mind, I believe the proposal could bring the following benefits:
- Redirection of surplus 'Close' votes to pending reviews in the Close Votes review queue.
- Reduction of time to closure from unclear, broad, opinion-based and off-topic questions preventing off-topic answers to be added.
- Increase in overall signal-to-noise ratio (by having more questions finished reviewing, not only because a surplus of votes is being created, but also due to a less amount of votes aging-away; hypothetically, this would have an exponential effect).
- It does not increase the burden of that very few users (<5% of reviewers) who are already hitting the vote cap at least sporadically (see, here, here, and here).
But what about that other 2%-6%** of questions that despite having 4 or 3 leading 'Close' votes, ended up not being closed?
Let's transfer this cost to OPs, because recently they have already gained useful resources on their side: i) Be Nice policy improved; ii) New Contributor Indicator; iii) Ask Question Wizard.
** Remembering, expect lower proportions of review tasks with result 'Leave Open' because data used in this question was biased towards not closing ('Close' votes outside the review queue were not considered; and 'Close' flags triggering reviews were considered, hence, pushing away the close votes count threshold).