In the spirit of science, we're going to run a test on the Low Quality Review Queue.
Current Problem
After pulling some stats about how the LQRQ is performing, we confirmed that review is handling a ton of posts, but it's not able to process them fast enough. The review queue gets 60 minutes to handle the post before it also heads to the moderator queue. If it's not completely reviewed in the 60 minutes, then either the moderators or review can handle the post.
In the last 30 days, 11,987 flags have been sent into the review queue. Of these:
- the community handled roughly 22% of them
- 4.5% were completed in less than 60 minutes
- 3% were cleared in 60 to 120 minutes
- 3% were processed in 120 to 180 minutes
- 2% were handled in 180 to 240 minutes after the flag was in review
- and 9% were processed in over 240 minutes
What's Changing?
Currently, we require a post to accumulate 6 Recommend Delete & Delete reviews. Over the next 30 days, we're going to adjust this to 4 Recommend Delete & Delete votes to dequeue a post.
We don't want things waiting in review for hours to be handled by the community, so we're testing if lowering the number of recommend delete and delete votes will move things along.
What Happens At The End Of The Test?
When the 30 days are up, I'll rerun the queries to see if the review queue is able to dequeue posts before the moderators can handle them. Ideally, we'd see an increase in the number of posts being handled by review during the 60 minutes before they hit the moderator queue. After some sanity checking on the accuracy of the review queue at 4 votes, we'll specifically look for the following:
If we see an 20% increase in what the review queue is handling, then we will assume this is a success and we'll consider leaving the new settings in place.
If we don't see the 20% increase in what review is handling, then we'll have to reevaluate the settings and see what steps to take next.
What's Next?
Just do what you always do. If you review in the Low Quality queue, then continue as you normally would. We expect most users will continue their normal patterns during the test.
I'll be back in 30 days to report what happened.