-8

If older flags are being aged away because there aren't enough people to approve or reject them, like this question suggests Why were my older close flags "aged away"? , then would it be worth lowering the limit on when members can review them?

For example if the community dropped the limit to those with a reputation of 1.5k to be able to review flags then that would clear them quicker. If needed then a flag could be approved with the sign off from one member over 1.5k but another over 2k?

18
  • 8
    No, we don't need to lower the limit. What we need is to get the people who can review to review. Only a small fraction of the total people that can review actually do. Aug 28, 2017 at 17:22
  • 1
    What percentage of people that can review do review?
    – ChrisM
    Aug 28, 2017 at 17:24
  • Also if flags are getting aged away and those that can review aren't doing so then don't other options need to be looked at? I am making one suggestion that could be implemented but you have just made a comment about more people who can reviewing with no comment on how that would be done?
    – ChrisM
    Aug 28, 2017 at 17:28
  • I don't have the exact numbers but there are 80K+ people with close vote privileges. That many people could review ~16K reviews per day. Right now we're more than half way through the day and we have only done ~1K review. Aug 28, 2017 at 17:30
  • 2
    But are those 80k people active on the site? If they aren't then they don't really count. In any case is my suggestion realistic or not, or is it something that could be open to discussion?
    – ChrisM
    Aug 28, 2017 at 17:32
  • I'm not sure. They all have 3K+ rep and generally higher rep people are active so I would say a good chunk of them are. Aug 28, 2017 at 17:33
  • Makes sense. Has getting more people to review been addressed anywhere that I have missed?
    – ChrisM
    Aug 28, 2017 at 17:35
  • There was this. There are probably others, just not enough time to search for them now. Aug 28, 2017 at 17:38
  • Thanks you. I will have a look.
    – ChrisM
    Aug 28, 2017 at 17:40
  • We need to raise the bar for being able to flag, not lower the bar for review. A good percentage of what I review in the close vote queue for stuff that doesn't have any close votes (was flagged by someone with less than 3K rep) does not need to be closed at all. If I didn't waste all that time clicking "leave open" on stuff that doesn't need to be closed, I could spend more time closing stuff that does need to be closed.
    – user4639281
    Aug 28, 2017 at 17:43
  • 1
    Lots of people review, there are ~2500 new reviewers every week. But only ~7000 of them are active per week. It is galley slave labor, people just burn out on it in less than a month. Having them burn out sooner doesn't help anybody. Aug 28, 2017 at 17:43
  • If people burn out quickly then how about the opposite of what I have suggested and limit how many they can review for the first few weeks or until their reputation gets higher again?
    – ChrisM
    Aug 28, 2017 at 18:32
  • @ChrisM there is a limit of 20 reviews per queue per day.
    – tima
    Aug 28, 2017 at 19:54
  • @NathanOliver According to my SEDE query, there are 33k users over 3k reputation only that have been active in the last 30 days.
    – Magisch
    Aug 29, 2017 at 7:59
  • @NathanOliver and whoever finds it interesting: I wrote this query to analyze how many eligible reviewers were on vs how many review tasks have been completed in the last 30 days using SEDE. Results: 161122 users above 500 reputation were online at least once in 30 days and in that timespan 146666 first post and late answers reviews were completed. 55326 users above 2k were on and 175280 suggested edit and low quality post reviews were completed,
    – Magisch
    Aug 29, 2017 at 8:29

1 Answer 1

2

Of the review queues, the one that desperately needs more reviewers is the Close Votes queue. While the others have a manageable number of posts that can be adequately handled by the available reviewers, Close Votes has hovered at well over 5k posts for quite some time now, recently sitting at >9k for many months.

The problem with this queue is that reviewing effectively requires the reviewer to have close vote privileges, which you don't earn until 3k reputation.

So…basically what you are proposing here is that the close vote privilege be reduced, and I just can't get behind that proposal. We intentionally set this privilege at a relatively high reputation level to ensure that the only people who get to close other people's questions are those with a good grasp of what is/is not suitable for this site. In order to make valid decisions regarding closure, you need a non-trivial amount of experience on this website in particular, and that's what reputation most accurately measures.

I agree that we need to figure out a way to reduce the number of close flags that age away, because that's a horrible system—off-topic questions don't get more on-topic just because there aren't enough people to close them. I just don't think this is the right solution. Instead, I would prefer increasing the weight of close votes for experts, especially those users who hold gold badges in relevant tags. They are the most capable of assessing whether a question is on-topic, clear, or too broad. I personally think they should have binding votes, just as they do for duplicates, but even if you can't get behind that, you should be able to get behind doubling or tripling the weight of their votes.

7
  • A quick query shows that 37970 users that can close or reopen have been active in the last 30 days and those have completed a total of 65744 close & reopen reviews in the same timespan.
    – Magisch
    Aug 29, 2017 at 8:42
  • Cool numberz. Dunno what they mean, though.
    – Cody Gray Mod
    Aug 29, 2017 at 8:56
  • That 37970 users have all together completed a total of 65744 close and reopen reviews in the last 30 days.
    – Magisch
    Aug 29, 2017 at 8:57
  • I wasn't proposing the close vote privilege be reduced. I was proposing the limit for reviewing was lowered. If the only queue that doesn't get cleared is the closed review then I guess it does suggest that, although I wasn't aware of that before. Thanks for the feedback, it was interesting to get a bit more insight into how the reviewing builds up.
    – ChrisM
    Aug 29, 2017 at 15:33
  • @Chris How would you propose that one review questions for closure if he didn't have close-vote privileges? What actions would be available to you in the queue? (Oh, guess your edit answered that. Okay then.)
    – Cody Gray Mod
    Aug 29, 2017 at 15:35
  • The question wasn't aimed at closure reviews. I am only aware that that is the queue that builds up most because of your answer. Are the only reviews to be aged away closure reviews? Yes, had edited after, you were to quick to reply :)
    – ChrisM
    Aug 29, 2017 at 15:38
  • 1
    Yes, closure reviews (and possibly re-open reviews, but they're just two sides of the same coin) are the only ones that age away. The other ones get adequately handled by the community. Low Quality Posts (which is fed by "not an answer" and "very low quality" flags) are escalated to moderators if the community doesn't handle them. It's worth noting that it only takes 500 rep to get started reviewing right now; you just can't access certain review queues that require more privileges to take meaningful action.
    – Cody Gray Mod
    Aug 29, 2017 at 15:46

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .