20

After this question (Adding a threshold for closing/reopening duplicate question to limit "robo-reviewers") where nothing will be done, I am wondering if I can at least flag "robo-reviewers"?

I am really tired about trivial duplicates reopened by two blind votes from users with no activity in the related tag. The two votes usually come after an automatic reopen vote done by the OP where no edit is made to the question or the trivial edit "my question isn't a duplicate .."

Here are some screenshots of a user involved in the reopening of some questions that should be kept closed (I manage to re-close them again with the help of another Gold badge)

enter image description here

enter image description here

Based on the above, it's hard for me to believe that we can review a question within a few seconds. 4 questions in only 30 seconds considering the time for the page to reload, to read the question (to check the duplicate if it's about duplicate closure) and to click the button. This is not the only pattern, I found a lot for the same user and many other users.

Is such behavior worth a flag?

Most important question: Are the reopen/close queue safe for spammers? Can they click as fast as possible with no way to stop them (audits, ban, etc.)?


To be clear, I am not accusing a random user based on timestamps. That user (and others) made wrong decisions reviewing some questions. To this I add the fact that they did it for tags where they aren't active and later I consider their reviewing speed. Based on that I concluded that they are a spam reviewer.

19
  • 6
    If they're making incorrect reviews as a result, absolutely you should flag them Commented Jun 22, 2020 at 11:13
  • 4
    ..but it seems they voted to "Leave Closed" :)
    – Scratte
    Commented Jun 22, 2020 at 11:21
  • 4
    @Scratte I picked a random pattern to highlight the speed factor because I think we need more than 30s to review 4 questions Commented Jun 22, 2020 at 11:22
  • 1
    Yes, you are right of course. I was just a little confused for a moment there. There is also a chat room for bad reviews, though I am not sure if you can directly post users in there.
    – Scratte
    Commented Jun 22, 2020 at 11:24
  • 3
    Note that it strongly depends on the question how long a review takes. On some, the decision to hit leave closed can take mere seconds. Deciding to reopen, however, should always take some time.
    – Erik A
    Commented Jun 22, 2020 at 11:27
  • @ErikA true, but I discovered such repeated pattern after I discovered many bad decisions so it was another argument to consider this as spam. This also raises the issue of having such queue free from any control (unlike others where we have audits) Commented Jun 22, 2020 at 11:36
  • @Scratte that room seems to deal only with editing Commented Jun 22, 2020 at 11:41
  • @TemaniAfif It was used to post only bad Triage reviews, but I have posted both Late Answers and First Posts in there. Now the starboard says "I think we can relax the only-Triage rule now since the campaign is over. Feel free to report any egregious review that needs attention" by Samuel Liew, so I think any review can be posted there.
    – Scratte
    Commented Jun 22, 2020 at 11:46
  • @Scratte the bad review I discover are related to question I myself close with gold badge. I can easily fix them by calling another gold badge, this isn't an issue BUT my concern is how to prevent/stop this because it's difficult to identify since there is no control over that queue and if I am able to identify few cases because I was involved in the closure, there is for sure more than that with no way to identify them Commented Jun 22, 2020 at 11:52
  • 1
    There are audits for both the Close Vote queue and the Reopen queue, so I assume they cannot continue clicking mindlessly. But as Nick pointed out, flagging as a good option when you notice such. Finding a new innovative way to handle it needs a proper Answer though.
    – Scratte
    Commented Jun 22, 2020 at 12:08
  • @Scratte good to know there is audits for this but I am wondering if there is audits with duplicate close reason. Commented Jun 22, 2020 at 12:13
  • to be honest, the people do what they can, and try to help reviewing the cr... other people wrote. Sometimes the cr.. is as bad as it comes and you can click fast forward, a typo corrected for example, hightlight of text and such sh... so without knowing what exactly was to be review your images and highlighted reviews doesn't tell us nothing..just my 2 cents
    – nbk
    Commented Jun 22, 2020 at 13:36
  • 1
    @nbk I am not talking about reviewing edits. This is out of the scope of the question. I am talking about openinig/closing question where you need to at least read and understand the question and sometimes also read the duplicate. The images I shared show reviews related to "closed" question Commented Jun 22, 2020 at 13:39
  • 1
    @nbk as I also stated in my question, I noticed that such user are reviewing question with tags where they have 0 activity. If you have at least 10 Rep in the related tag then I may consider this as a different opinion but someone reopening a trivial duplicate where I see no activity in the related tag is suspicious for me. Commented Jun 22, 2020 at 13:51
  • 1
    @TemaniAfif Also consider that the questions might have all been really bad. It might have been open ended questions that the user spammed.
    – 10 Rep
    Commented Jun 22, 2020 at 14:59

1 Answer 1

4

Yes...if they're making mistakes.

Sometimes I can tell a question is bad the moment I look at it. If the question body is just a screenshot of an app's UI with "it doesn't work, why could this be? anyone know?" under it, there's a good chance I'll cast my vote within 10 seconds of opening the review. Questions this bad are fairly common in the tag I curate most.

But if, like here, someone's going fast and either missing things or just blatantly guessing, you should definitely flag that (by putting a custom flag linking to examples on a relevant post). It's worth doing this for people reviewing incorrectly even if they're doing so more slowly, too. But the combination of fast + wrong is worth calling out in the flag.

1
  • I see the theme isn't actually the speed, but the accuracy, so "slow and wrong" is just as bad as "fast and wrong" :)
    – Scratte
    Commented Apr 26, 2021 at 10:48

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .