6

I noticed a user who is systematically approving edits, even terrible ones. All of these rejected edits have been approved by this reviewer, and he of course fail his audits too.

When you look at his review timestamps, it seems that the user just waits until the approve button is enabled to click it - he surely doesn't have the time to read anything in 3 seconds:

2016-01-29 08:21:48
2016-01-29 08:21:43
2016-01-29 08:21:39
2016-01-29 08:21:36
2016-01-29 08:21:33
2016-01-29 08:21:29
2016-01-29 08:21:26

I don't have clear evidence of that, but I think he's doing the same for his LQP reviews (all posts "looks ok" so far).

I custom-flagged one of the edit to warn moderators about this, but considering this behavior is pretty common there might be a better way to prevent this:

How about increasing the freeze time on the review buttons? I don't feel like there is any review you could possibly correctly accomplish in 2 seconds. Maybe force reviewers to stay for 10 seconds on the review page will force them to read? With a little message while the freeze is running, something like:

Please wait x seconds to review this edit. Use this time to read the edit thoroughly.

I'm aware that after failing few audits the user will be banned from review, but in order to educate users to properly review, this might be a solution to avoid the "robo reviewing".

What do you think about this?

13
  • 2
    After failing too many review audits, he will be automatically banned from reviews, so what is the problem? Commented Jan 29, 2016 at 10:33
  • @Gothdo : It could be that he didn't know that. I certainly didn't know that.
    – KarelG
    Commented Jan 29, 2016 at 10:34
  • 3
    That is exactly why there is a limit to reviews per day, and a review doesn't depend on one person.
    – David
    Commented Jan 29, 2016 at 10:35
  • 1
    @Gothdo the question is what we can do. Sure, you can wait until the system catches it, but then the harm is already done. The problem is that there is yet another user who uses this site for the shiny badges, and couldn't care less for quality. We better get rid of such users. That being said, this is a duplicate of many questions.
    – CodeCaster
    Commented Jan 29, 2016 at 10:35
  • @Gothdo I'm not sure you understand my question. When noticing an user who's on the path to be banned from review, what's the right course of action to take? Can't we educate the reviewer, sent him some warning before he get banned to get it back in the right path?
    – vard
    Commented Jan 29, 2016 at 10:35
  • @CodeCaster I would be interested if you could point me to those duplicates - I searched before asking on meta and didn't find any question helpfull.
    – vard
    Commented Jan 29, 2016 at 10:38
  • 2
    You can @-comment on any of their posts. Or contact them in chat. But if a user has ignored the "STOP! Look and Listen" that they've had (apparently) multiple times.... I doubt it'll help. Commented Jan 29, 2016 at 10:38
  • 2
    See Are we supposed to flag bad reviews?: "If you see a clear pattern of a particular user making careless reviews, and suspect them of abusing the review queues, you can flag for that".
    – CodeCaster
    Commented Jan 29, 2016 at 10:39
  • @CodeCaster Fair enough. I will flag one of the failed review, though that doesn't really answer the second question.
    – vard
    Commented Jan 29, 2016 at 11:00
  • 1
    That's what you get for asking two completely different questions at the same time. #2 sounds like a decent FR. You should flesh that out and submit it for review.
    – user1228
    Commented Jan 29, 2016 at 14:10
  • 1
    Limiting the speed won't help. Worse, it will make it harder to spot the robots - if you see 10 or more approvals in a minute, you know it is a robo-reviewer, and you can take action. Don't take this clue away from us! Commented Feb 8, 2016 at 16:06
  • @S.L.Barth I don't think it address robo-reviewers only - a lot of poor reviews are not done by robo reviewers. And I thought the audits were there for this exact intent: spot the robo-reviewers. This will not be changed by increasing the freeze time.
    – vard
    Commented Feb 9, 2016 at 8:04
  • @vard Either way, I don't think slowing reviewers down will help. We need to educate the reviewers. There are a few feature requests for that, but AFAIK Stack Exchange hasn't acted upon them yet. At least not openly. Commented Feb 9, 2016 at 8:10

1 Answer 1

6

When they consistently fail the audits, you don't have to do anything... it will catch up with them, and they will get a well-deserved review suspension.

You could also contact them, and talk with them. Whether or not this is going to be effective depends on the user.

If you suspect deliberate abuse, or if they won't listen when you talk with them... you can also flag them for moderator attention. You find a few recent, bad reviews - then use a custom moderator flag on one of their posts.

Limiting the speed with which we can do reviews is not going to help. Robo-reviewers will simply review as fast as the system lets them. What could help is better audits, and perhaps better guidance for reviewers.

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .