108

There are many easy ways to tell that a review task is really an audit. You can just visit the link for more information about the actual post before making a decision. You can examine timestamps. And there are probably many other tricks/exploits to passing a review audit.

If review audits are so obvious and easy to pass, why do they exist? Should I report this as a bug?

Return to FAQ index

2
  • 4
    The "OP" of an "attention test" question usually has no reputation, badges and name like "user21371234", I agree that it is too obvious
    – radrow
    Commented Jan 19, 2019 at 11:37
  • 4
    @radrow To notice that means you've been paying attention. So you passed.
    – Anonymous
    Commented May 7, 2021 at 23:10

1 Answer 1

129

No, this is not a bug. Audits are not designed to be challenging, so there is no need to report "bugs" when you discover clever ways to figure out what review tasks are really audits. There's also no need to report "mistakes" in the review task that give away the fact that it's an audit, even if they don't occur in normal audits. These mistakes are included on purpose.

From the beginning, the purpose of the review audits is twofold: to prevent "robo-reviewing" and help guide new reviewers.

"Robo-reviewing" is mindless clicking to quickly process reviews without giving any thought at all to the review. Often this is to try to quickly process reviews and earn badges with minimum effort. Audits help stop this mindless reviewing by periodically checking that a reviewer is actually paying attention. Failing enough audits can lead to a review ban to help prevent future robo-reviewing. Audits are trying to catch these robo-reviewers, so the audits should be easy for legitimate reviewers to pass.

The other purpose of audits is to help guide new reviewers. This means that audits are supposed to be clear-cut and even obvious by design. Without such a black-and-white task it would be hard to properly educate new reviewers. The most important part of audits is teaching reviewers to eliminate spam. In fact, a lot of audits are based on spam.

TL;DR If you are paying enough attention and spending enough time on a review task to figure out that a review is an audit, then the audit has already done its job.


On the other hand, if you feel that a given audit is absolutely terrible (in either direction – an objectively good post expecting a negative action or an objectively bad post expecting a positive action), simply perform the reverse action on the post itself (downvote if it's bad and upvote if it's good), outside the review queue, to prevent that from ever being an audit again.

Because audits are chosen automatically, bad audits can sometimes happen. If you're not sure, you can post on Meta with the tags for community input.

Additionally, if you spot a user who appears to be robo-reviewing but is somehow passing all the review audits, flag one of their posts for moderator attention and explain the situation. Moderators have the ability to issue manual review bans.

1
  • 1
    Just to know, I just receive an audit where the name of the person who answer was completly removed (so it's different than sometimes "user113213" unclickable). So i was absolutly sure it was an audit, and this is detectable with a bot. So whould we report this or it's just something that make it easier to know it's an audit for real person ?
    – Elikill58
    Commented Sep 13, 2021 at 7:20

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .