Skip to main content
replaced http://stackoverflow.com/ with https://stackoverflow.com/
Source Link

less should be served when large numbers of reviews, and hence audits have been done successfully.

The problem is, completing a non-audit review does not mean that you made the correct decision. The system has no way of knowing whether your decision was correct or not unless it's an audit. (And even then, audits aren't perfect…*grumble, grumble*.)

Therefore, audits are sporadically inserted into the review queue as you go through it. This is designed to catch people who are doing what we call "robo-reviewing"—basically, not paying attention and therefore making the wrong decision. An incorrect review is worse than no review at all, so we want to catch people who are going through the review queue with their brain turned off and potentially making incorrect decisions.

Audits are not necessarily "training wheels" so much as they are "speed bumps" or "road blocks". Thus, passing (or failing) one of them doesn't indicate much about your competence as a reviewer, so we can't simply take the fact that you've passed x number of them as evidence that you're a good reviewer and therefore don't need them anymore. At any time, the high volume of garbage in the review queues is liable to have turned your brain into mush. An audit will catch this, and either wake you up or cause you to stop reviewing.

I don't have any details on how exactly audits are generated, other than they appear randomly, without respect to your reputation or anything else. Thus, I assume it doesn't matter how many things you've reviewed recently, other than having done more reviews increases your chances of seeing an audit, statistically speaking.

Rene says that, on average, you should expect 2 audits every 50 reviews. I assume he's basing this on empirical evidence, having done lots of reviewsdone lots of reviews.

less should be served when large numbers of reviews, and hence audits have been done successfully.

The problem is, completing a non-audit review does not mean that you made the correct decision. The system has no way of knowing whether your decision was correct or not unless it's an audit. (And even then, audits aren't perfect…*grumble, grumble*.)

Therefore, audits are sporadically inserted into the review queue as you go through it. This is designed to catch people who are doing what we call "robo-reviewing"—basically, not paying attention and therefore making the wrong decision. An incorrect review is worse than no review at all, so we want to catch people who are going through the review queue with their brain turned off and potentially making incorrect decisions.

Audits are not necessarily "training wheels" so much as they are "speed bumps" or "road blocks". Thus, passing (or failing) one of them doesn't indicate much about your competence as a reviewer, so we can't simply take the fact that you've passed x number of them as evidence that you're a good reviewer and therefore don't need them anymore. At any time, the high volume of garbage in the review queues is liable to have turned your brain into mush. An audit will catch this, and either wake you up or cause you to stop reviewing.

I don't have any details on how exactly audits are generated, other than they appear randomly, without respect to your reputation or anything else. Thus, I assume it doesn't matter how many things you've reviewed recently, other than having done more reviews increases your chances of seeing an audit, statistically speaking.

Rene says that, on average, you should expect 2 audits every 50 reviews. I assume he's basing this on empirical evidence, having done lots of reviews.

less should be served when large numbers of reviews, and hence audits have been done successfully.

The problem is, completing a non-audit review does not mean that you made the correct decision. The system has no way of knowing whether your decision was correct or not unless it's an audit. (And even then, audits aren't perfect…*grumble, grumble*.)

Therefore, audits are sporadically inserted into the review queue as you go through it. This is designed to catch people who are doing what we call "robo-reviewing"—basically, not paying attention and therefore making the wrong decision. An incorrect review is worse than no review at all, so we want to catch people who are going through the review queue with their brain turned off and potentially making incorrect decisions.

Audits are not necessarily "training wheels" so much as they are "speed bumps" or "road blocks". Thus, passing (or failing) one of them doesn't indicate much about your competence as a reviewer, so we can't simply take the fact that you've passed x number of them as evidence that you're a good reviewer and therefore don't need them anymore. At any time, the high volume of garbage in the review queues is liable to have turned your brain into mush. An audit will catch this, and either wake you up or cause you to stop reviewing.

I don't have any details on how exactly audits are generated, other than they appear randomly, without respect to your reputation or anything else. Thus, I assume it doesn't matter how many things you've reviewed recently, other than having done more reviews increases your chances of seeing an audit, statistically speaking.

Rene says that, on average, you should expect 2 audits every 50 reviews. I assume he's basing this on empirical evidence, having done lots of reviews.

added 221 characters in body
Source Link
Cody Gray Mod
  • 244.2k
  • 84
  • 721
  • 763

less should be served when large numbers of reviews, and hence audits have been done successfully.

The problem is, completing a non-audit review does not mean that you made the correct decision. The system has no way of knowing whether your decision was correct or not unless it's an audit. (And even then, audits aren't perfect…*grumble, grumble*.)

Therefore, audits are sporadically inserted into the review queue as you go through it. This is designed to catch people who are doing what we call "robo-reviewing"—basically, not paying attention and therefore making the wrong decision. An incorrect review is worse than no review at all, so we want to catch people who are going through the review queue with their brain turned off and potentially making incorrect decisions.

Audits are not necessarily "training wheels" so much as they are "speed bumps" or "road blocks". Thus, passing (or failing) one of them doesn't indicate much about your competence as a reviewer, so we can't simply take the fact that you've passed x number of them as evidence that you're a good reviewer and therefore don't need them anymore. At any time, the high volume of garbage in the review queues is liable to have turned your brain into mush. An audit will catch this, and either wake you up or cause you to stop reviewing.

I don't have any details on how exactly audits are generated, other than they appear randomly, without respect to your reputation or anything else. Thus, I assume it doesn't matter how many things you've reviewed recently, other than having done more reviews increases your chances of seeing an audit, statistically speaking.

Rene says that, on average, you should expect 2 audits every 50 reviews. I assume he's basing this on empirical evidence, having done lots of reviews.

less should be served when large numbers of reviews, and hence audits have been done successfully.

The problem is, completing a non-audit review does not mean that you made the correct decision. The system has no way of knowing whether your decision was correct or not unless it's an audit. (And even then, audits aren't perfect…*grumble, grumble*.)

Therefore, audits are sporadically inserted into the review queue as you go through it. This is designed to catch people who are doing what we call "robo-reviewing"—basically, not paying attention and therefore making the wrong decision. An incorrect review is worse than no review at all, so we want to catch people who are going through the review queue with their brain turned off and potentially making incorrect decisions.

Audits are not necessarily "training wheels" so much as they are "speed bumps" or "road blocks". Thus, passing (or failing) one of them doesn't indicate much about your competence as a reviewer, so we can't simply take the fact that you've passed x number of them as evidence that you're a good reviewer and therefore don't need them anymore. At any time, the high volume of garbage in the review queues is liable to have turned your brain into mush. An audit will catch this, and either wake you up or cause you to stop reviewing.

I don't have any details on how exactly audits are generated, other than they appear randomly, without respect to your reputation or anything else. Thus, I assume it doesn't matter how many things you've reviewed recently, other than having done more reviews increases your chances of seeing an audit, statistically speaking.

less should be served when large numbers of reviews, and hence audits have been done successfully.

The problem is, completing a non-audit review does not mean that you made the correct decision. The system has no way of knowing whether your decision was correct or not unless it's an audit. (And even then, audits aren't perfect…*grumble, grumble*.)

Therefore, audits are sporadically inserted into the review queue as you go through it. This is designed to catch people who are doing what we call "robo-reviewing"—basically, not paying attention and therefore making the wrong decision. An incorrect review is worse than no review at all, so we want to catch people who are going through the review queue with their brain turned off and potentially making incorrect decisions.

Audits are not necessarily "training wheels" so much as they are "speed bumps" or "road blocks". Thus, passing (or failing) one of them doesn't indicate much about your competence as a reviewer, so we can't simply take the fact that you've passed x number of them as evidence that you're a good reviewer and therefore don't need them anymore. At any time, the high volume of garbage in the review queues is liable to have turned your brain into mush. An audit will catch this, and either wake you up or cause you to stop reviewing.

I don't have any details on how exactly audits are generated, other than they appear randomly, without respect to your reputation or anything else. Thus, I assume it doesn't matter how many things you've reviewed recently, other than having done more reviews increases your chances of seeing an audit, statistically speaking.

Rene says that, on average, you should expect 2 audits every 50 reviews. I assume he's basing this on empirical evidence, having done lots of reviews.

Source Link
Cody Gray Mod
  • 244.2k
  • 84
  • 721
  • 763

less should be served when large numbers of reviews, and hence audits have been done successfully.

The problem is, completing a non-audit review does not mean that you made the correct decision. The system has no way of knowing whether your decision was correct or not unless it's an audit. (And even then, audits aren't perfect…*grumble, grumble*.)

Therefore, audits are sporadically inserted into the review queue as you go through it. This is designed to catch people who are doing what we call "robo-reviewing"—basically, not paying attention and therefore making the wrong decision. An incorrect review is worse than no review at all, so we want to catch people who are going through the review queue with their brain turned off and potentially making incorrect decisions.

Audits are not necessarily "training wheels" so much as they are "speed bumps" or "road blocks". Thus, passing (or failing) one of them doesn't indicate much about your competence as a reviewer, so we can't simply take the fact that you've passed x number of them as evidence that you're a good reviewer and therefore don't need them anymore. At any time, the high volume of garbage in the review queues is liable to have turned your brain into mush. An audit will catch this, and either wake you up or cause you to stop reviewing.

I don't have any details on how exactly audits are generated, other than they appear randomly, without respect to your reputation or anything else. Thus, I assume it doesn't matter how many things you've reviewed recently, other than having done more reviews increases your chances of seeing an audit, statistically speaking.