What are review audits; how is the correct action determined and what happens if you fail one?
-
I'm just curious why so many of you are marking this too broad when I have specific questions– user4413591Commented Feb 9, 2015 at 22:36
-
3Also, reading over this post should help answer your first two questions.– KendraCommented Feb 9, 2015 at 22:41
-
Ok, I limited it to the last one– user4413591Commented Feb 9, 2015 at 22:41
-
4Kudos for taking the feedback to heart. :) This particular question is answered in the FAQ section of Meta Stack Exchange. The post in question is here. It currently does not address Triage, however, but here's a post that does. Triage is relatively new, and so are the audits, so those will likely be added to the FAQ later.– KendraCommented Feb 9, 2015 at 22:44
1 Answer
There are currently two types of audits:
Known-good audits are generated from posts that have a lack of negative signal (close votes, downvotes), and a plethora of positive signals (upvotes, views, actions from high-rep users).
Failing to mark a known-good audit as "Looks OK" may be considered a failure; marking it as "unsalvageable" will certainly fail it.
Known-bad audits are generated from posts that were deleted for being spam.
Failing to mark a known-bad audit as "unsalvageable" may be considered a failure; marking it as "Looks OK" will certainly fail it.
A failed audit will give you a stern warning. A sufficient number of failures in a short period of time may result in a temporary removal of reviewing privileges.
See also: What are review tests (audits) and how do they work?
-
1What do you mean by may fail it if I fail to do the right action without doing the completely wrong action?– user4413591Commented Feb 10, 2015 at 1:22
-
3Strictly-speaking, both types of audits have only one choice that is correct - but "needs improvement" may pass either one depending on how we've configured the system. Eventually, expect both to fail.– Shog9Commented Feb 10, 2015 at 1:23
-
1@Shog9: "may pass"? As in, there's some percent-chance to pass, or some arbitrary hidden variable that makes it a pass? That seems counter to the educational role of audits, as people only get feedback about their errors some of the time, and other times the same action passes. Commented Feb 10, 2015 at 2:11
-
-
@Shog9: I was replying to that comment. I don't understand why you'd choose to let "needs improvement" sometimes pass the audits given there is only one correct choice. Commented Feb 10, 2015 at 2:13
-
Lack of confidence in the "known-good" selection logic, @Jeffrey. We've beefed it up considerably, but... still a bit gun-shy. As I said, this behavior is temporary - the purpose is to gather information on which audits are less-than-clear-cut.– Shog9Commented Feb 10, 2015 at 2:15
-
@Shog9 Tracking which audits are questionable (failed the most by users who pass most audits, or whatever metric) seems orthogonal to letting some wrong answers pass for opaque reasons. But we're veering into chat, so I'll wait for you to explain yourself if/when you present the data you collected and/or the triage feature "graduates from beta". Commented Feb 10, 2015 at 2:19
-
3In my opinion, "Should Be Improved" should not be considered a failing response for many of the audits that have been presented to me that were from the Known-Good pool. Several of the ones I have seen definitely could use an edit for formatting, grammar, spelling, etc. Each such automatically chosen question/answer might be a good question/answer, with good content, but that does not mean that they actually reach the level which a conscientious reviewer would rate them as "Looks OK". Unfortunately, even an edit by a high rep user is not sufficient to guarantee such issues are solved.– Makyen ModCommented Feb 11, 2015 at 1:23
-
@Makyen See meta.stackoverflow.com/questions/284315/… -- it seems if a post is answerable as-is, it Looks OK, even if editing could make it better. Commented Feb 11, 2015 at 22:33