Questions tagged [review-audits]
Test items in review queues that are designed to help new reviewers hone their moderation skills, while nudging more experienced users that don't seem to be paying close attention to what they're reviewing.
813
questions
34
votes
1
answer
703
views
Is it possible to review a review audit? [duplicate]
I just failed my first review audit. After having clicked "Looks okay", I was confronted by the failed audit message, however the post itself that I had just reviewed was blank, leaving me unable to ...
24
votes
1
answer
556
views
Can I view a history of my recent review audits? [duplicate]
I failed a review today and I was banned for a few days. I'm OK with it as I understand the reasoning.
But I don't understand the "You have made too many incorrect reviews..." since I think this one ...
328
votes
4
answers
3k
views
Review audit failed after just clicking "add comment"
I had a review audit yesterday, and apparently the answer was a "good answer." I don't disagree that the answer was good, I wasn't going to downvote or flag, simply leave a comment. But as soon as I ...
5
votes
1
answer
122
views
Failed low-quality post audit, why?
Here is the failed audit. here.
I understand that this answer was deleted, and I agree that the answer was not high-quality. But I did not see a particular reason to delete the answer, it was not a "...
8
votes
1
answer
299
views
Failed an audit, why is this spam?
https://stackoverflow.com/review/low-quality-posts/5050600
And for those who can't see the original content:
I did get a warning that the system thinks the answer is spam, but I chose "Looks OK" ...
5
votes
0
answers
161
views
It's easy to robo-review questions and answers with comments!
Just upvote a comment on the answer or question in question. You'll get a nice dialog box telling you that it's already deleted, effectively declaring it's an audit.
85
votes
4
answers
834
views
Create "too minor" review audits that consist of adding a bad tag
The Suggested Edits review queue suffers from robo-reviewers. One thing I see regularly is users serially adding one or a few tags to a lot of posts.
The current review audit system does not catch ...
53
votes
3
answers
2k
views
When, if ever, will I stop getting review audits?
When I crossed reputation to 3k+ I get privileged to mark posts as off-topic or duplicate.
I'm always doing using my privileges to help community to decide whether a post is off-topic or duplicate. ...
3
votes
0
answers
61
views
Failed review - too subjective of a question?
I was stopped by this audit: https://stackoverflow.com/review/close/5018614
I feel that the original question is asking for way too much opinion.
28
votes
4
answers
1k
views
Is an answer that just confirms another answer allowed?
During review, I got this answer. I thought it appropriate to flag as "not an answer", but it turned out to be one of those review audits and apparently, it is considered a high quality answer.
I ...
5
votes
1
answer
165
views
Why did I fail this review audit?
Here is the audit. This is a yes/no question, so I decided to close it. However, I failed the review audit.
Can someone explain this behavior to me?
27
votes
1
answer
1k
views
Can code-only answers be high quality?
I don't like asking about audits, because it sounds like complaining, but I'm not sure about this:
I've been review-banned once, and I haven't failed any audits since then (a few weeks ago), but I ...
3
votes
1
answer
151
views
Failed audit due to Looks Ok
I recently failed an audit (linked here). I feel this is unfair because I did go click the link and went to go downvote it, which would have been my action to take. When I clicked the link to the ...
6
votes
0
answers
115
views
Let's do something better with all those high-voted old closed questions
The reopen queue seems to be flooded with old high-popularity open-ended questions. I just NoActionNeeded'd and downvoted 20 of them. Instead of putting posts in the queue to consider reopening when ...
4
votes
1
answer
109
views
Failed a "late answer" review audit. Was skipping the correct answer?
I noticed some questions in the "late answer" section and looked at them (since it's always 0 when I look at it), and the only options I had were Looks good, I'm Done, and Skip.
It doesn't seem there'...
19
votes
1
answer
223
views
How can I learn from a failed review audit, I can't see the post I was supposed to delete? [duplicate]
I was reviewing in the "low quality posts" queue and I failed a review audit. I got a message saying that the post contained "nothing of value" and that I should have recommended deletion.
My ...
4
votes
0
answers
47
views
close vote review filter not working? [duplicate]
I am reviewing close votes with filter matlab and only duplicate.
However I recently was asked to review this question with a close reason "primarily opinion-based?"
What's wrong with my "duplicate" ...
6
votes
1
answer
100
views
Reopen Votes tests
Today I failed twice on Reopen Votes tests in the Review area (I've done approx. 900 votes so far)
I've always assumed that the close is a true fact and that the tests force me to think about whether ...
15
votes
0
answers
316
views
Automatic review failed - duplicated answer [duplicate]
Today I was doing a first answer review, where someone has posted a very first answer. Interested by the topic, I opened the original question to see other answers, and I found that the best answer ...
2
votes
2
answers
210
views
Is an answer to an off-topic question automatically low-quality?
I just failed a review audit because I marked this answer as OK. I did think about it for a bit before marking it as such, but it seemed to me like a valid answer to the question (and not link-only), ...
-11
votes
4
answers
417
views
Is it really necessary to test the attention of users reviewing edits?
I recently accumulated 2k reputation on Stack Overflow, and with it the ability to review edits and flags. In community spirit, it's something I've taken to doing occasionally when I've got a few ...
89
votes
2
answers
2k
views
Review suspension progressive system
Some time ago I was suspended for two days for having performed too many incorrect reviews. Two days passed but unfortunately I made a review mistake again and failed an audit (failed only one, it's ...
1
vote
2
answers
75
views
Recommendation on reviewing
I decided to do some reviewing. On one review edit, I guess I misunderstood what 'Improve' meant. I almost clicked 'Reject' but clicked 'Improve' feeling that either I would fix the edit or that it ...
30
votes
3
answers
651
views
How to handle link-only low quality posts?
Isn't this a link only post? Why on earth SO tells me I should have click on "Looks Good"?
Not sure if this a duplicate. It seems from there that as long as the link is from a valid site, this is ...
4
votes
1
answer
59
views
Phantom tag in close votes review [duplicate]
A question in review queue appears to be tagged with a tag it doesn't have.
I have my close votes queue filtered by ios, objective-c, xcode. Today a question about Ruby on Rails appeared in my queue, ...
39
votes
1
answer
801
views
Reporting bad review audit
I just got this review audit, which showed me the perfect example of a link-only answer, so of course I pressed the Recommend deletion button, but then it gave me the message that this was actually a ...
22
votes
0
answers
192
views
Review audits load more slowly than other review items, making them obviously audits [duplicate]
Over the last several days, whenever the system decides it's time to quiz me the retrieval of the audit question/posts takes between 3 to 10 seconds to load - making them rather easy to spot and ...
11
votes
0
answers
82
views
In what cases do the buttons disappear in reviews?
The review in question is here.
I just noticed it was because it was migrated... in that case, shouldn't this be cleared from the Close Queue?
19
votes
3
answers
990
views
Another (invalid?) failed audit
While doing my chores, I came across this audit and, as you can see, I failed. I don't fail them very often at all because they are usually so obvious so I'm not crying about my privileges possibly ...
5
votes
0
answers
205
views
Why does a "Congratulation You Passed" review item show up in my flag list to be reviewed?
The last week, I have noticed a slight change in behaviour for the test messages in the review queue. It may be low quality posts, but I am not 100% sure.
Anyhow, a question I flagged today came ...
4
votes
0
answers
47
views
Close votes review audits kinda broken?
I was doing some reviews in close votes queue and I came across this review audit. The first problem with that audit is that I couldn't see the reason it was flagged.
But I looked at the question and ...
5
votes
0
answers
117
views
Automatic Review Test on close-vote review section has one dead give-away [duplicate]
Recently I decided to start reviewing close votes like many members are expected to do. I didn't intend to review all the tags so I picked up one tag to review the questions.
As everyone would know ...
11
votes
0
answers
201
views
Close audits don't respect tag filters [duplicate]
I was just going through the close queue for questions tagged java when a C++ template metaprogramming question popped up. As suspected, this was an audit question.
Is noticing the discrepancy enough ...
15
votes
1
answer
287
views
Does "Improve Post" on audits make you fail?
On audits, does hitting Improve Post (which tells you you were supposed to reject/accept) count as a failure?
4
votes
2
answers
175
views
Failed automatic review test
While I was reviewing the close vote queue I've run into this question.
It was marked as unclear what you are asking.
I've read the question carefully together with the comments.
I've decided to ...
12
votes
1
answer
142
views
Don't show the vote counts of review audits
I noticed that it's possible to cheat the review audit system in the First post and Late answer queue. If the reviewer has 1k reputation he can just click on the score and see the real number of up ...
7
votes
0
answers
89
views
What is the reasoning behind this close review audit? [duplicate]
I just voted to close a question (see below), but it was an audit and shouldn't have been closed, according to said audit.
My reasoning was that it is at least a really broad question ('when would I ...
12
votes
0
answers
124
views
Edit review audits should contain "obviously" invalid code edits
There is a problem with the edit review audits that they only address obvious vandalism - even a simple Bayesian filter could catch whatever audits there are and hit reject on them, and beyond that ...
4
votes
1
answer
269
views
Review ban for not treating this as "spam or offensive"
After some years of doing edit reviews on SO, I managed to get my first review ban for approving this answer as non-low quality. It popped up as one of them review audits.
It may be interesting to ...
3
votes
1
answer
80
views
Low quality posts queue: system shows actual number of votes when checks reviewer attention
As we all know, sometimes we're being tested - if we're paying attention - when we review low quality posts. The system can give us a high-quality post and expect us to click "Looks good".
My ...
12
votes
0
answers
124
views
Help me understand what constitutes spam - conflicting signals from flag resolution and audit question
Note: I am not disputing anything in this question, I'm asking for help.
A week or so ago I flagged the following answer as spam:
https://stackoverflow.com/questions/14722649/continuous-integration-...
5
votes
0
answers
66
views
Are all review audits always revealed after you answer?
I was just reviewing a few low quality posts, and getting up a bit of speed. I found a fairly strange Answer with something about "college interview" in it and it dawned on me that this was most ...
11
votes
0
answers
179
views
Erroneous audits are being selected from posts community deleted through Review
Currently, audits representing examples of posts that should be deleted can be selected from posts that were deleted through the review queue. This meta question is one example of an audit of a post ...
5
votes
1
answer
122
views
Failed a First Posts audit but I don't know why was my action wrong?
I just fail this First Post review. I think it answers the question.
Although it could get some help with some elaboration and reference etc but not worthy of deletion or vote.
But my assessment of ...
6
votes
2
answers
151
views
This review audit should really be marked as spam? [duplicate]
There is this review audit: https://stackoverflow.com/review/low-quality-posts/4736111
which is also marked as possible spam by the system:
Our system has identified this post as possible spam; ...
6
votes
0
answers
106
views
Failing the automatic review test - for no reason [duplicate]
I'm sorry if this was asked before, but my search hasn't led me to the question I want to raise.
While reviewing (mainly, but not exclusively, close-votes) I sometimes fail even before I voted for ...
10
votes
1
answer
299
views
Empty answer in failed review audit [duplicate]
I just failed a review audit in the low quality queue: https://stackoverflow.com/review/low-quality-posts/4723971
The answer here shows as completely empty, but of course it was not when I reviewed ...
36
votes
0
answers
371
views
What is the best way to dispute review audits
Is there a way to deal with audits that we disagree with other than to post about it in meta?
I recently failed this review audit. The question asked how to get out of a for loop when they couldn't ...
-31
votes
2
answers
583
views
Bug: possible logic flaw in the review auditing system
Hypothesis
Stackoverflow contains some automated review auditing logic. The goal is to ensure that reviewers are paying attention and not blindly accepting content without critical scrutiny.
The ...
34
votes
1
answer
540
views
Review audit failed on massively edited post that was now good
I just failed this audit. (It currently shows the "this answer was marked as spam or offensive" message; what I was shown in the review was the revision here along with a suggestion that the length ...