Cody Gray was kind enough to talk through the issue with me in SOCVR—and I now have a better understanding of what I was (indeed) doing wrong. I suspect others may learn from my mistakes, so I've summarized and excepted relevant parts of the conversation below.
TL;DR:
- My first review as acceptable, though the post could have benefited from light editing.
- My second review was wrong—but not because it was a code-only or incorrect answer, but because it was "not even wrong".
- Fundamentally, I was confusing the NAA rules for LQP and LA; the review queues allow (and indeed expect) judgment calls regarding content that "contributes nothing to the site".
First Audit: Wrong programming language, but useful as pseudocode
For the first audit, this was primarily a bad audit, and Cody has since undeleted it (source):
I think the first answer was completely reasonable. It wasn't just someone cluelessly posting a solution in the wrong language. They acknowledged that it was in the wrong language, but were trying to explain an algorithm. That seems OK to me. A downvote is not unjustifiable, but deletion is.
That said, Cody also concurred with Jeanne Dark's comment that the answer would have benefited from some light editing to touch up the grammar and clarify the answerer's intent (source):
It's difficult to think of any case in a review queue where "Looks OK" is completely justified. There's almost always something that can be done to improve a post.
I will definitely echo Jeanne's remark about reviewing not being a binary choice between "flag" and "Looks OK". There are plenty of other options. Just because something doesn't need to be immediately deleted (and thus flagged/voted to delete), that doesn't mean it's "OK".
Second Audit: "Not Even Wrong"
For the second audit, Cody suggests that this was a bad call on my part, and warranted the failed audit (source):
The second answer was complete trash. It wasn't even trying to be relevant, and looks more like trolling to me. Maybe you couldn't tell because all of C# is Greek to you? That's OK; hit Skip. Don't say stuff looks OK that doesn't. I think you made the wrong call on that one.
This one confused me initially, because it was my understanding (based largely on the LQP guidelines) that reviewers should not be evaluating posts for technical accuracy, and that wrong answers shouldn't be flagged. Cody confirms this (source):
Now, we don't generally want to delete answers simply because they're wrong, because (A) we might be wrong, too, and (B) wrong answers can still serve in an advisory capacity about what not to do. (Especially when they're recommending a common, but flawed, approach. If that isn't mentioned by answers, people will think it was forgotten and possibly leave more answers mentioning it. That's much worse. Just downvote the wrong answers instead; it is much more useful.)
But additionally carves out an exception for "not even wrong" answers (source):
I would also generally say that you shouldn't vote to delete incorrect answers. But I have a different opinion about "not even wrong" answers. That one falls into the latter category. It doesn't even attempt to answer the question, even though it masquerades as an answer by having a code block.
This really gets into the heart of my confusion, which is that I was applying roughly the same criteria I use for NAA flags for both LQP and LA (source):
The lesson should be more of:
- Pay more attention, actually reading the answer and the question, and evaluating whether it even attempts to answer the question. Although something like this probably couldn't be flagged as NAA, that doesn't mean it's an appropriate contribution or should stick around.
- Almost nothing in the review queues "Looks OK", so you probably need to do something.
- If you aren't sure, or don't have the time to look carefully, then just "Skip".
Fundamentally, reading your other comments, I think you are confusing the guidance that is meant to be very specific to NAA flags with the general guidance for how to review.
And, in fact, part of the issue is that I was deliberately removing both my subject-matter expertise as well my personal judgment from my reviews, just as I have (successfully) done for NAA flags. But, as Cody notes (source):
We still want people to be able to exercise their judgment and subject-matter expertise when reviewing answers, deleting them when they think that the post is harmful or contributes nothing to the site.
That requires paying closer attention to the code than I have been when reviewing LQP and LA; normally, I treat a code block as a black box, since I didn't see it as my role to evaluate technical accuracy. But to evaluate "not even wrong", I need to have some basic idea of what the question asks and what the code is doing.
NAA Flags
On a final note, even though answers like the second audit aren't suitable for the NAA flag, Cody suggests using a custom flag in these cases (source):
Even that second case where I said it was "complete trash" would probably not be suitable for a NAA flag. If a mod wasn't paying close enough attention, they could end up declining that flag. (There are no mod audits!) So, a custom flag is probably more appropriate, or, of course, directly voting to delete when the queue allows it.