I just failed an audit on the first question queue - this was the audit question - and firstly it was an obvious audit because it had no associated user but also I clicked share feedback
whereupon it instantly failed me. When the feedback option offers the opportunity to provide literally any feedback message, that seems a little prescriptive. The system has no idea what feedback I was going to give. I suspect I would probably have failed for selecting anything but Looks OK
?
It says "make sure you read and understand why you failed" but I can't see a way that offering feedback that could improve the way a question is framed is a failure condition. It doesn't say what the "right answer" here would have been, so when it is ambiguous like this it just feels like the audit system punches you out of the blue and then shrugs like "should have seen that coming."
Since I have got involved in the review queues more over the last couple of weeks I have hit a few weirdly hostile audit questions that feel more like a deliberately posed puzzle than an attempt to check whether I am paying attention. They're generally quite out of keeping with everything else in the queue so it's pretty clear when one is an audit question and maybe the correct response is to skip them by default. But I would argue that if the correct way to respond to an audit is always to avoid it, there is a problem with the audit system. Why not base the things being audited on successfully resolved audits from the same queue? I'm doing this because I want to help, not because I want to be confounded by trying to double and triple-guess audit questions.
I guess SO has so many people blazing through the review queues that there's no problem with putting some of us off with this approach, but at the very least it would be helpful to have some indication of what the "correct" response would have been on a failure. As things stand it just tells us we're wrong without giving any guidance on how to be right beyond read and understand which is what I aim to do before choosing what review response to give.