I would like to re-open the conversation around a formal way to dispute or flag ambiguous audits.
TBH, I haven't been banned before, but I have seen my fair share of questionable audit questions and we have all seen the meta posts that those of us frustrated enough to do so will leave on meta when we don't understand or agree with a failed audit.
If there was a mechanism to flag an audit review then perhaps we can act as a community to clean up or improve the currently automated audit review system. It would be great if the result of a review was to remove the audit question, then it would remove any record of users who completed that audit, but ultimately I would be happy with a first step of ensuring that the question was removed from the queues altogether.
If the purpose of Audits is to enforce rules, conventions, and/or standards, then the reviews as a bare minimum should not be ambiguous, ideally, they should be clear in the intent and if possible should include specific guidance on the correct resolution and the correct reasoning. If we can identify ambiguous or misleading audits then we can all help keep this community a better place.
Formalizing the process for audit review flags does add another queue system, but it simplifies the manual moderation effort that we hope goes on when we post in meta, it should reduce the number of frustrated posts like these or any in the disputed-review-audits and hopefully result in better education across the board:
- What to do about incorrectly failed review audits?
- Failed audit on what looked like a link-only answer—was I wrong in my judgement?
and, hopefully, we can avoid these types of discussions: Suspended from reviewing due to questionable audits
On a personal note, failing an audit that looks wrong really de-motivates you to continue. I want to help with the queues, but, clearly, the queues don't want my help. I understand this is an automated and imperfect system, so provide a mechanism where we can help.