We all know that the auditing system is flawed. Several users have come across faulty audits. Multiple times resulting in bans. I recently came across an audit in the Close Votes. As you can see here there is no well formulated question here:
NOTE: (The example below, may or may not be a valid question, but it should not be used as an audit, because even if you are paying attention it's quite ambigous on what the answer would be)
Yet, if you navigate the the Question, you can see that despite this question being of such poor quality, it has several upvotes and 0 votes to close:
This happens multiple times a day and most people don't even care enough to report it. Seeing as this is in the Close votes queue, it's quite ambiguous what happen's when you vote to close an audit in close votes
I think it's time we attempt to solve this with another queue: audits review queue. This will be tricky to implement but I think I've worked out most of the spec.
- Audits which people have failed will now have a dispute button.
- Audits review queue should only be open to people who have gotten a gold badge for reviewing, and have access to all review queues.
- Reviewers review system picked Flagged and system picked audits.
- Anyone banned by an audit which failed review is automatically lifted.
Auditing the audit queue, Will be an issue so we will need to revise some spec's for this. Audits for the audit queue will work in two ways.
- Some audits for the audit queue will be hand written by moderators.
- When enough user's review an audit, an audit can be added to the audit's audit.
- Once the queue starts working properly there will be no need for hand written reviews but, but moderators should still have the ability to submit them.
This will help remove bad audits from the queue, and take a small load off of moderation once the queue starts working properly.
P.S Can a moderator remove that posted audit from close votes audit?