Similar to this request, but not filled with random audits (which are sometimes notoriously bad) and more focused on training people on how to spot what reviews are looking for. We have a process like this for people asking questions, it makes a lot more sense to do this for reviews.
What the queue should have is
- Clear guidance throughout the process. No simple notes next to buttons, but a solid step-by-step process as to what to look for.
- No bans, but a place to learn how the process works in a ban-free environment.
- Curated situations. Since we're making these good or bad, we can tell people exactly where they went wrong. And if we mess up, we can fix it. This could be done by CM or moderators (ideally community members with Trusted User privs could submit potential simulations and have Mods or CMs approve).
- Remedial work. Instead of a ban, give moderators the option to force people to "start over" in the simulator, or have a moderator force someone to go through a specific training that covers their situation. Potentially replaces the "Stop, Look and Listen" notice on failed audits as well.