I've [talked about this before][1], but I don't believe the solution to debatable audits is for them to be handpicked by moderators or staff. That simply would not scale to a site of this size, particularly as the number of users and posts increases over time. We would not have enough time in the day to pick out the number of audit posts required for this. Also, the number of audits that are controversial account for a small fraction of the total number of audits applied.

I'm sounding like a broken record, but the way to combat questionable audits is to [put in place a system for disputing them][2]. This would let us focus on the relatively rare bad audits and remove them from the system, rather than take all our time hand-picking good audits.


  [1]: https://meta.stackoverflow.com/questions/275188/do-something-about-failed-audit-questions/275272#275272
  [2]: https://meta.stackexchange.com/questions/188780/review-audits-and-i-understand-button/188790#188790