This is a bit of a cross post from my question on meta.se, because this mainly has to do with review queues, and my idea would mainly target Stack Overflow.
Say we have this review:
This is an obviously bad review here, as the post should have at least been met with a flag/comment, as this is clearly NAA.
My question boils down to the following:
- Should this be something that should be flagged?
- To ♦ moderators: If I do report this, what are the repercussions from this? Would this be review-ban worthy, on the first mistake? Is this something that would you want to see and track from the first mistake, or something that should be reported/tracked after n or more mistakes? If so, what is n?
I'm seeking input from ♦ moderators, because I want to find out what your feeling is if these are automatically reported. Natty currently runs in the SOBotics channel on SO. It examines NATO posts, and experienced users rate questions as TP: They're NAA, or FP: It looks fine. I wanted to piggy back on that data, pull all verified posts that were confirmed NAA, examine the related First Post/NATO review for that post, and then auto flag to a moderator if the review completed as 'No Action Needed'. What are your thoughts?
For the last 3 days, I've attached some sample data of posts that would have been caught, with this algorithm, which accounts for ~ 8 posts a day. I feel like even if the review below doesn't have any actionable action, it still may indicate a possible bad deletion (On the VLQ queue).
53051731 Sentinel 4 late answer
53049813 Sentinel 7 late answer
53045412 Sentinel 4.5 late answer
53038119 Sentinel 4 late answer
53035294 Sentinel 4.5 late answer
53035252 Sentinel 6 late answer
53033653 Sentinel 4.5 late answer
53032243 Sentinel 5 first post
53029865 Sentinel 4 late answer
53028947 Sentinel 5.5 first post
53028086 Sentinel 4.5 first post
53027686 Sentinel 4.5 first post
53027568 Sentinel 4.5 first post
53027568 Sentinel 4.5 late answer
53026740 Sentinel 4.5 late answer
53024017 Sentinel 4.5 first post
53023354 Sentinel 5.5 first post
53022883 Sentinel 6 late answer
53021942 Sentinel 3.5/manual late answer
53021443 Sentinel 7.5 first post
53020797 Sentinel 5.5 first post
53020672 Sentinel 4 late answer
53020551 Sentinel 6.5 late answer
53019167 Sentinel 5 late answer
53018467 Sentinel 4.5 late answer
52733210 Sentinel 1/manual late answer
Gist here for a slightly better formatted table.