Timeline for Can we please tweak the algorithm that selects review audit questions
Current License: CC BY-SA 3.0
17 events
when toggle format | what | by | license | comment | |
---|---|---|---|---|---|
Nov 29, 2017 at 4:01 | comment | added | Jim Garrison | The target question is now closed as off-topic. Meta effect? Will that question now be an audit failing people if they DON'T flag it for closure? That would be the epitome of irony. | |
Nov 29, 2017 at 3:57 | comment | added | Jim Garrison | @NicolBolas "If you can spot that it's an audit, then you undermine the purpose of audits." -- then audits are doubly broken, because with a little reviewing experience under your belt it's relatively easy to develop a feel for what an audit question looks like and check it out before reviewing. I don't do much reviewing any more because the system is so broken, but when I do I find it quite easy to spot audits. | |
Nov 28, 2017 at 18:45 | answer | added | theMayer | timeline score: 1 | |
Nov 28, 2017 at 17:31 | answer | added | Bernhard Barker | timeline score: 4 | |
Nov 28, 2017 at 17:25 | history | edited | Bernhard Barker |
edited tags
|
|
Nov 28, 2017 at 4:51 | comment | added | Ian Kemp | @KevinB That's what I suggested, but Martijn Pieters doesn't seem to agree. I know that blacklisting a particular tag is a little extreme, but considering the overall quality of Android questions are miles below even the poor-quality questions that are now the accepted norm on SO... | |
Nov 27, 2017 at 22:49 | comment | added | Kevin B | i mean... 16 upvotes is a decent criteria to look at, but it's certainly possible for a post to get a large number of upvotes and still be terrible. Waiting longer won't change that. Maybe just blacklist android questions from being audit examples of good quality posts. | |
Nov 27, 2017 at 13:59 | comment | added | Lundin | The main problem with the audits is that they are catching people who review correctly and add the incorrect review towards a review ban when they review correctly. This has been discussed endlessly on meta, in fact it feels like 80% of meta is about this. The consensus is 1) Yes the audits are broken, and 2) no, SO will not do anything about it, they are busy with more important things like monochrome top bar icons. | |
Nov 27, 2017 at 13:32 | comment | added | Daniel F | Yeah, if spotting an audit undermined the purpose of audits, "Review Edit" audits wouldn't look so much like the "editor" had a stroke. | |
Nov 27, 2017 at 10:00 | comment | added | ben75 | @NicolBolas IMO audits should only catch robo-reviewing. If one day, an algorithm is able to decide if a post follow the changing "SO standards" or not: then human-reviewing will be useless. | |
Nov 27, 2017 at 7:48 | comment | added | Martijn Pieters Mod | @IanKemp: we have plenty of excellent [android] posts that are audits. There will always be flukes, in any tag. If you think it is a bad audit, downvote the post or vote to close it (either of which disqualify it), and move on. | |
Nov 27, 2017 at 5:13 | comment | added | Ian Kemp | @MartijnPieters Exclude anything from the [android] tag as an audit? | |
Nov 27, 2017 at 3:16 | comment | added | animuson StaffMod | I don't see how just waiting longer will have the desired effect. If it sat around for that long and attracted only upvotes and no other moderation activity, waiting until it's 2 weeks or a month old is only going to delay how long until the audit gets chosen, not prevent it. A mishandled post is a mishandled post no matter how long it takes to get selected. | |
Nov 27, 2017 at 0:27 | comment | added | TylerH | @NicolBolas The point of SO's audit system is to make sure reviewers are paying attention. With SO's implementation, a reviewer detecting an audit means the system is working in one of its intended ways. | |
Nov 26, 2017 at 22:59 | comment | added | Martijn Pieters Mod | That question has 16 straight upvotes. What other criteria would you suggest? | |
Nov 26, 2017 at 21:49 | comment | added | Nicol Bolas | If you can spot that it's an audit, then you undermine the purpose of audits. The point of auditing people's reviewing is not just to catch people robo-reviewing. It's to make sure that they're reviewing up to our standards. That means you need to catch people who are close voting inappropriately, or not closing appropriately. And so forth. | |
Nov 26, 2017 at 20:37 | history | asked | Ian Kemp | CC BY-SA 3.0 |