Timeline for Limit the Docs review votes for lower rep users
Current License: CC BY-SA 3.0
24 events
when toggle format | what | by | license | comment | |
---|---|---|---|---|---|
Jul 28, 2017 at 13:11 | vote | accept | MachavityMod | ||
Mar 20, 2017 at 9:15 | history | edited | CommunityBot |
replaced http://meta.stackoverflow.com/ with https://meta.stackoverflow.com/
|
|
Sep 21, 2016 at 20:05 | comment | added | Travis J | @Shog9 - Turns out notifications aren't working as expected, so maybe that was Freud at work earlier :) | |
Sep 21, 2016 at 8:15 | comment | added | NoDataDumpNoContribution | @JF Maybe the low reputation threshold of 100 for reviewing Docs is the reason low rep users review particularly enthusiastic and also make more errors. Having then to roll the edits back and forth by experts to undo all these errors might be a big waste of effort. But for the time the idea seems to be that quantity trumps quality. Apart from this I'm all for more efficient tools for rolling back and forth edits. | |
Sep 20, 2016 at 23:46 | comment | added | Travis J | @JF - Thanks for the correction. Yikes! Perhaps 100 is a little low. | |
Sep 20, 2016 at 23:45 | comment | added | Jed Fox | @TravisJ No, it’s 100: stackoverflow.com/help/privileges/docs-reviewing. 500 is First Posts & Late Answers. | |
Sep 20, 2016 at 22:16 | comment | added | Travis J | @Shog9 - Aside from all the other stuff going on with that user, I thought that review queues required 500 reputation to access? | |
Sep 20, 2016 at 22:15 | comment | added | Shog9 Mod | That particular user has rather a lot of history, @Travis. | |
Sep 20, 2016 at 22:08 | comment | added | Travis J | @Shog9 - So... I couldn't flag this user since they have no posts. stackoverflow.com/users/6655984/zaq?tab=profile They were one of the approvers above. 137 rep, 54 days of an account, 5241 flags, and the gold marshal badge.... what gives? How are these types of users gaining access to the docs review queue? | |
Sep 20, 2016 at 22:06 | comment | added | Shog9 Mod | Yeah, I'd say some non-trivial amount of such approvals should remove your ability to review for a while, @Travis. | |
Sep 20, 2016 at 21:58 | comment | added | Travis J | @Shog9 - How about approving when reviewing improvements which are then rolled back or deleted within some time frame, 48 hours?, then that factors into some sort of wrist slapping. For example, check these two out: stackoverflow.com/documentation/review/changes/… and stackoverflow.com/documentation/review/changes/… | |
Sep 20, 2016 at 21:52 | comment | added | Shog9 Mod | There are probably one or two things I can do to make review a bit more effective, @Travis... But neither heuristics nor audits are a panacea. I would like to see an effort made to use rollback as a means of expert review, rather than trying to throttle up-front - if it works, there are various things we can do to make it less onerous for folks like yourself. We're > 4 years out from the last major overhaul of /review on Stack Overflow now, and I'm increasingly aware of its limitations - it would be nice to use this opportunity to find better ways of handling these problems. | |
Sep 20, 2016 at 21:37 | comment | added | Travis J | @Shog9 - I have subscribed to "immediately" for the proposed changes to JavaScript to see how that works. However, I cannot shake the feeling that I (and others in this role) am now somehow tasked with reviewing the review queue. Personally, I would rather that the review queue have something in place to help with quality control prior to the audits (which I have heard are going to be complicated to generate at first). | |
Sep 20, 2016 at 21:35 | comment | added | Travis J | Yeah, I was not trying to say that the notification system was unreliable. Just that the system where users review this type of junk and approve it is unreliable, and needs some sort of stop gap. It is disheartening to see, and it takes precious time away from creating content to fix. | |
Sep 20, 2016 at 21:08 | comment | added | Shog9 Mod | You can opt into immediate notification of proposed changes if you wish, @Travis. That feature exists, I thought you were saying it was unreliable. Granted, I wouldn't recommend subscribing to these for every tag in the system, but then again I hardly think you're qualified to pass judgement on edits in all tags either. So, pick the tag(s) you care deeply about and are able to make good decisions in, and monitor edits there. Wanna play gatekeeper for jquery? That's your choice. | |
Sep 20, 2016 at 21:06 | comment | added | Travis J | @Shog9 - Sorry, I think I unintentionally misled you. I was basically trying to say that "there is no way to know when a poor edit was approved automatically", and if there were the system would probably just prevent it in the first place. In other words, the only way that I can determine an edit that should not have been approved got approved would be manual inspection. The manual inspection requirement, paired with the difficulty of any changes that had transpired afterwards, is what makes it hard to detect and fix these. | |
Sep 20, 2016 at 21:00 | comment | added | Shog9 Mod | Let's figure out why notifications aren't working first then, eh @Travis? | |
Sep 20, 2016 at 20:57 | comment | added | Shog9 Mod | In an ideal world, no one ever suggests edits that aren't universally loved, @Trilarion. This is not that world, hence the very existence of reviewers. In a nearly-ideal world, reviewers never approve anything that isn't universally acclaimed... This is not a nearly-ideal world either, hence the existence of rollback. Let us learn from past experience here: we're dealing with a wiki, and it is a given that wikis will be edited incorrectly... Therefore, if we wish to have a wiki we must design tools that allow corrections to be made efficiently. | |
Sep 20, 2016 at 20:34 | comment | added | NoDataDumpNoContribution | @Shog9 "If a bad edit is approved, roll it back." This could potentially result in a lot of rolling forth and back. Quality assurance on the suggested edit approval would be an important step to avoid that. | |
Sep 20, 2016 at 18:06 | comment | added | Travis J | @Shog9 - It would be nice if I was alerted every time one of these needs to be rolled back. Unfortunately that isn't happening for some reason, and the only way to see if there was robo reviewed content edited into docs is on accident for the most part. Worst case scenario: someone contributed a worthwhile improvement after a robo review introduces inaccuracy or mangles the example. As a result of this situation, I do not find it easy to fix these edits because of the difficulty involved in both noticing them, and also if there were complicating factors. | |
Sep 20, 2016 at 16:47 | comment | added | user812786 | @Shog9 Rollbacks are useful, but surely it would be better to stop the bad approvals before they happen, rather than hoping a knowledgeable user looks through the history and takes action? Hopefully, audits will fix this - it's certainly preferable to have the system reviewing the reviewers, rather than asking for another layer of expert volunteers. | |
Sep 20, 2016 at 16:05 | comment | added | DavidG | @Shog9 I'm guessing there isn't (at least currently) anything that will punish either the user who submitted the edit or the reviewer when they are rolled back multiple times? For example, banning from reviews or submitting further edits. | |
Sep 20, 2016 at 2:32 | comment | added | Shog9 Mod | If a bad edit is approved, roll it back. That removes the author as a contributor, and nullifies the rep. Folks have been asking for this for suggested edits for years, and now it exists - if it doesn't actually work, it'd be nice to know that. | |
Sep 19, 2016 at 21:11 | history | answered | Travis J | CC BY-SA 3.0 |