Timeline for 1, 2, 3...test. Let’s increase the number of reviews & close votes for science!
Current License: CC BY-SA 3.0
51 events
when toggle format | what | by | license | comment | |
---|---|---|---|---|---|
Apr 28, 2021 at 8:49 | comment | added | Scratte | About this limit of 200 items in the Triage queue.. Is that still valid? Does it mean that if there are 200 items in the queue all other VLA-Questions get a free pass? | |
Jun 3, 2020 at 15:29 | history | edited | CommunityBot |
Commonmark migration
|
|
Mar 20, 2017 at 10:32 | history | edited | CommunityBot |
replaced http://meta.stackexchange.com/ with https://meta.stackexchange.com/
|
|
Mar 20, 2017 at 9:34 | history | edited | CommunityBot |
replaced http://meta.stackoverflow.com/ with https://meta.stackoverflow.com/
|
|
Aug 9, 2016 at 2:36 | comment | added | noɥʇʎԀʎzɐɹƆ | @bluefeet maybe a bigger increase would be be better - we have proof it works at least somewhat | |
Aug 9, 2016 at 2:26 | comment | added | Taryn StaffMod | @CliffBurton the number of reviews is based on queue size so if it starts off > 150 you'd have 40 reviews but it would drop to 20 if/when the queue size falls below 150. | |
Aug 9, 2016 at 2:24 | comment | added | Taryn StaffMod | @uoɥʇʎPʎzɐɹC it didn't produce the results the exact results that we wanted so as a compromise we've made some adjustments to the total number is reviews users get on a daily basis based on queue size. We're continuing to discuss other things that we can do to fine tune the queues as mentioned last week we made additional changes. | |
Aug 9, 2016 at 1:56 | comment | added | noɥʇʎԀʎzɐɹƆ | If it worked, why remove it? When's this going to be back? | |
Aug 8, 2016 at 8:27 | comment | added | Cliff Burton | About Update (August 4, 2016) - What happens if I start reviewing when the queue is at 151? Do I keep 40 reviews for the whole day? Or as soon as the queue decreases under 150 I get back to 20? And what if the queue goes down when I'm at (e.g.) 27 reviews today? | |
Aug 4, 2016 at 19:32 | history | edited | TarynStaffMod | CC BY-SA 3.0 |
added 439 characters in body
|
Aug 1, 2016 at 11:37 | comment | added | Glorfindel | Hmm ... I might have misread the answer. The first section is apparently not part of the test-which-has-ended. | |
Aug 1, 2016 at 11:09 | comment | added | Glorfindel | @bluefeet according to this question, you still get 40 reviews per day when the queue size is 200. This would imply the test is still going on?! | |
May 24, 2016 at 20:05 | comment | added | Taryn StaffMod | Ah ok @IanRingrose those questions go Triage. | |
May 24, 2016 at 20:02 | comment | added | Ian Ringrose | @bluefeet, Sorry I was thinking that the low quality queue got questions that the machine learning system decided were bad. | |
May 24, 2016 at 17:53 | comment | added | Taryn StaffMod | Huh @IanRingrose, those queues are completely different. Questions don't go into the Low Quality queue. I'm not sure I understand why you'd think low quality would impact the close queue. Can you clarify your question? | |
May 24, 2016 at 16:44 | comment | added | Ian Ringrose | Is speeding up the Low Quality queue review resulting in more items being put in the close queue? | |
Apr 30, 2016 at 13:15 | comment | added | NoDataDumpNoContribution | "Overall, both the Close Vote Review and Low Quality queues had a substantial drop in the average number of posts during the test period." The length of the close vote queue seem to kind of increase again after an initial two weeks low indicating a special effect by the announcement of this test. So my guess would be that the real effect on the close votes queue is less than 11% and giving a few more close votes to a few users with high rep might not change that, especially given that "very few of the reviewers capped out their reviews at least once during the test". | |
Apr 26, 2016 at 23:30 | history | edited | TarynStaffMod | CC BY-SA 3.0 |
added 1 character in body
|
Apr 26, 2016 at 22:22 | comment | added | gnat | I understand. You would just have to additionally examine and possibly adjust close vote limit if you would want to get it at some other site. 40 reviews in CV queue at a site with 24 votes would bring quite a bit of senseless Leave Opens from badge hunters | |
Apr 26, 2016 at 22:11 | comment | added | Taryn StaffMod | @gnat if there is proven need to do this elsewhere, we can. | |
Apr 26, 2016 at 21:47 | comment | added | gnat | understood, thanks for explaining. As you wrote, primary purpose of this tweak is to accommodate dynamics of SO LQ queue | |
Apr 26, 2016 at 21:40 | comment | added | Taryn StaffMod | @gnat I don't think there is a need to make this network-wide at this time. | |
Apr 26, 2016 at 21:18 | comment | added | gnat | I see, thanks. And there is no plan / intent to make it network wide, correct? | |
Apr 26, 2016 at 21:17 | comment | added | Taryn StaffMod | @gnat It's just Stack Overflow which is why this is posted on MSO. | |
Apr 26, 2016 at 21:16 | comment | added | gnat | "When the queue size is greater than 200, you will have 40 reviews a day" -- is this limited only to Stack Overflow? if it's network wide, how could there be 40 reviews at sites where users have only 24 close votes? | |
Apr 26, 2016 at 21:03 | comment | added | Travis J | I agree with @gnat, there should be more priority given to posts with 4 close votes already. Perhaps there is an argument to make that this is giving bias towards robo reviewers since they are more likely to be accurate simply voting along the existing votes trajectory. However, I believe that once 4 votes are present the trajectory is more than likely accurate anyway especially given the low rate of reopen or edit after closure occurrences. As far as fatigue, I am not sure it will be a cure, but at least the effort will be instantly recognizable which plays into satisfaction levels. | |
Apr 26, 2016 at 20:55 | history | edited | TarynStaffMod | CC BY-SA 3.0 |
added 498 characters in body
|
Apr 21, 2016 at 12:17 | comment | added | Dalija Prasnikar Mod | @bluefeet Even though CV queue didn't approach set parameters, having more votes increased number of questions closed. Also, I don't think that maxing out votes or not is significant, it is having ability to vote when you stumble upon horrible question that counts. From my experience during experiment, I would say that number of close votes we have in queue is sufficient, we should get more additional close votes to close questions outside queue. Fatigue is not relevant there. And it is extremely frustrating when you cannot close totally off topic question fast enough. | |
Apr 15, 2016 at 20:53 | comment | added | honk | @bluefeet: Hm, accepted self-answers don't go to the top? Didn't know that yet... | |
Apr 15, 2016 at 20:48 | comment | added | Taryn StaffMod | @honk Done, just hadn't gotten back around to it. | |
Apr 15, 2016 at 20:48 | vote | accept | Taryn | ||
Apr 15, 2016 at 20:47 | comment | added | honk | @bluefeet: How about accepting your own answer, so that the results can be found directly below the question? | |
Apr 14, 2016 at 12:37 | comment | added | Taryn StaffMod | @Yvette 30 days-ish, it ran for 4 weeks. | |
Apr 14, 2016 at 12:35 | comment | added | Mark Rotteveel | Not necessarily fatigue; I had to dial back on close vote review to make sure I had any close votes left while browsing the site itself. | |
Apr 14, 2016 at 7:44 | comment | added | gnat | @Shog9 as I mentioned, one option to tame fatigue is to further amplify current ptioritisation, making even stronger push for insta-close items to the top of the queue. But 60 reviews would still be troublesome I'm afraid. Maybe 50 | |
Apr 14, 2016 at 4:29 | comment | added | Shog9 | Interestingly, after an initial bump at the start fewer people hit >=40 votes/day during the last half of the test, @gnat. So yes: fatigue. | |
Apr 14, 2016 at 3:44 | comment | added | user3956566 | this question was asked 28 days ago, how can that be 30 days, or did you start it before the post? | |
Apr 13, 2016 at 22:13 | comment | added | Luke | +1 for going back to 20 votes in LQ queue, maxed out every day except one at least. | |
Apr 13, 2016 at 20:46 | comment | added | TylerH | Separate Close Votes from CVQ votes :-) Problem solved! | |
Apr 13, 2016 at 20:30 | comment | added | CubeJockey | All in all, I appreciate the 50% increase in the amount of reviews I could handle. Maybe a year from now I'll help out with those close votes. | |
Apr 13, 2016 at 20:20 | comment | added | Taryn StaffMod | @JonClements I didn't exclude mods from these stats. Based on my quick once over, there weren't too many mods in the list. | |
Apr 13, 2016 at 20:19 | comment | added | Jon Clements Mod | @bluefeet does that take into account a couple of mods that might have bothered on a couple of occasions to have a whack at the CV queue? | |
Apr 13, 2016 at 20:17 | comment | added | Taryn StaffMod | @hichris123 108 users maxed out their close votes at least once during the test. | |
Apr 13, 2016 at 20:07 | comment | added | hichris123 | "113 users maxed out their close vote reviews" how many maxed out their close votes? I know I didn't max out my reviews, but I did max out my votes. | |
Apr 13, 2016 at 19:58 | comment | added | Taryn StaffMod | Yup @gnat those last 20 can be tough when you've already looked through a bunch of stuff that needs to be closed. Burn out can happen quickly in review. | |
Apr 13, 2016 at 19:57 | comment | added | gnat | less people maxing sounds realistic. I pick the low hanging fruit when in the queue, making it as easy as possible but even this way, even after getting used to new limit, it still felt noticeably harder than 40 reviews a day. I would say 60 reviews seems to be really approaching reviewer fatigue. You probably can stretch it a little bit more by "amplifying" current CV prioritisation heuristic (which works already well btw), but only a little bit | |
Apr 13, 2016 at 19:51 | comment | added | NathanOliver | @bluefeet Thanks for the information. | |
Apr 13, 2016 at 19:51 | comment | added | Taryn StaffMod | @NathanOliver More people maxed out their CV reviews in the 30 days prior to the test. I grabbed the last 30 days when it was set to 40/day and were 150 users who hit the max at least once. | |
Apr 13, 2016 at 19:44 | comment | added | NathanOliver | I am curious. Did more or less people max out CV reviews during the test the in the 30 days before the test. | |
Apr 13, 2016 at 19:40 | comment | added | rene | -1 for turning back the number of Close votes, +2 for increasing the number of close votes based on rep. Thanks for running the experiment and the feedback. | |
Apr 13, 2016 at 19:33 | history | answered | TarynStaffMod | CC BY-SA 3.0 |