245

It's New Year's Day in Stack Exchange land...

A distinguishing characteristic of these sites is how they are moderated:

We designed the Stack Exchange network engine to be mostly self-regulating, in that we amortize the overall moderation cost of the system across thousands of teeny-tiny slices of effort contributed by regular, everyday users.
-- A Theory of Moderation

While there certainly are Moderators here, a significant amount of the moderation is done by ordinary people, using the privileges they've earned by virtue of their contributions to the site. Each of you contributes a little bit of time and effort, and together you accomplish much.

As we enter a new year, let's pause and reflect, taking a moment to appreciate the work that we do here together. And what could be more festive than a big pile of numbers? So here is a breakdown of moderation actions performed on Stack Overflow over the past 12 months:

                  Action                  Moderators Community¹
----------------------------------------- ---------- ----------
Users suspended²                               1,340      1,615
Users destroyed³                               4,305          0
Users deleted                                  4,155          0
Users contacted                                4,475          0
User suspensions lifted early                     45          0
User review-bans lifted early                     64          0
User banned from review                        3,023      4,004
Tasks reviewed⁴: Triage queue                     34  1,239,611
Tasks reviewed⁴: Suggested Edit queue          2,940  1,141,695
Tasks reviewed⁴: Reopen Vote queue               223    185,719
Tasks reviewed⁴: Low Quality Posts queue         219    343,007
Tasks reviewed⁴: Late Answer queue                25    282,584
Tasks reviewed⁴: Helper queue                      9     31,119
Tasks reviewed⁴: First Post queue                 89    804,290
Tasks reviewed⁴: Close Votes queue             3,126    318,431
Tags merged                                      534          0
Tag synonyms proposed                            423        107
Tag synonyms created                             534         77
Tag highlight language set                        28          0
Revisions redacted                               490          0
Questions unprotected                              8         75
Questions reopened                             1,235      9,112
Questions protected                              141      6,039
Questions migrated                               418        758
Questions merged                                  94          0
Questions flagged⁵                             1,758    472,085
Questions closed                              33,862    306,210
Question flags handled⁵                       45,195    430,080
Posts unlocked                                   147        574
Posts undeleted                                3,325     70,345
Posts locked                                     432      8,517
Posts deleted⁶                               142,938  1,251,256
Posts bumped                                       0     34,352
Escalations to the Community Manager team      1,387          0
Comments undeleted                             1,770          0
Comments flagged                                 611    471,440
Comments deleted⁷                          6,075,670    981,980
Comment flags handled                        244,261    227,661
Bounties canceled                                227          0
Answers flagged                                3,707    366,618
Answer flags handled                         265,031    105,362
All comments on a post moved to chat           1,568          0

Footnotes

¹ "Community" here refers both to the membership of Stack Overflow without diamonds next to their names, and to the automated systems otherwise known as user #-1.

² The system will suspend users under three circumstances: when a user is recreated after being previously suspended, when a user is recreated after being destroyed for spam or abuse, and when a network-wide suspension is in effect on an account.

³ A "destroyed" user is deleted along with all that they had posted: questions, answers, comments. Generally used as an expedient way of getting rid of spam.

⁴ This counts every review that was submitted (not skipped) - so the 2 suggested edits reviews needed to approve an edit would count as 2, the goal being to indicate the frequency of moderation actions. This also applies to flags, etc.

⁵ Includes close flags (but not close or reopen votes).

⁶ This ignores numerous deletions that happen automatically in response to some other action.

⁷ This includes comments deleted by their own authors (which also account for some number of handled comment flags).

Further reading:

Wishing you all a happy new year...

45
  • 73
    Happy new year, @Shog
    – Bhargav Rao Mod
    Commented Jan 1, 2020 at 2:14
  • 134
    Comments deleted by moderators⁷ increased from 303,700 in 2018 to 6,075,670 in 2019! :o
    – Wai Ha Lee
    Commented Jan 1, 2020 at 2:53
  • 12
    1.4 million deleted posts in one year seem like a lot (59,549,823 posts in more than 11 years and 18,720,517 questions in more than 11 years on Stack Overflow). Commented Jan 1, 2020 at 3:25
  • 9
    @Peter Indeed, let us never be called slackers again! ;-)
    – Cody Gray Mod
    Commented Jan 1, 2020 at 3:36
  • 13
    @WaiHaLee, it was because of a script to delete some of the useless old comments.
    – Bhargav Rao Mod
    Commented Jan 1, 2020 at 3:52
  • 260
    How many moderators quit? Commented Jan 1, 2020 at 6:05
  • 39
    @andrewtweber I believe the count of moderators who formally stepped down from Stack Overflow in 2019 is 5: Yvette Colomb, Robert Harvey, Ed Cottrell, George Stocker, and Jon Clements. Others have suspended their activity, but some of these have since returned to at least partial activity.
    – Cody Gray Mod
    Commented Jan 1, 2020 at 6:14
  • 19
    Anyone loves stats? I've created a spreadsheet tracking the changes from past years as well docs.google.com/spreadsheets/d/… (discuss in the Meta Room)
    – Samuel Liew Mod
    Commented Jan 1, 2020 at 6:35
  • 24
    @Boris mostly it's when there's a large amount of noisy comments on a post and it's easier for a moderator to purge all comments (which is a single action option for a mod) and then undelete comments that warrant remaining instead of individually deleting comments... (So if you've got 100 comments - it's easier to in one stroke delete 100 then undelete 2 than it is to go through and individually delete 98 comments...) Commented Jan 1, 2020 at 12:46
  • 21
    It's a curious decision to make a post about how it's not just the moderators who moderate soon after having conflict with a number of moderators.
    – NotThatGuy
    Commented Jan 1, 2020 at 15:44
  • 19
    @NotThatGuy: It might be a coincidence. As Freud once said, "sometimes a Jan 1 is just a Jan 1". Commented Jan 1, 2020 at 16:00
  • 130
    Moderators destroyed: too many
    – ㅤㅤㅤ
    Commented Jan 1, 2020 at 16:12
  • 12
    @Not That is very much intentional. A fundamental tenet of SE sites has always been that they are moderated by the community. Diamond moderators are exception handlers. Normal users handle most of the moderation/curation tasks, including voting, flagging, closing, etc. This is all covered in the "Theory of Moderation" blog post that is linked in the question. Shog's phrasing here is very much intentional, and has been used for years in year-end review posts like this. It has nothing whatsoever to do with recent events, including mods stepping down, and isn't an attempt to minimize them.
    – Cody Gray Mod
    Commented Jan 2, 2020 at 2:05
  • 11
    @CodyGray Just because you don't feel unappreciated doesn't mean no-one does.
    – NotThatGuy
    Commented Jan 2, 2020 at 2:48
  • 10
    "This, then, is the "community" who moderators are elected to represent: anyone who has ever participated constructively, anyone trusted to perform one of the countless small actions that - combined - account for the bulk of moderation performed on the site." - read that if you want a long and thorough exploration of my opinions on moderators and moderation, @NotThatGuy; there's no way I can do justice to this topic in a couple sentences.
    – Shog9
    Commented Jan 2, 2020 at 3:34

2 Answers 2

75

It seems to me that the number of reviews (at least in specific review queues - number graph, percentage as of 2016 graph) is dropping, while 3,000 more users were banned from review by moderators in 2019 than in 2018.

In addition, moderators have handled 45k flags more and the community 140k less than in the previous year (2018). As a result, many NAAs have been left without being deleted (related answer by Bhargav Rao).

Finally, there are about 500 unhandled bugs and feature requests here, on MSO, and about 1k on MSE (bugs, feature requests), a sign that review is completely neglected by SE employees. Zoe sums it up pretty well here (although the answer is mainly about the CV queue): review tools need improvements and more reviewers are needed, especially in the CV queue1.

Please, please, invest some time in implementing feature requests and fixing bugs about review, making it an easier job for everyone.

Wish 2020 would be a better year in review than the others....


1 now dropped to 3.5k items, thanks to this recent change.

13
  • 7
    “As a result, many NAAs have been left without being deleted.” I don’t follow the logical leap here. Moderators didn’t do a sufficient job of cleaning up the site, despite handling 45k more flags? NAA flags don’t age away, so if they’re getting raised and not pending (no flags pending as of last night when we cleaned out the queue), then someone is handling them.
    – Cody Gray Mod
    Commented Jan 1, 2020 at 21:57
  • 7
    The "feature-requests" are handled in bulk by SE folks saying that they no longer look at Meta for any feature requests... Someone needs to post "the feature request to end all feature requests" feature-request to request that all feature-requests no longer requested... Commented Jan 2, 2020 at 0:29
  • 22
    @Alexei Someone could just write a bot to cross-post feature requests from Meta on Twitter?
    – Cody Gray Mod
    Commented Jan 2, 2020 at 2:06
  • 133
    Honestly, all the drama last year, with the licensing, monica, and other things have dropped my motivation to invest really into reviews and reporting. I can't say I did much before, but I did every now drop in to review stuff, but right now I can't motivate myself. I think the thing that has changed for me is that, from my perspective, Stack Overflow the company has changed into an uncaring cash hungry company, and I can't bring myself to care about increasing shareholder value without getting something in return. I used to believe SO cared about us, now I feel I am just a money making cow. Commented Jan 2, 2020 at 9:45
  • 12
    If SO were going to provide better tools for this, I think it's fair to say they'd have done so by now. The focus seems to be on turning the company into a cash cow at the moment - and that's really just about traffic, view counts, ad revenue, product revenue etc. at the expense of moderator tools, quality Q&A, and human touches such as swag for 100k members, etc. Commented Jan 2, 2020 at 17:42
  • 1
    @MichaelBerry I hear they've stopped handing out 100k swag now, so much for that human touch ;-)
    – cs95
    Commented Jan 3, 2020 at 1:02
  • 6
    @MichaelBerry "If SO were going to provide better tools for this, I think it's fair to say they'd have done so by now." That is not so clear. Over the last year, there definitely was company time spent on moderation tools -- mostly diamond, so sadly mostly invisible to the bulk of the community, but I'll take the 3 CV change -- and quality improvements -- with work on the ask questions page. Things are still being built. Who knows, maybe reviews will get some love this year, especially the audit systems. I sure hope they do.
    – Baum mit Augen Mod
    Commented Jan 3, 2020 at 1:27
  • 1
    @Tschallacka Isn't that the problem with democracies? When it goes wrong people loose motivation to participate. This makes the process become worse, etc. Commented Jan 3, 2020 at 12:21
  • 1
    @MichaelBerry are they no longer giving swag to 100k members?
    – Dónal
    Commented Jan 3, 2020 at 13:28
  • 39
    @RuiBarradas-ReinstateMonic The thing is, I'm willing to work my ass off when I have the feeling I'm participating to the common good, for an organisation that works for the good of "all". Originally SO(in my view) was to make development knowledge available, common things findable, problems solvable. That got my passions up. But over the years SO changed from organisation to Company. With that change, my willingness to work for free for the company, that happens to have a community also declined.I don't care about companies, or working for free for them. Let them hire full time moderators. Commented Jan 3, 2020 at 14:05
  • 4
    @Tschallacka Same here. I am making up my mind these days how to continue ... but I am really not sure any more where and how my "investments" are going to happen here.
    – GhostCat
    Commented Jan 3, 2020 at 20:52
  • @cs95 They reasonably explained that ... problem is that "global" shipping is a complicated story. See meta.stackexchange.com/questions/341231/… for some other ideas ...
    – GhostCat
    Commented Jan 3, 2020 at 20:54
  • I'm talking from the future, 2020 has been a horrible year.
    – 10 Rep
    Commented Jan 21, 2021 at 23:46
57

How much has moderator activity plummeted in the last months?

Unfortunately, you only show numbers for all of 2019. But I have the strong impression that we'll see quite a dip in the end of 2019 in moderator activity, because of the Monica incident. Quite a batch of moderators appear to have suspended activity, or stepped down altogether. Or they were kicked out, of course.

And it does not look as if it is getting better in 2020...

4
  • I have only a small sample, but it seems that both very low quality posts (like serial code only answers and such) and outright rude comments fly under the radar these days. Commented Jan 8, 2020 at 21:55
  • 2
    Are you talking specifically about diamond moderator activity? Yes, it is true that several moderators resigned and others suspended their activity. No moderators were "kicked out" on Stack Overflow. The reduction in moderator strength unarguably had an effect. I don't have concrete stats that I can share, but I do know that the flag queue was not cleared as quickly. What that actually means is not clear. Moderator flags do not age away, and the queue has been cleaned out (down to 0) multiple times since the Monica incident, so it's not as if problems are falling through the cracks.
    – Cody Gray Mod
    Commented Jan 11, 2020 at 2:48
  • 1
    Having fewer active moderators simply means that it takes a bit longer for moderator flags to be handled. As of several weeks ago, one of our most prolific flag-handlers resumed his activity, meaning that the flag queue is essentially back to its normal clearance rate. Overall flag handling stats haven't really changed much either, I don't think, since flags have always been relatively slow to be cleared on Stack Overflow, given the site's massive volume. We're doing better now than we were at many points in the past ~10 years.
    – Cody Gray Mod
    Commented Jan 11, 2020 at 2:49
  • 1
    None of this is to justify the company's actions, of course, or to minimize in any way the statements made by a significant number of moderators stepping down. But this really isn't the appropriate place to make a statement about that, and you shouldn't read anything into the fact that this "answer" has not received an official reply.
    – Cody Gray Mod
    Commented Jan 11, 2020 at 2:50

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .