160

Franck Dernoncourt asked, over on Skeptics:

Did Stack Exchange cut the number of negative comments nearly in half between the beginning of the fourth quarter of 2019 and January 21, 2020?

It's not really possible for someone outside the company to answer, and given that - it feels a little more appropriate to post a long answer here on Meta Stack Overflow* and then cite it over on Skeptics.

So I'm doing that.

*The bits we have for this are only running on Stack Overflow, so I think this is technically a better place than Meta Stack Exchange.

10
  • 31
    It depends on how "negative" is defined. That's subjective. Next, it's unclear if that includes all posted comments or only the surviving comments of a certain age. And it surely also depends on the classification system. That might have a huge error. Probably nobody knows for sure. Okay, there is already an answer. Commented Feb 5, 2020 at 22:36
  • 6
    @Trilarion it's subjective to some extent but sentiment analysis is well studied in the field of natural language processing. Commented Feb 5, 2020 at 23:22
  • 63
    Just want to say, I really like how you went about this. Official response to the question, detail on meta, a short summary on Skeptics where it was asked; and of course, actually acknowledging the existence of the rest of the SE network, while explaining why it's all SO-focused! Very welcome and good to see. Commented Feb 5, 2020 at 23:30
  • 2
    I at first thought "negative" was commenting on the illegal relicensing or voicing support for fired moderators and CMs. And I at second thought it was true. i.e., I interpreted "negative" as "negative to / not in line with the company", not "unfriendly or unkind".
    – iBug
    Commented Feb 6, 2020 at 9:42
  • 3
    Unrelated discussion has been moved to chat.
    – deceze Mod
    Commented Feb 6, 2020 at 15:17
  • 10
    It seems SE has managed to cut negative comments on questions like this: "I am a student and my professor said to explain this matlab code in scilab and i dont know nothing about it.So can anyone help me on this". We all have to agree that is great progress on making this site more welcoming while at the same time increasing question quality /s
    – Alex
    Commented Feb 7, 2020 at 6:50
  • 4
    @Alex SE didn't delete any comments, the automatic system presented here only proposes comments to the moderators for review, nothing more. If the moderators do delete valuable comments while cutting the negative comments, it would be on them, not on the proposal system. Indeed moderators might become too trustful of the automatic proposals, but I don't think this is actually happening. Maybe if there are new moderator elections in the future and more trigger happy moderators come into this position, it might become an issue. Commented Feb 7, 2020 at 10:18
  • 13
    Let me give you a quick answer, they did not cut down negative comments - they simply cut down on the number of users visiting the site...
    – JonH
    Commented Feb 11, 2020 at 3:37
  • 5
    That's right @JohH, I'd bet they have managed to cut down on ALL comments in that short period. Probably questions too, and certainly answers Commented Feb 11, 2020 at 18:23
  • 5
    @JonH maybe not visitors as SO is still one of the best places to find existing qa. I would suggest instead they cut down on the number of veterans who don't ask/answer here anymore
    – Eonasdan
    Commented Feb 11, 2020 at 18:58

4 Answers 4

196

This is sort of two questions: "How are we measuring 'negative comments'?" and "Did the number of negative comments on SO decrease by ~50% in Q4 2019?" My team (along with several others) worked on both sides, so I'll do my best to answer both.

Measuring Negative Comments

First we have to be very specific about what we mean by "negative comments." Stack Overflow is a bit unique in that the "negative" comments that survive are not the sorts of negative comments you find on a lot of the internet - we're not talking about hate speech, slurs, targeted harassment, and the like that many other online communities have to wrestle with. We normally call these really egregious things "rude or abusive," like in the flag dialog. The community and moderators of Stack Overflow do a really good job of keeping the "rude or abusive" content cleaned up, very little of it survives.

The sort of negative comments we have to contend with are the "unkind, unwelcoming, or unfriendly" ones - those with condescending, dismissive, or otherwise subtly hostile phrasing. I feel like often there is confusion around this point since, in contrast to the "rude or abusive" cases, the intent of the commenter is rarely hostile. In my experience this can make discussion of the issue more difficult, since it requires separating the comment and its impact on a reader from the commenter and their intent - which is very unnatural, especially emotionally.

A few years back we started work on quantifying the magnitude of our unwelcoming comment problem - we had heard, both anecdotally and in more structured user surveys, that it was an issue but it's hard to measure progress or make rational decisions in the absence of data. To cut a long story short, we started with manually labeling new comments and progressed to using user generated flags and a human-in-the-loop automated flagging process.

The manual labeling started with employees, then rolled out to moderators, and then a wider group of volunteers. That data suggested that somewhere between 5% & 10% of new comments were perceived, by at least one person, as unwelcoming in some way. Later, we rolled out new flagging options for comments that allowed users to flag unwelcoming comments for moderator attention.

The data that was gathered from manual labeling and from the comment flags was used to train an auto flagger1 (internally, we call it the Unfriendly Robot). The robot doesn't delete anything, but it raises concerning comments for moderator attention - a setup often called "human in the loop". We have iterated on the robot, mostly by taking the cases where moderators have disagreed as test cases, and the flags it raises are now at least as accurate as the flags raised by regular Stack Overflow users. It is with this robot that we can now plot the change in negative comments over time.

In summary, we measure comment negativity using a custom algorithm that is trained on users' comment flags (and refined with moderators' responses to both those flags, and the algorithm's flags). Today when the algorithm raises flags, they are accepted at rates as high or higher than human raised flags.

Reducing Negative Comments

One nuance right away, while Prashanth spoke about the absolute number of negative comments, internally we mostly talk about percentages. In this case there isn't a practical difference, but he did make a (reasonable, IMO) simplification.

Given a way to classify negative comments, we can use it to look at the past and see how the prevalence of negative comments has evolved over time. This lets us evaluate the impact of our efforts.

Graph of unfriendly comment creation and 'still visible'-ness over time

Cumulatively, the robot thinks they've taken Stack Overflow from something like 1.5% of new comments being unwelcoming to a little less than 1%. This translates to something like a thousand improved comments a week, which get read by tens of thousands of people in the same period - and since content on Stack Overflow is consumed far more often than it is produced, the cumulative number of people impacted is even larger.

We've also used the robot to investigate specific changes, rather than just global trends. For example, Yaakov's work around post notices flow appears to have reduced the % of unfriendly comments on duplicate questions by ~10%.

Caveats, Footnotes, Etc.

The big caveat to acknowledge is that it's not possible to split test most changes around welcoming-ness, and thus we can only infer causation - not prove it. While, when we look at history, changes correlate to actions we'd expect to have had an impact - that is still only suggestive of causation, not proof of it.

Another thing to acknowledge is that, while I believe our efforts have made an impact on new content, there is still a very long tail (a decade or more of it) of old content. Changing perceptions of Stack Overflow's overall welcomingness to newcomers is a very large undertaking, and won't be accomplished by a single feature shipped or algorithm implemented.

Members of my team are planning at least one blog post that goes into the process of building the algorithm in detail, though it is a large enough and nuanced enough topic that it could still take a while to get published. I also expect they'll want to explore some of the nuances between preventing unfriendly comments (with things like policy changes), addressing unfriendly comments (with things like flags), and handling the long tail of old content that still gets frequently viewed. There are already some older posts that have alluded to bits of this topic: like these three.

A final thing I'd like to share - a lot of third-party approaches to these sorts of problems focus on users, building up profiles and histories to influence how they score particular pieces of text from those users. We explicitly decided against that approach. Our algorithms only consider the text of comments, no user specific details or user history are considered. This decision follows naturally from the observation that these subtly unwelcoming comments are often not intended to be unwelcoming.

1Because these are subtle and automated flags, they're a bit special. Mostly, any of the systems that consider flag history or volume ignore these flags.


Edit (from Jason)

Was it Q4 2019?

To answer the title question: No, this particular thing definitely didn't happen in Q4 2019. Sorry for the confusion. In the original post Prashanth mentioned a bunch of things that did happen in Q4 and I think this was "thrown in for good measure". We haven't really talked about it much publicly for reasons and I think he was right to add it in, as it has happened.

Was it half?

For the 30 days leading up to "Stack Overflow is Unwelcoming" the average daily unfriendly comment percentage (by robot V2 reckoning) is 1.41% and the average count of daily unfriendly comments is 493.

For the 30 days leading up to today the average daily unfriendly comment percentage is 0.821% and the average count of daily unfriendly comments is 244.

On a percentage basis it's a stretch (we reduced the percentage 41.7% relative). On an absolute basis it's true (we reduced the number 50.5%).

"Did you try anything?"

"Did you try anything?" gets a .73 from UnfriendlyRobotV2. "Did you even try anything?" gets a .941. "Did you even bother to try anything?" gets a .978. The maximum is 1 and the threshold for an automated flag is .907. So no, "Did you try anything?" isn't getting anyone in trouble.

Can we say that there are more negative comments from post authors or from readers?

UnfriendlyRobotV2 marks 1,015,098 of 70,878,654 comments (1.43%) from Not-PostAuthors as unfriendly. It marks 323,182 of 32,148,152 comments (1.01%) from PostAuthors as unfriendly. The 95% confidence interval of a proportion test is 0.422% - 0.431% (this is the difference between the two percentages) with a p-value of 2.2e-16.

UnfriendlyRobotV2 thinks Not-PostAuthors are unfriendly 41%-42% more frequently than PostAuthors and the difference is statistically significant.

Can we say that there are more negative comments under questions or under answers?

(Jason: I'm getting tired of saying UnfriendlyRobotV2, so I'm just gonna call it the robot from here on out).

The robot marks 508,183 of 50,763,777 comments (1%) on Answers as unfriendly. The robot marks 931,338 of 55,658,832 comments (1.67%) on Questions as unfriendly. The 95% confidence interval of a proportion test is .668% - .677% with a p-value of 2.2e-16.

The robot thinks that comments on Questions are 66%-67% more frequently unfriendly than comments on Answers and the difference is statistically significant.

Did 3CV change anything?

We moved the close vote threshold around in the second half of 2019. Did that have any effect on the percentage of unfriendly comments?

Unfriendly Comments and the 3 Close Vote change

This was not an A/B test, so there's no control to compare against. All we can really do is look at a trend line. I don't see much of a change during the original 30-day experiment period. There's some rolloff in 2020, but I'd be hard pressed to attribute any of it to the final change which was made on December 3.

How helpful is the robot?

What percentage of robot flags are helpful? Here's a plot that puts it alongside the same metric for humans. (Human flags here are both Rude/Abusive and Unfriendly/Unkind as that's what the robot is trained on)

Flags Percent Helpful by Source

Robot V1 was definitely not up to the task (there were tons of false positives). Robot V2 looks as if it's doing well but it's jumped around a bit and recently has fallen to "merely" human levels. It's natural to come up with another metric which we call "The Robot Rating" and calculate as Robot %Helpful / Human %Helpful. That plot looks like this...

Robot Rating

That isn't the whole story though, because the robot never sleeps. There is no comment that escapes its roboty eye. Let's plot helpful flags by source...

Helpful Flags by Source

We see that even though V1 wasn't so accurate it still raised tons more helpful flags than humans did. (V1, though diligent, did get sick at the end of its tenure and dropped off a bit to "merely" human). How much are we improving detection using the robot? We get a multiplier by taking the ratio of Robot Helpful Flags to Human Helpful flags...

Detection Improvement

V1 helped us find 2X-3X more unfriendly comments than humans flagging alone. V2 has routinely been above 3X.

The robot gives a score to each comment. How helpful is the robot conditioned on score? If we round robot scores to the nearest percent and calculate percent helpful at each rounded score we get this...

Percent Helpful by Robot Score

We can see that in both versions the higher the score the more likely our moderators agree with the robot. We also see a jump in helpfulness across all scores that came with robot V2.

65
  • 45
    Gonna put a small comment here to say that I collected a lot of this quickly from other folks who did the real work, so don't be shocked if there are some edits (from myself or other employees) to fix any mistakes I might have made in the collation. Commented Feb 5, 2020 at 21:20
  • 66
    Could you quantify how much useful information was lost in the process? It's clear that many comments SO has deemed "unwelcoming" were quite helpful.
    – jpmc26
    Commented Feb 6, 2020 at 0:09
  • 61
    Example of negative comment: Also, any time you have enumerated columns, you can be sure that something’s gone very, very wrong with your design. That said, you’re probably after LEAST(). But don’t do that. Fix your design."
    – user
    Commented Feb 6, 2020 at 8:37
  • 27
    @Fermiparadox the comment you quoted may not be strictly 'unfriendly', however it is certainly unhelpful/unneccessary. It is something that I have encountered as an asker as well: Instead of someone answering the question you get a bunch of "you shouldn't do it that way" "you are doing it wrong" ... . The asker may even know that it is wrong but either there is no better/quicker way of solving it OR it is old code and the person asking is just trying to fix it. Just writing a short "Hey can you do it this way? Then you won't have that issue." says the same and is friendlier/more helpful. Commented Feb 6, 2020 at 9:16
  • 116
    @SteffenWinkler I've had the exact opposite experience. I was doing something the wrong way and i got a similar comment. It was very helpful in my case.
    – user
    Commented Feb 6, 2020 at 9:56
  • 43
    "perceived, by at least one person, as unwelcoming" - one out of how many?
    – user
    Commented Feb 6, 2020 at 9:59
  • 109
    @SteffenWinkler Problem is, this is how developers talk... if I have to say something is wrong I will just say it, yes, people might have reason to do things the "wrong" way... but more often than not, they just don't know better. Also such comments and answers are not only for the OP but for other devs that might come across some piece of code and think this is a good way to do something. WE MUST POINT MISTAKES IN APPROACH, that is the only way people (we all) can learn and improve.
    – Dalija Prasnikar Mod
    Commented Feb 6, 2020 at 9:59
  • 19
    @Fermiparadox, I finally understood what all this reminds me. I mean: "Community has to be renewed" "negative comments .. are ... those with condescending, dismissive, or otherwise subtly hostile phrasing". How many of you remember fidonet and usenet groups? How many of you have seen and 100% agree with the classic How To Ask Questions The Smart Way? The Introduction section says at all. SO users with the attitude of hackers (as described in the link) has to be renewed. Commented Feb 6, 2020 at 10:39
  • 40
    Sometimes it depends how people read the comment, rather than the person who wrote it. eg. "you need to fix your design" can be interpreted as "you are a moron and your design is junk and you need to fix the way you think", or "a bug in your design is the real problem here that should be addressed first or you'll run into more errors later" - this is why you should assume good intent with everything you read on t'interwebs, there is no nuance or context to help you.
    – gbjbaanb
    Commented Feb 6, 2020 at 10:42
  • 16
    @SteffenWinkler Most of devs I know talk like that... I talk like that... yes, I know some that talk differently... point is if someone is bent on perceiving direct comments like that as offensive... then I really have nothing to say to them. I cannot change who I am... I can be nicer but that requires extensive effort on my side... I am not going to bother doing that... most people I know will not bother either. I am here to help people.. I usually have few minutes while something is compiling... if I have to get out of my head to write comment, I will just skip commenting and just CV and DV.
    – Dalija Prasnikar Mod
    Commented Feb 6, 2020 at 10:52
  • 61
    @SteffenWinkler "The asker may even know that it is wrong but either there is no better/quicker way of solving it OR it is old code and the person asking is just trying to fix it." Then they need to include that information in their question from the start. Claiming people who are trying to help are wrong, just because the person asking the question didn't go to effort of being specific, is offensive on every level.
    – Ian Kemp
    Commented Feb 6, 2020 at 11:35
  • 37
    @Magisch I understand and accept that, but I'm also a human being. I try to be kind and understanding and approachable, but it becomes difficult when I'm overloaded and/or my attempts to help aren't appreciated. And that's exactly what's happening with the horde of self-entitled new users being encouraged to use SO as a free helpdesk/tech support/code writing service. The unwelcoming problem is a symptom of the new users problem, and as long as SE Inc continues to ignore the latter, they won't be able to solve the former. That won't stop them from blaming everyone else for the former, natch.
    – Ian Kemp
    Commented Feb 6, 2020 at 11:56
  • 25
    @Magisch "snarking is never actually useful" - mostly agree, but that's not relevant here. Based on the example comments shown by SE, they define comments as "unwelcoming" not only if they are snarky, but also if they are simply not sugarcoated or fluffed up enough.
    – l4mpi
    Commented Feb 6, 2020 at 13:00
  • 41
    @SteffenWinkler Are you kidding? Telling someone point blank that they're having an XY-problem and to fix the real problem is unhelpful? What about the poor sap who has to maintain the code that's so poorly designed? You never just answer the question when the asker is looking to do something ill advised. You tell them it's ill advised. And if they really know what they're doing, they'll come back and say, "Right, normally this is a bad idea, but because of reasons a, b, and c, this situation is exceptional." And then those specifics should be edited into the question.
    – jpmc26
    Commented Feb 7, 2020 at 0:45
  • 26
    I've seen a lot of this before, and some has been shared with moderators privately as well... But I want to express my gratitude to @Jason and Kevin for making it public and taking the time to answer questions here. The shape of the problem has been known for nearly 7 years now, but tracking it with this level of detail and broadly communicating its nature has made scaling tooling to address it almost impossible - I am confident that the work y'all have put into this will prove invaluable.
    – Shog9
    Commented Feb 7, 2020 at 15:57
19

As an answer focusing exclusively on Skeptics.SE question this is maybe OK but for meta post it seems to be bit lean on substance.

I think providing some additional statistics and correlation analysis could help us understand what could be done to further decrease negative comments. Below is what I would like to see in a meta report on this matter (hardly relevant to Skeptics question, sorry).


Can we say that there are more negative comments from post authors or from readers (or more precisely, whether available statistics lets us tell this with reasonable confidence).

Can we say that there are more negative comments under questions or under answers.

Do we observe a correlation between negative comments and posts score (or amount of votes up/down, and additionally, votes close / reopen for questions).

Speaking of score, it would be useful to learn whether recent experiment of hiding negative score made any observable impact on negative comments.

The last but not the least, whether there was a confidently observable impact of introducing 3CV threshold, including its trial run few months before.

6
  • 5
    I answered your first two in edits to Kevin's answer. The rest are really tricky to get to the bottom of. Some of the difficulty has to do with changing data (post scores change all the time), some of it is the design of those experiments. Commented Feb 6, 2020 at 21:16
  • 1
    thanks @Jason - data you added makes great food for thought! Wrt correlation with score / votes, I was thinking simply of most recent values of those - assuming that for most posts these somehow stabilize over time, does that make sense?
    – gnat
    Commented Feb 6, 2020 at 22:24
  • @JasonPunyon I am confused about what could be difficult about correlating with 3CV threshold. I thought it is a simple matter of getting average amount of negative comments having date within timeframe of a new threshold, do I miss something? As for A/B test of hiding negative score, I gave it more thought and you seem to be right about it - it looks hard (maybe even impossible) to figure a way to get data to make a reliable conclusion, everything I considered so far leaves a room for mistakes in the interpretation
    – gnat
    Commented Feb 7, 2020 at 8:43
  • 3
    Ah, for some reason I thought 3CV was an A/B test. We just turned it on for 30 days originally. This is easier to pull than I thought, but we will just be eyeballing a graph (there's no control for any statistical tests). Commented Feb 7, 2020 at 13:02
  • 3
    Added a graph on 3CV. Commented Feb 7, 2020 at 13:20
  • 1
    thank you @JasonPunyon - visually it looks like there was no impact worth talking about
    – gnat
    Commented Feb 7, 2020 at 13:29
6

I would imagine the system feedback while users type out their question (e.g. "Your question seems to be mostly code...") has played at least some small part in reducing potential negative comments.

Can the robot be trained on questions as well? I.e. what kind of questions tend to produce negative comments?

Then, is it possible to integrate that into the question-asking process? As long as the feedback seems to be system-generated, improved questions -> fewer negative comments -> better overall perception.

And, you can certainly A/B test this process.

2
  • 10
    You imagine things that we also imagine. One thing the robot finds is that "homework" is a token associated with unfriendliness. Using "questions with comments with the token 'homework'" as a positive set and "random questions" as a negative set I've trained a model (using the exact same software) that detects questions with eerily homework like qualities. Hooking that second model into the question asking flow so we can eagerly inform and educate question askers about our homework policies seems like a straightforward way to tackle a certain subset of unfriendliness. Commented Feb 12, 2020 at 17:32
  • 6
    I also did a prototype of an "images of code" detector that could be used the same way... twitter.com/JasonPunyon/status/1180094373234651138 Commented Feb 12, 2020 at 17:34
5

The auto flagging of comments by a trained system and feeding to moderators for review in the second half of 2019 seems to have had a big impact. I'm convinced that the fraction of negative comments has gone down because of it, but the question here is by how much? Regardless of the how much, I think it is an important step forward and I like it very much.

There are some more caveats than mentioned in the answer by Kevin Montrose, mainly the false negative rate already mentioned by Magisch in a comment, so I want to discuss a bit, what errors could still be in that estimated cutting-the-number-nearly-in-half-statement. Of course, it's difficult to include all details in a blog post, but writing "we cut the number of those negative comments that we are aware of nearly in half" instead would probably have been better.

Everyone has a different threshold for negative comments. The calculated rate of removed negative comments might depend on it.

For example, is "Did you try anything?" a negative comment? It surely is a frequent comment. Some might say yes, others might say no. Overall, people could have different thresholds, resulting in different perceived actual fractions of negative comments. Is it 1% negative comments, or rather 2% or 5% or 10%, it may be up to your personal opinion and that may influence the results here. For example, Julia Silge reported a factor of two difference in the fraction of unwelcome comments present depending on the group you ask in 2018.

We know probably exactly how many comments we deleted and they could be seen by definition as negative comments. The difficulty is rather in estimating how many negative comments there are in order to estimate by which factor they have been cut.

The false positive error rate or why was the number of negative comments only cut in half?

In the official answer here, it is reported that the accuracy, i.e. the fraction of flagged comments that got deleted later-on, is as high as for the manual flags. But what is it really? Probably at least 50% because the blue curve seems to have dropped by 50% in 2019, but how low is the false positive rate?

This false positive rate should be taken into account, if it was 50% (and there were no false negatives) then actually negative comments would have been completely wiped out as of 2019. The statement in the CEO's blog post would have been too modest.

The false negative error rate or which negative comments did the robot miss?

This is by far the greater unknown here, I guess. If the auto flagging did not include all negative comments, then one could expect that those kind of negative comments that are more difficult to detect automatically are not cut in half too, because they would not have profited from the increased moderator attention. That could mean that the number of negative comments could have been cut in less than half. The statement in the CEO's blog post would have been too optimistic. One way out would have been to explicitly restrict the statement to those negatives that they are aware of.

The presence of the effect is not a surprise.

The number of negative comments is estimated by the algorithm that is responsible for feeding these comments to the moderators. They will surely delete some of them. There had to be an impact. But maybe the auto flagging tool has a too high threshold (to avoid too many false positives) and may miss out on some negative comments.

The lifetime of negative comments.

In the answer by Kevin Montrose, it is hinted that the real impact is how many people actually see negative comments. The lifetime of a negative comment before it gets deleted is therefore equally important as the mere fact that it gets deleted eventually. The fraction of negative comments that exist on Stack Overflow at any given moment in time is probably somewhere between the blue and the red curve presented. That would be the interesting curve and it would depend on lifetime and deletion rate both.

Summary

All in all there is a bit of room for error, and especially if the false negative rate is high, the statement might be a bit too optimistic. If it wasn't then Stack Overflow made a great leap towards eliminating unwelcomingness.

11
  • 14
    "Did you try anything?" gets a .73 from UnfriendlyRobotV2. "Did you even try anything?" gets a .941. "Did you even bother to try anything?" gets a .978. The maximum is 1 and the threshold for an automated flag is .907. Commented Feb 6, 2020 at 17:54
  • 3
    @JasonPunyon Thanks for the values. So we could just replace version 2 and 3 with version 1 everywhere and call it mission accomplished, maybe. ;) Commented Feb 6, 2020 at 18:47
  • 12
    @JasonPunyon "Did you try anything?" is arguably as neutral a comment as it gets, so it should have a rating around .5 (50%). That it sits at almost 75% basically shows how skewed and biased the detection is. Commented Feb 6, 2020 at 21:46
  • 6
    @AnsgarWiechers The goal of the project isn't to have a specific score of a specific comment be palatable to a specific user. The goal is to bring comments that need attention to the attention of our moderators. We (correctly) would not raise this comment. Commented Feb 6, 2020 at 22:08
  • 1
    @Trilarion lol 😂 Commented Feb 6, 2020 at 22:29
  • 3
    @AnsgarWiechers The score doesn't have to be scaled so that 0.5 is meaningful. It's just a number below or above the threshold and that is all that is important. I wonder how well more veiled attacks are detected, it seems to be more like a "watch your language son" thing you might hear in your parents home. I wish though they would employ it on other popular Internet places. I can hardly believe Google or Facebook or Twitter cannot do the same. Commented Feb 6, 2020 at 22:38
  • 1
    If you say so. I for one am way past assuming good intentions. Commented Feb 7, 2020 at 8:58
  • @AnsgarWiechers Yes, there are critical aspects of their automatic detection but they are more to do with the threshold less with the absolute values of the score. Why is the threshold 0.907, why not 0.99 or 0.8? Commented Feb 7, 2020 at 9:39
  • 1
    @Trilarion I bet that threshold is roughly "moderators can comfortably handle X comment flags a day - set threshold to automatically flag ~X*0.5 comments a day". Probably with some adjusting depending on current needs - down if more training for robot would be needed (to get more comments reviewed by mods) or up to free up mods time if large number of auto-flagged comments not get deleted. 0.9 is likely just that round enough number that currently satisfy all needs. Commented Feb 7, 2020 at 17:35
  • @AlexeiLevenkov If this would be true it would be an indication that there is no control of the false negative rate and the true rate of cutting down negative comments as reported by the CEO could be anything. In the answer to the skeptics question it ends with "it's my professional opinion that the number really is cut in half" or something similar. Who would give a professional judgment without having at least an idea of the number of items you might miss out in the calculation. Commented Feb 7, 2020 at 17:57
  • 3
    Hey so I added some more graphs to Kevin's answer. The false negative question is a good one. I can't answer it without an oracle, but we can see how many false negatives there are for humans, given that the robot is running. Commented Feb 7, 2020 at 18:36

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .