51

Much as the question title says.

I am not an SEDE crack enough to research about that myself. But my guts say that the recently introduced indicator didn't help much to improve the quality of questions or answers from new contributors.

Well, it might encourage and remind to play gently with them for experienced users, but regarding the point we're just moderating content rather than users it doesn't seem to help much.

Also it reminds not to put comments which might be considered rude by them, but that's somehow subjective from point of the new user anyways IMO.

Most of the "veterans" seem to just aim for the overall quality of the site, and just use the engine's mechanisms to judge that.

So my questions are:

  1. Is there any observable impact on quality due to introduction of the New Contributor indicator?
  2. If not, why should we keep it?

BTW: Happy Winter Bash everyone!

9
  • 11
    As suggested by Makoto, I would like to see whether there was an observable impact on the attitude of veteran users towards new contributors, and (especially) vice versa.
    – E_net4
    Dec 17, 2018 at 20:28
  • 17
    I don't think that the "new contributor" indicator was ever intended to increase site quality.
    – BJ Myers
    Dec 17, 2018 at 21:22
  • 5
    What do you mean by "resilient" data?
    – TylerH
    Dec 17, 2018 at 22:16
  • 3
    I never expected the new contributor indicator to improve site quality, but since it was part of the welcoming movement, and the welcoming movement has focused heavily on unwelcoming comments, I made a proposal on Meta SE about a way to see if the New Contributor indicator has helped push away unwelcoming content: Let's use the Snark Detector to actually find out if the Contributor Indicator is having any effect where we want it to.
    – Davy M
    Dec 18, 2018 at 0:20
  • 2
    Maybe you mean "robust data"? According to my dictionary, "resilient" is "1. (of a person or animal) able to withstand or recover quickly from difficult conditions. 2. (of a substance or object) able to recoil or spring back into shape after bending, stretching, or being compressed." I don't think that applies to data. Dec 18, 2018 at 4:45
  • Or maybe... "concrete data", as opposed to "opinion" or "guesswork"?
    – Andrew T.
    Dec 18, 2018 at 7:07
  • 17
    That annoying banner does improve the site quality to some degree. Before, I occasionally commented on borderline bad question to give some hint. After that banner shown when I typing a comment, it's so annoying that I don't want to type anymore. So I just downvote and close vote then move on. The final effect is that more mediocre/borderline-bad question will be downvoted and closed more efficiently, and comments are only reserved to good questions.
    – llllllllll
    Dec 18, 2018 at 12:10
  • What is a SEDE?
    – Cid
    Dec 18, 2018 at 13:08
  • 2
    @Cid: meta.stackexchange.com/tags/data-explorer/info
    – Cœur
    Dec 18, 2018 at 13:44

2 Answers 2

43

I'm just going to codify my comment as an answer instead.

The New Contributor label is not related to anything in regards to the quality of posts we get from new contributors. It is a mechanism which was meant to remind users that these people are new to the site and we shouldn't presume that they know everything there is to successful participation here.

That said...

Even with that label, there's no meaningful data points that could be extracted to prove that a question is "better" with or without the label. People may react to the questions differently (with an acute aversion to taking appropriate moderation action on content), but that will never correlate to better quality.

5
  • 3
    That's a fair point and answers my doubts well, ty. I suspect it might even helped to lower rude responses for VLQ posts at all. Taking into account that site quality also includes welcoming that feature probably did it's job. Dec 17, 2018 at 20:31
  • 2
    @πάνταῥεῖ Maybe. Depends on who you ask.
    – Makoto
    Dec 17, 2018 at 20:35
  • 7
    I am not that much a friend of the feel being welcomed cuddly waggon, but well we have to keep it at a professional and neutral level, that's at least what I've learned the hard way here (and to some extend helps me to communicate professionally in my daily work at my job as well). Dec 17, 2018 at 20:41
  • 6
    @πάνταῥεῖ exactly: this "new contributor" thing worked some way. I see way less snark, and more professional reactions (including from myself :)), but that shouldn't apply to new contributors only. If it went away now, I'd keep the same behaviour. Dec 17, 2018 at 21:16
  • 1
    @Jean-FrançoisFabre Yes, agreed. We would have been learning with that to reduce snark. Dec 17, 2018 at 21:41
12

How do you measure quality?

The only measure any SEDE query will give you is changes in commenting, voting, closing and deletion patterns.

But do those numbers give real answer to your question?

I would say no. You are interested in knowing the real impact on question and answers quality and not effects of "let's be nice and welcoming" policies.

2
  • Well roared, lion. Fair point! Dec 17, 2018 at 23:02
  • I mean you can do sentiment analysis on comment replies, or look at following contributions.
    – djechlin
    Dec 20, 2018 at 15:52

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .