81

I just came across these HTML comments when I went to edit a question:

<!-- What are you trying to accomplish? (Please include sample data.) -->
<!-- Paste the part of the code that shows the problem. (Please indent 4 spaces.) -->   
<!-- What do you expect the result to be? -->
<!-- What is the actual result you get? (Please include any errors.) -->

I haven't seen these before, and I was wondering if they were related to "What can we put in a question template to help people ask better questions?"

If not, what are those about? I'm pretty sure the OP didn't put them in.

If so, I'm sorry for spoiling the official announcement.

10
  • 1
    "I'm pretty sure the OP didn't put them in." Anyone else from the questions edit history?
    – user0042
    Commented Dec 5, 2017 at 17:51
  • 2
    Good question. But there are no edits so far. I assumed they didn't put them in because they don't match the rest of the writing style at all, and it seemed strange for someone to ask themselves questions in their question. Commented Dec 5, 2017 at 17:52
  • 1
    @Don'tPanic Honestly I'm surprised it took this long for someone to comment!
    – Joe Friend StaffMod
    Commented Dec 5, 2017 at 18:18
  • 5
    @JoeFriend maybe it's so successful that it's producing nothing but questions that don't need editing? ;) Commented Dec 5, 2017 at 18:21
  • @Don'tPanic Wow, you just made me smile. Okay, so that probably isn't it, but it made me smile anyway. Maybe the whole of meta has been too busy Christmas (or Hanukkah or Kwanza or whatever) shopping to notice?
    – Joe Friend StaffMod
    Commented Dec 5, 2017 at 18:25
  • 2
    In case it's not obvious, feel free to delete or leave these comments as you see fit. I decided to make the template 100% HTML comments so that the OP can see them while editing, but they won't show up in the rendered post. That way it doesn't matter so much if the asker ignores the template.
    – Jon Ericson Staff
    Commented Dec 5, 2017 at 18:45
  • 9
    @JonEricson :( Commented Dec 5, 2017 at 18:48
  • Although, I assume googling "What are you trying to accomplish? (Please include sample data.)" isn't the best way to find examples of successful template users. Commented Dec 5, 2017 at 18:50
  • 2
    @Don'tPanic: Ugh. That clearly goes in the "template failure" category. Thanks for cleaning it up with an edit. If we see a lot of cases where people screw with the template without deleting it, I might need to adjust the copy.
    – Jon Ericson Staff
    Commented Dec 5, 2017 at 19:02
  • 1
    I was wondering about this the other day, too.
    – jscs
    Commented Dec 5, 2017 at 21:03

1 Answer 1

85

Yes. We started an experiment on Friday (see screenshot of editor with template below). So far 15,000 people have seen the template and over 9,000 of them have gone on to ask a question. Anyone with less than 111 rep is eligible for the experiment (no guarantees on whether you see it or not). The outcome of this experiment is evaluated using our new question grading system. We are also running a survey for those who experience the template. We will be back in a week or two with details on how well it works.

Editor with template enter image description here

It is important to remember that this is the first of many experiments we will run around the question quality theme. Given that we haven't executed an experiment around question quality before, we intentionally kept things simple so that we could focus on the mechanics of running this new type of experiment.

35
  • 3
    Would it be worth adding something like "please remove all these comments before posting"?
    – Shepmaster
    Commented Dec 5, 2017 at 19:22
  • 9
    @Shepmaster I don’t think so — HTML comments don’t show up in posts. <!-- (but they do show up in comments) -->
    – Jed Fox
    Commented Dec 5, 2017 at 19:34
  • 16
    I'm curious to see how many people simply select-all -> delete. Then proceed to copy-paste dump their homework or a screenshot of it with the title: "HALP URGANT!!! PLZ!"
    – Mysticial
    Commented Dec 5, 2017 at 19:41
  • 21
    "Anyone with less than 111 rep is eligible..." Oddly specific number. What's the logic behind it?
    – j08691
    Commented Dec 5, 2017 at 19:42
  • 6
    @AntoinePelletier: The point is to get people to think through their questions a bit better. If people want to replace the comments in order, I think that's ideal. But if people prefer to add their content between the comments, that's fine too. I'm even ok with people reading the template, asking a better question as a result and forgetting to remove the template. In any case, the A/B test ought to show us if there's a measurable improvement in question grade as a result of the template.
    – Jon Ericson Staff
    Commented Dec 5, 2017 at 19:43
  • 15
    @j08691: at a guess, the logic is that a complete beginner on this site can have 1 point by default + 100 for transferring their account from another SE site, so they can have 101 without having used this site before. 10 more means they've either done a few edits that were accepted, or else received at least one upvote on an answer or two on previous questions, so they've shown at least some familiarity with the site. Commented Dec 5, 2017 at 19:50
  • 22
    "(Please indent 4 spaces.)" could be improved by informing the user that the {} in the edit bar will perform this indentation. Perhaps: "(Please indent 4 spaces; e.g. select your code and click the {} in the edit bar above)".
    – Makyen Mod
    Commented Dec 5, 2017 at 20:06
  • 8
    Also, shouldn't we be asking for an MCVE instead of "part of the code"? Commented Dec 5, 2017 at 21:22
  • 7
    @j08691 When we ran the mentorship experiment we used more complicated criteria. I suggested simplifying the criteria AND increasing the rep level to broaden the pool of participants. Having a bigger pool helps reach a statistically significant result sooner. So, 111 is 11 rep (earned on SO) + 100 association bonus that you get by having decent rep on some other network site. This is an imperfect attempt to fully include most very, low rep question askers. It seems to be working well at this point.
    – Joe Friend StaffMod
    Commented Dec 5, 2017 at 21:52
  • 8
    @KevinWorkman: I have a template variation that specifically prompts for an MCVE. For this test, we wanted something simple that didn't require people to go to another page to figure out what the template is getting at.
    – Jon Ericson Staff
    Commented Dec 5, 2017 at 22:30
  • 3
    @JonEricson It seems that even some truly terrible questions are at least trying to fill in the template, so... good news?
    – mbrig
    Commented Dec 5, 2017 at 23:01
  • 2
    @mbrig: Huh. Well. . . maybe more entertaining than if there weren't a template?
    – Jon Ericson Staff
    Commented Dec 5, 2017 at 23:08
  • 7
    Some people are responding to the template's prompts without realizing that no one else sees them.
    – Shepmaster
    Commented Dec 6, 2017 at 20:43
  • 9
    This is a massive detriment to the site. We can now expect even less interesting questions, and even more mindless debugging nonsense questions that have been asked and answered in one way or another hundreds of times already and will never help anyone other than the OP ever. Y'all just keep coming up with ways to discourage experts from participating, and encourage those who ultimately add no value to the site to participate. Just making the great wall of crap that much bigger.
    – user4639281
    Commented Dec 7, 2017 at 18:31
  • 4
    "It's OK, we're just shooting ourselves in the foot right now. Once we're done shooting ourselves in the foot, we'll still be able to walk... right?"
    – user4639281
    Commented Dec 8, 2017 at 0:46

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .