682

Editors note: For the Ask Question Wizard 2022 see Feature Test: Ask Wizard for New Users (trial has completed)


I'm really happy to announce that the Ask Question Wizard is now live on Stack Overflow! This is the end of a long arc of experiments that have been happening for over a year to provide structured guidance to newcomers when asking a question, and I'm so excited for everyone in the community to give it a go. This is the biggest change we've made to the question asking experience on Stack Overflow since we started a little over ten years ago, and it's the result of a lot of hard work and collaboration with all of you in the community.

Guided mode

How it works

  1. Go to the question asking page. If you are under the reputation threshold (currently 111, because that's what we tested with in previous experiments), you will automatically be directed to the wizard, also known as guided mode. If you are over that threshold, you'll be taken to the original question asking page, which we're calling traditional mode.

  2. You can switch from traditional to guided mode at any time by clicking the "Use guided mode" link near the top. When in guided mode, you'll be able to switch to traditional mode after first answering a few questions - a "Use traditional mode" link will appear when this is available.

  3. After you've switched modes, future visits to the question asking page will direct you to the question asking mode you last used for a period of time, overriding the default described in #1. That way, you don't need to keep switching back and forth between the two experiences. After that time period expires, you'll again be directed to the default mode based on your reputation.

  4. Switching between guided and traditional modes should always save your work once you start typing your question, so don't worry about losing any drafts when switching between the two modes. There might be slight differences in formatting when you switch, but the content of your post should always be preserved.

Why we're excited

Everyone on Stack Overflow stands to benefit from this feature:

  1. Guided mode addresses many of the concerns newcomers have about asking their first few questions.

    There is a lot of guidance, history, and culture involved in asking a question, and filling out those few blank boxes in the original question asking page can feel like a daunting task. With guided mode, we've tried our best to bake in many of the best practices when asking a good question on Stack Overflow. We're hoping that, with this launch, asking a question can turn from an intimidating experience into one that is more approachable and even fun.

  2. Guided mode means better questions on the site overall.

    Based on our experiments, we found that question quality improved when using guided mode compared to traditional mode. In our latest experiment, we found a 5.12% decrease in bad-quality questions, and a positive change in neutral-quality questions (2.26% increase) and good-quality questions (1.12% increase). We also saw an overall 3.42% decrease in overall question volume, which correlates pretty well with the decrease we saw in bad quality questions.

These early findings suggest that we're not only helping people ask better questions, but also stemming lower quality questions that occur on the site. These may seem like small percentages, but when we consider the scale that we're operating at with this launch, these small differences can have a large impact that we'll be looking for over the long term.

What's next?

One of the biggest wins with this launch is that we now have a framework for improving the question-asking experience. We wanted to get this first public version of guided mode out so we can continue improving on it as we learn more about how it's used. The team at Stack Overflow has a lot of exciting ideas about how we can improve the question-asking experience with this in place, but we also want to hear from you! Go and try out the wizard, and tell us what you think could be improved and what new ideas you're excited for us to explore.

You'll be hearing more from me and the rest of the team in coming weeks about the wizard and other features that are coming soon. We think this is one of the first big steps we can take to help both newcomers and veterans of the site collaborate better on Stack Overflow.

52
  • 88
    Why was 111 chosen as the limit? I hope it is higher, say 1000, (or 1111, if you don't want to press more than one key), as getting 100 or even 500 rep on Stack Overflow is very easy.
    – Bhargav Rao Mod
    Commented Mar 22, 2019 at 17:51
  • 41
    @BhargavRao It's what we tested with during previous experiments, so we're keeping that here for the first release. As we learn more about how people are using this, we'll probably experiment with different thresholds and adjust if needed.
    – Jon Chan StaffMod
    Commented Mar 22, 2019 at 17:53
  • 183
    Although I just posted a bug and may have some more feedback coming, I want to make clear that this is super exciting awesome news, and that I'm really thankful that this has finally come to fruition. Who knows, it might not make any perceptible difference, but at least we've tried. I should probably only speak for myself, but I'm going to go out on a limb and say that all of the veteran users really appreciate you and the team working hard to make this happen.
    – Cody Gray Mod
    Commented Mar 22, 2019 at 18:02
  • 13
    I really like how links to the other stack exchange sites go straight to their help center, where one of the first links is what the user can ask about there.
    – Davy M
    Commented Mar 22, 2019 at 18:08
  • 9
    When I opened up the wizards page and saw the options. I was joking to myself that 3 of the options would tell the user to GTFO. I was mildly amused that I wasn't entirely wrong, it sends them to a different site. haha
    – Mysticial
    Commented Mar 22, 2019 at 18:09
  • 7
    Whenever I see percentages like this, I think 'but what are the confidence intervals? Do all those decimal places really mean anything?' :/ Guided mode does look more friendly for new users though (Bugzilla has a similar guided mode vs. non-guided mode).
    – ahiijny
    Commented Mar 22, 2019 at 18:52
  • 10
    @ahiijny Good question! All these percentages are statistically significant from our latest experiment. We had over 100K people involved in the experiment when it was running, and we were able to converge on these results with >90% confidence.
    – Jon Chan StaffMod
    Commented Mar 22, 2019 at 18:59
  • 13
    So where's the data? I want to be able to audit this and actually do some determinations based on tag or technology.
    – Makoto
    Commented Mar 22, 2019 at 19:09
  • 96
    🙌 so happy to see this finally go out, thanks for everyone's hard work on it, including the community 😍 Commented Mar 23, 2019 at 0:46
  • 13
    @JeffAtwood: if we want to make this scale, time to create a new review queue 'Downvoted questions which were asked using the Ask Question Wizard', so we can spot bugs/weaknesses.
    – smci
    Commented Mar 24, 2019 at 2:24
  • 25
    5% fewer closed (terrible unanswerable trash) questions is... not great, I would've expected a much higher percentage. Either the metrics aren't getting everything, or the testing group wasn't representative, or something... but I was hoping for double digits at least. If the 5% number is correct, we still have a problem.
    – Ian Kemp
    Commented Mar 25, 2019 at 12:20
  • 11
    @smci Jeff Atwood's the wrong person to ask for improvements to the site; he doesn't work at SO anymore.
    – TylerH
    Commented Mar 25, 2019 at 16:13
  • 9
    @IanKemp - It is far more efficient to automatically prevent the need for content removal than it is to have community members do the removal manually. That said, Stack Overflow has gone the tooling route as well, and I have tried to do my share to help with the tooling in order to remove content. In addition, far too often in the past have we had the misuse of tools in order to prevent or remove content. Overall, it is a complex problem, and attempting to minimize the complexity by saying that it isn't being done because of "welcoming" isn't fair to all the hard work from everyone involved.
    – Travis J
    Commented Mar 26, 2019 at 5:24
  • 12
    @TravisJ Apologies - I didn't intend to denigrate the efforts that you, and many others, have put into creating tools to help with curating this site. My anger and frustration is directed at Stack Overflow the company, which has persistently and intentionally frustrated those curation efforts, as well as tarring curators with the "unwelcoming" brush. This wizard is a long-overdue step in the right direction from SO the company, but so much more is so desperately needed.
    – Ian Kemp
    Commented Mar 26, 2019 at 6:33
  • 10
    I read the title as "Ask a Wizard a Question", so I'm disappointed. I wanted to know where they get their hats. :(
    – user3657941
    Commented Mar 29, 2019 at 6:01

49 Answers 49

343

Maybe it's just me, but I didn't even see the additional fields at first. I did what was asked of me in the blue highlight and then hit the blue button:

Guided mode description next button skips other fields: background, show some code, etc

I expected hitting Next after filling in Summarize the problem would put me in the Provide background including what you've already tried and instead it brings me to review. This seems like an easy mistake to make.

10
  • 121
    It’s not just you. I’d expect next to take me to step 2 as well Commented Mar 22, 2019 at 20:46
  • 4
    No surprise this answer (concern) is top voted. No; not just you.
    – Amit Joshi
    Commented Mar 23, 2019 at 5:54
  • 36
    Perhaps "Next" could be programmed to take you to the next stage unless you've done them all, in which case it would take you to review...
    – Nick
    Commented Mar 24, 2019 at 4:37
  • @Nick That's more or less what I was expecting: if the last box is highlighted and you hit next that takes you to the review page: so you can skip a step, but you have to have to either click on it or click past it in the last: either way you have to actively skip it. Commented Mar 24, 2019 at 22:56
  • 65
    And the + icons should be a downwards arrow. + makes it seem like it's additional, a.k.a. non-essential, info to put in. The downward arrow shows it's a collapsed tab without implying it's an addendum.
    – kettlecrab
    Commented Mar 25, 2019 at 5:43
  • 36
    Maybe they should have asked around the UX SE before implementing this one... :p
    – lucasgcb
    Commented Mar 26, 2019 at 13:20
  • 28
    Agree this could be improved. We'll revisit this.
    – Jon Chan StaffMod
    Commented Mar 26, 2019 at 15:29
  • 2
    Same for me.... definitely force them to go through all the steps, even if they're not required to enter anything in 3 of them. Commented Mar 28, 2019 at 11:34
  • @lucasgcb Funny; I was about to post the same comment ... Commented Mar 30, 2019 at 13:51
  • @person27 I didn't not see those plus icons at all when I tried it Commented Apr 16, 2019 at 13:14
192

Be more explicit in the homework warning

Currently, the effect of selecting the homework option in the first step appears to be that you get shown this:

homework instructions

I find this phrasing unnecessarily weak and giving a false impression to pure help vampires. The tip suggests that asking a proper question “only” improves the quality and speed of answers. It fails to mention that not adhering to this is extremely frowned upon, unethical, and will (or at least should) yield no answers whatsoever.

Also, “homework questions” is bound to be naïvely interpreted as referring to the homework task itself, which is exactly what we do not (directly) want to help with.

I would suggest a wording along the lines of the following:

Great!

Our community is here to help you with coding questions about your homework. We’ll take you through a step-by-step guide for writing a great question.

Tip: We will not do your entire homework for you, only help you with it. Show us your code and focus on a specific problem you're having. Tell us what you already understood and where you are struggling.

14
  • 11
    I'm not sure I'd even say "for writing a great question", as opposed to something like "for writing an answerable quesiton" or "for writing a question our users can answer".
    – Tas
    Commented Mar 25, 2019 at 3:35
  • 2
    @Tas Fair point, but that's the same description they use for all the other pages, so consistency dictates that it be kept. Also, welcoming wagon.
    – Cody Gray Mod
    Commented Mar 25, 2019 at 3:45
  • 5
    This is excellent! Commented Mar 25, 2019 at 16:27
  • 72
    I take issue (just a little bit) with the phrase "Our community is here to help you with...your homework." That's not what this site is for. It really needs to say "We can help you with questions about homework, as long as you <instructions to write a good question>."
    – BJ Myers
    Commented Mar 27, 2019 at 5:07
  • +infinity for including "We will not do your entire homework for you."
    – zwol
    Commented Mar 29, 2019 at 14:25
  • 15
    I'd just say "We will not do your homework for you." Period. We answer programming questions that demonstrate the minimum threshold of competence necessary, not just gimme teh codez. Commented Apr 5, 2019 at 19:53
  • Also, "We’ll take you through a step-by-step guide for writing a great question" has issues. #1: it misrepresents the wizard. The wizard builds the question; a step-by-step guide is a list of instructions. Perhaps "In the following steps, let's build your question." (Feels a little clunky. Massage as necessary.)
    – Mathieu K.
    Commented Apr 7, 2019 at 21:34
  • #2: it feels like a bit of a non-sequitur, particularly in the original text. The proposed text fixes this, I'd say. Here's my beef with the original: If you're offering to help me with my homework, I expect the last word of the sentence to be "answer": "We’ll take you through a step-by-step guide for writing a great... answer." I already have the question, you know? Again, just to be clear, I think Wrzlprmft's proposed text fixes this just fine: it makes the "question" in both sentences to be the one the asker is about to ask, not the one they're being asked in their homework assignment.
    – Mathieu K.
    Commented Apr 7, 2019 at 21:38
  • @MathieuK.: “We’ll take you through a step-by-step guide for writing a great question” is displayed for all cases where you are not directed to another site. I left it in, because I wanted to focus on one aspect only. Your criticism is best posted as another answer.
    – Wrzlprmft
    Commented Apr 8, 2019 at 5:38
  • That's true. Your answer made me rethink the importance of it, though. Will delete.
    – Mathieu K.
    Commented Apr 11, 2019 at 3:10
  • 4
    I want to say I already saw a few mentions under copy-paste homework questions where the OP comment that they posted under the "homework section", and did not understand the downvotes/closure.
    – kabanus
    Commented Apr 23, 2019 at 8:40
  • 8
    I think the proposed response is still too weak. There needs to be some very specific warnings that homework questions unless crafted well often get a poor response. Then we need to provide some better guidance on just how to write that question. Maybe link to How do I ask and answer homework questions? but I'm sure there are even better resources Commented Apr 23, 2019 at 11:13
  • When dealing with people with low comprehension skills and/or non-native speakers we have to use the most basic and direct language. The kind of lingo that when translated online to, say, Russian and then back to English it has to keep making sense.
    – brasofilo
    Commented Apr 24, 2019 at 3:09
  • 1
    You might add: "Know your course policies about seeking external help or posting course material on the internet before asking questions. While you can delete unanswered questions that are down-voted, questions with up-voted answers remain visible to future viewers and can not be deleted."
    – Paul
    Commented Apr 25, 2019 at 21:27
143

Guide users to create an MCVE

The guidance currently highlights the importance of code formatting (which is great!), but it fails to note the importance of creating a Minimal, Complete, Verifiable example.

Image of the 'share your code' section of the ask a question wizard

Although the bold text ('Share as little code as possible that still reproduces the same problem') starts to hint towards this, a new user would most likely interpret this as 'copy-paste the only section of my code that has a problem' - which is not correct, as such a sample would be neither complete nor verifiable. Additionally, I found that my eyes skimmed over the bold section, straight to the examples - it was only when I purposefully searched for a link to MCVE that I fully read the sentence.

An ideal solution would be to add another 'good' example, saying something like '<tick> Create a minimal, complete, and verifiable example', and linking to the relevant help page.

17
  • 30
    Agree. I've been reviewing new users posts for months now and almost all of them fails to add the steps and/or the code required to reproduce the issue. It is very tiresome to explain to them individually that we can't help them if we can't reproduce what they're facing. IMO it's the #1 cause of bad newcomers questions and I expected more details and warnings to be provided in the wizard.
    – Nino Filiu
    Commented Mar 23, 2019 at 11:33
  • 4
    @NinoFiliu Don't waste your time trying to squeeze blood from very dense stones, just downvote and move on.
    – Ian Kemp
    Commented Mar 25, 2019 at 12:15
  • 19
    @IanKemp thats a bleak outlook... Newcomers should be treated as such new. If you have the time to downvote, you have the time to write a small comment why. Otherwise IMO you're as much a detriment to the community as newcomers with bad questions. >> stackoverflow.com/conduct Commented Mar 26, 2019 at 7:18
  • 11
    @FreeSoftwareServers Newcomers are expected to read and follow extremely basic instructions; this wizard was necessary because they weren't willing to do even that much. The reason for those instructions is so that we can help them solve their problem as fast as possible - so by ignoring those instructions, they are actively sabotaging themselves! I don't know about you, but that sounds like the exact opposite of intelligent behaviour to me.
    – Ian Kemp
    Commented Mar 26, 2019 at 10:24
  • 5
    @FreeSoftwareServers Pray tell where exactly does the CoC mandate that downvotes be explained? | Also keep in mind that people who actively curate the site cast many votes per day and there's a LOT of garbage flowing in all the time. Together they make up a fraction of a percent of the total userbase. Time is valueable and limited, and they do it for free. Frankly it doesn't seem reasonable to expect them to spend time reminding careless people to proof-read their gibberish before posting it. (Let alone explain to 10k rep users that they need a MCVE instead of 1 line ripped out of context)
    – Dan Mašek
    Commented Mar 27, 2019 at 0:00
  • 3
    @DanMašek I understand, I did add IMO as I do know It's not required. But I would rather you didn't curate if you don't have the time to explain votes. I just feel that we are pushing away users who could potentially grow into useful contributors by not helping them and under Our Expectations it's broad but it does say If you’re here to help others, be patient and welcoming. and Edits, comments, and suggestions are healthy parts of our community. which IMO are broad ways of saying to help newcomers vs quickly downvoting and moving on. Commented Mar 27, 2019 at 1:51
  • @DanMašek It doesn't say it's mandated and 10K users vs First Time Posters are two different beasts completely. Commented Mar 27, 2019 at 1:52
  • 11
    Wait, do backticks work now!???!? Commented Mar 27, 2019 at 14:55
  • 13
    I agree that this should be improved! "Don't paste an entire file" What? Exactly the opposite is true: (1) Create an MCVE and then (2) paste the entire file (otherwise, it wouldn't be complete). In fact, users should not be encouraged to "share their code"! They should be guided to create a new MCVE from scratch, based on their code. (And yes, discouraging users who think this is too much work from completing and submitting their question is probably a good thing.) After that, a link "discard my question, I just solved it by trying to create an MCVE" might be a good addition, ...
    – Heinzi
    Commented Mar 29, 2019 at 8:59
  • 5
    ...so that we get statistics on how many people were helped by guiding them to create an MCVE.
    – Heinzi
    Commented Mar 29, 2019 at 9:02
  • 3
    I think the Show some code section covers minimality and verifiability but lacks of emphasizing completeness. In principle, the user only has to realize that another user wants to replicate his code and needs everything necessary to do so, such as example data and also additional packages. We could just extend the phrase a little. "Share as little code as possible, that still produces the same problem, including the data and non-base packages needed for reproduction." There's a sophisticated duplicate in the trash, unfortunately I overlooked this answer.
    – jay.sf
    Commented Mar 31, 2019 at 18:24
  • Sometimes one line is totally fine as a MCVE especially in a language like R where there are sample data sets available (and reproducing issues using one of them often leads to the solution for the issue).
    – Elin
    Commented Apr 7, 2019 at 13:49
  • @andrewtweber Yes, since a few months ago now. I could swear I stumbed on some kind of announcement, but I can't find it...
    – Pac0
    Commented Apr 7, 2019 at 23:38
  • 1
    “Share the shortest code except that would allow somebody else to reproduce your issue.” // “Don't include anything that isn't needed to reproduce the issue.” // “If at all possible, provide code that can be run as presented.”
    – Veedrac
    Commented Apr 8, 2019 at 21:09
  • 1
    @IulianOnofrei If your answers are using the other method of code formatting (4 spaces), then that's fine and will continue to work perfectly. There's no need to edit your answers to switch to the backticks method. You may just find it more convenient in the future to use the backticks method for new answers. Commented Apr 20, 2019 at 5:56
141

The Do any of these answer your question? still appears when the search for similar questions returns 0 results, and asks you to verify that none of these 0 similar questions answer your question.

enter image description here

This issue has already been raised in this answer when the prototype was just ready, and apparently is there.

5
  • 7
    FWIW, probably any real question title will contain at least some words that will bring up some questions, even when they'll be completely irrelevant. Try e.g. "Why is my queldorf not florking?" OSLT. Commented Mar 22, 2019 at 19:57
  • 17
    @VladimirPanteleev Programming terms and utter nonsense are hard to distinguish sometimes, and real titles can return 0 results. For example, the title on this question and this question both return 0 results, as do many other titles without any real words. These may be poor titles and it may not occur frequently, but it will certainly occur.
    – Erik A
    Commented Mar 22, 2019 at 20:35
  • 2
    I was hoping this was fixed already. Commented Mar 22, 2019 at 21:05
  • 1
    Guess we can('t) mark my answer as a duplicate. I'll leave it here as a signpost
    – Erik A
    Commented Mar 22, 2019 at 21:14
  • 19
    @ErikA I think the point isn't that this step shouldn't appear when the title is gibberish; the point is that there's no point asking "do any of these questions help?" when the list of "these questions" is empty, because the answer will always be "no". Even if your title is excellent, if the system can't find anything that might be related, the "these things might be related" step can safely be skipped. Commented Mar 28, 2019 at 10:03
108

The wizard shakes violently when loaded in Internet Explorer 11. This makes the wizard completely unusable in that browser and can cause accessibility issues with users with photosensitive epilepsy.

I've captured an animated GIF of the issue, but it's in spoiler markup because epilepsy warning:

enter image description here

It seems that it cannot decide what the right width is, for responsive design. I did discover that reducing the width of the browser window works around the issue and makes it remain still.

19
  • 83
    If the goal of the new design is to reduce low quality questions. It would certainly help if it's hard to post one in the first place!
    – Mysticial
    Commented Mar 22, 2019 at 21:30
  • 110
    when loaded in IE - As Designed - WONTFIX. Commented Mar 22, 2019 at 21:34
  • 60
    Is the bug that it doesn't do this in all browsers?
    – Davy M
    Commented Mar 22, 2019 at 21:50
  • 31
    Really hate to say this @ErikA, but you missed the joke.
    – gunr2171
    Commented Mar 22, 2019 at 22:23
  • 56
    "It seems you are using an outdated or obsolete browser. Are you sure you should be programming?"
    – BJ Myers
    Commented Mar 23, 2019 at 16:00
  • 7
    Ahahaha, this is the most interesting IE-related bug I've seen yet! xD Thanks for the laugh
    – Clonkex
    Commented Mar 25, 2019 at 5:53
  • 14
    ... I wouldn't be able to reproduce this even if I wanted to, I just wouldn't have a clue how. To make this happen by accident is next level.
    – Gimby
    Commented Mar 25, 2019 at 14:03
  • 1
    I'm pretty sure IE is not a supported browser anymore for SO.
    – TylerH
    Commented Mar 25, 2019 at 16:22
  • 3
    @TylerH It is still supported...semi-supported, but nevertheless supported.
    – gparyani
    Commented Mar 25, 2019 at 16:25
  • 51
    @TylerH No no no, you've got it backwards! HTML 6 will need to have a <shakeviolently> tag so that all the other browsers can support this feature in a standards-compliant manner.
    – BJ Myers
    Commented Mar 26, 2019 at 3:51
  • 13
    This is a feature not a bug. Hopefully it will deter people from using IE. Commented Mar 29, 2019 at 17:50
  • 2
    Now also posted as meta.stackoverflow.com/q/382502
    – Mathieu K.
    Commented Apr 11, 2019 at 3:09
  • 6
    @BJ I'd bet that there's a good chance that IE users have more high quality questions and answers than the average SO user. Think about it: The majority of users using IE are working in some restricted corporate environment. Certainly not beginners wanting help with their home work. I doubt we have statistics for that, but it'd be interesting to see.
    – Voo
    Commented Apr 13, 2019 at 15:47
  • 4
    @gparyani Love the "epilepsy warning", and really good thinking of using spoiler markup.
    – James
    Commented Apr 15, 2019 at 15:44
  • 18
    But when the wizard starts shaking violently and shouts YOU SHALL NOT PASS, that's when you're in trouble
    – C8H10N4O2
    Commented Apr 16, 2019 at 0:55
87

Some of my reactions...


"What type of question do you have?" has a number of gotcha selections to short circuit off topic questions.

Good.

I'd suggest adding "I have a question about this website" and redirect them here.


You can't navigate (back button) backwards through the wizard, and some courses of action don't have a previous button, such as choosing "Other" for type of question. There's a possibility if you go down one route and wish to go down another you have to start over from the beginning. Not what I'd expect. I'd expect the back button to work or for the previous button to be everywhere.


I still think asking for a title at the end is a better option than before writing the question, but placing the tags first is very good.


When showing the user questions that might already have my answer, don't show unanswered questions or questions that are downvoted. Sort by votes and pick the top 5. If you show fifteen hundred in random order like you're currently doing nobody's going to want to slog through that. Probably won't even bother checking one, I know I didn't feel like it.


Each step in the wizard has such a small initial edit size. I'd prefer a larger initial area, with a well defined bottom barrier that can be adjusted manually (as in the regular post box). Also, automatically collapsing previous sections when moving on will help save on scrollwheels.


If I don't put code blocks in the code section, consider this an error condition and prompt the user to format their code if they have not done so.


In the expected results section, prompt the user to add the full text of any error messages they were given.


I think overall you guys did a pretty good job on this, from what I've seen. Congrats.

9
  • 37
    Personally I tend to write/rewrite titles at the end so I do agree that's an effective order. That said, if we save that step for last, we've made them spend their time writing a question that there's an exact duplicate of. As long as our duplicate check is based on titles, titles probably need to come before the body.
    – Catija StaffMod
    Commented Mar 22, 2019 at 18:57
  • 4
    Good point on that...
    – user1228
    Commented Mar 22, 2019 at 20:08
  • 6
    "Sort by votes and pick the top 5" - sorting by votes is only useful when I know that an old canonical question exists. Votes are not a good indicator of quality and relatedness, they vary too much because of different view counts. Potential duplicates should be ordered by relevance, as they are today. (Of course, the algorithm can always be improved...)
    – Bergi
    Commented Mar 23, 2019 at 14:27
  • 6
    @Catija Don't know whether this is good UI/UX, but would it be possible to show the title field before and after writing the question? Before writing the question, the title input could be labelled "Try to formulate a fitting title so we can search for similar questions already answered here. Don't worry, you can revise your title later" (or something like this). After writing the question, the user is asked to check whether they want to update their title, now that they've formulated the entire question.
    – TuringTux
    Commented Mar 23, 2019 at 14:57
  • @Catija Sorry, posted my comment too quickly - I just went through the entire assistant and saw that you can indeed change the title in the review section. So you can probably boil my idea down to mentioning that you can review the title (as well as tags and description) later.
    – TuringTux
    Commented Mar 23, 2019 at 15:04
  • 2
    Only showing some related questions improves the motivation to at least look at them. How about showing five or ten and increase the list each time any of them actually got clicked upon?
    – Alfe
    Commented Mar 25, 2019 at 16:01
  • "If I don't put code blocks in the code section, consider this an error condition and prompt the user to format their code if they have not done so." If I understand this correctly, you're making entering code mandatory. I disagree. Not every question requires code, such as this one about geth. Recommending to the user that he/she enter relevant code and allowing this to be skipped would be better. Commented Mar 30, 2019 at 13:59
  • 1
    @AgiHammerthief no, I'm not saying adding code is mandatory. But if you use the code section and have no code format in it, consider that an error and warn the user that they should format their code. If you're not adding code there's not a real reason to use the section marked for code. If you use the section marked for code you should have some code in it.
    – user1228
    Commented Apr 1, 2019 at 16:57
  • I like some of these and would like to upvote them. Consider breaking into separate answers.
    – Mathieu K.
    Commented Apr 7, 2019 at 20:57
83

– Clarify that questions about programming software tools are on-topic

If I indicate that "I need to troubleshoot some software or hardware", the wizard assumes that I'm about to ask an off-topic question and attempts to redirect me to a more appropriate place (Super User).

That works well in most cases, and I appreciate the motivation behind it, but there is a very important exception. Per the Help Center, one of the topics that can be asked about on Stack Overflow includes "software tools commonly used by programmers".

Practically speaking, that means questions about configuring your IDE, setting up a debugger, rebasing with Git, exiting Vim, and so on are allowed here. They might also be allowed on Super User, but that doesn't make them off-topic for Stack Overflow. Standing policy is that the asker should be allowed to choose where she wants to ask her question if it is on-topic for multiple sites. That decision is commonly based on where the asker thinks she will get the best answer, and in the case of programming tools, the best answer will almost certainly come from Stack Overflow.

You might say this is really not a big deal—why do we care if we redirect new askers to Super User?—but I disagree. There is plenty of confusion, even among long-time members, about whether questions about programming software tools are on topic. They absolutely are, and we need to be careful not to do anything that reinforces perceptions to the contrary.

Implementing this in a way that maintains the simplicity of the wizard is somewhat challenging, and I'd be open to suggestions about the best approach.

I don't think it makes sense to add another option button to the starting page of the wizard. It would look too similar to the existing ones, and too many options is actually a bad thing. So, I think we're going to have to modify/expand the existing option.

Maybe an interstitial step can be added that asks, "Is your question about software tools used primarily by programmers?" You can give an example or two (Visual Studio, Xcode, Git, Vim, etc.) in the body section. If the user clicks "Yes", they get routed to ask on Stack Overflow. If they click "No", they get routed to ask on Super User.

This would also allow later expansions to, "Is your question about professional server or networking administration?", and routing to Server Fault. And other adjustments deemed necessary when the Super User folks start coming at us with pitchforks.

7
  • 11
    There's no confusion. The help center is clear. Being a question about a tool commonly used by programmers can be necessary but not enough to be a on topic question for Stack Overflow. It's also necessary to be a practical question unique to software development. That you want emacs to have the background of the album Led Zeppelin IV isn't unique to software development. Also, personally, I've found those questions to be better answered by SU,SF,AU,U&L than SO, so it's a win for most interested parties (asker and future readers).
    – Braiam
    Commented Mar 22, 2019 at 18:33
  • 42
    Weird argument, @Braiam - the whole premise of the wizard is that the help center isn't sufficient for a good many new askers. Seems like offering a decision tree to help folks make the right call here would be a useful thing to have, particularly given past blow-ups when it comes to sites like Server Fault getting questions about the use of tools in dev environments where they very much should be on SO and probably aren't going to be answered well anywhere else...
    – Shog9 Mod
    Commented Mar 23, 2019 at 1:25
  • @Shog9 I see every tool, as an extension of the help center. Stuff to make what the help center establish as the basis of interactions with the site and other users easy and smoothly. In this specific case, the overwhelming majority of the questions that would follow this pathway, don't need a eject button. What we need is that whatever information we provide after they arrive to the other side should confirm the expectations the guided tool set. I have a bug to report about that. Landing on site.se/help isn't very useful. A landing page may be necessary (migration could use it too?).
    – Braiam
    Commented Mar 23, 2019 at 2:41
  • 5
    Can confirm widespread misconceptions about this being on-/off-topic.
    – user241244
    Commented Mar 23, 2019 at 17:46
  • 11
    @Braiam A question being about a tool commonly used by programmers may not be a sufficient condition for it to be on-topic, but it's also clearly not a sufficient condition for it to be off-topic, either, which is what the wizard currently presumes and what Cody is objecting to.
    – Mark Amery
    Commented Mar 25, 2019 at 12:29
  • 2
    ... although I wonder if the even bigger problem with the redirect to Super User is that it doesn't indicate that the "software" you're trying to "troubleshoot" should be something publicly available rather than your own proprietary code that you're trying to debug. I would not be surprised if the SU community turn up here soon to ask us why the F they've got a pile of PHP debugging questions on their doorstep from askers who say they were sent there from Stack Overflow.
    – Mark Amery
    Commented Mar 25, 2019 at 12:33
  • @MarkAmery I didn't say otherwise, but remember, people that has problem with their code would very rarely say that they have problem with a program but with their code. My gripping with Cody's answer is that tries to take something that has been very clear and muddy it, instead of improving the experience of the users that would be presented the tool. I told Shog what I believe is a bigger problem, and presented my answer also stating so. What would you believe is a bigger problem related to the wizard?
    – Braiam
    Commented Mar 25, 2019 at 15:05
71

- Typo in the "Show some code" help text of the description step.

enter image description here

"Higlight" should be "Highlight".

3
  • 4
    Damn, noticed this and thought I was all slick. Commented Mar 22, 2019 at 19:23
  • 1
    @WilliamJones you were all slick. Commented Apr 8, 2019 at 20:57
  • lol nice spotting this
    – Richard
    Commented Apr 22, 2019 at 17:40
42

Finally, we got tags before title. Can the search also be modified to include the tags in the "There may be similar questions"?

At present, even with guided mode, I still feel the similar questions list to be less than ideal.

Include the chosen tags in the search criteria for "Questions that may already have your answer."

An easy way to reproduce this is to, first: enter as the tag; second, enter "how to sort an array"; third, look at the suggested similar questions.

I think that this is planned since I ask about it all the time, but just as a reminder :) please include the tags in the search.


Beyond that... so excited. This seems like a really beneficial tool for so many new users. I hope it pans out, and will take any amount of improvement. That said, there is a lot of potential here, even small percents will be large progress.

1
  • 1
    Personally I prefer the tags to be added after typing out the post body itself. Writing the post often helps me to focus my thoughts and to determine what tags should be used. I'd still be fine with them coming before the title, as long as the title is after the body (which also might now be a bad idea).
    – Keven M
    Commented Apr 3, 2019 at 14:59
38

– Page title disappears as I click through the wizard

The <title> tag in the HTML is empty as I click through the wizard, which means that I get the raw URL appearing in my browser's title bar.

The title seems to be in place when I first open the page, but as I navigate through it, the <title> tag's contents somehow get cleared.

It might be nice to have the <title> dynamically update to reflect which step of the wizard I'm currently on, but that's a whole lot less important than just making sure that the page has a proper title. Keeping the original "Ask a Question - Stack Overflow" visible at all times would be acceptable.

3
36

I put in the python tag, and then asked the question "how do I convert an integer to a string". The top non-duplicate answer was for Java. I would expect the tag I entered be used to filter the other possible answers.

Screenshot of the suggested duplicate list, showing that the tag is clearly not used

1
36

Track the impact on the other sites redirected to by the wizard.

Since the wizard redirects askers to some other Stack Exchange sites, I would suggest to somehow track how this works, in order to make sure that we understand the impact. Staying oblivious of this impact carries a risk that affected sites may eventually push for their removal from wizard targets as was discussed e.g. here.

Ideally we would want to know how many askers registered at the target site, how many of them asked a question, and how well this question went. But for a start, we could at least track amount of clicks from wizard to other sites (possibly sampled), similarly to how it is done for hot questions at sidebar.

1
32

I think that telling the users to not worry can be setting them up for failure.

"And don’t worry—you can edit your question after it’s posted, too."

While it is true that the OP can edit their question once posted, community voting and actions are intended to be reflective of the post in its current shape, and if the current post looks something like this:

enter image description here

Then I am concerned that the user will have a rough go of things. Including the nod towards editing is good, but instead of "Don't worry", there should be a warning that voting and actions will be immediate and will be reflective of the post in its current shape, perhaps also including that asking a question at Stack Overflow expects a good amount of research to have been done up front, since at this point most of the basic questions have been asked.

6
  • 8
    Absolutely. People not worrying about what they post is IMHO one of the main causes of the issues we're facing.
    – Dan Mašek
    Commented Mar 26, 2019 at 22:36
  • 20
    "500 people will read this question in the next three minutes. Are you sure this is how you want it to look?" (from my comment the last time you raised this issue; others suggested using the number of tag watchers, and suggesting the user stick around to edit in response to comments) Commented Mar 27, 2019 at 1:47
  • 4
    @JeffreyBosboom: I like the sentiment, but "500" is a strong exaggeration (probably two orders of magnitude, in fact). Most questions never reach 500 views at all. I ran a sampling of 16k questions over most of a day with a quick PS script and got this CSV of views after 15 minutes. 99.9% of questions get 36 or fewer views in their first 15 minutes. 90.8% get 13 or fewer. 54.9% get 5 or fewer. I'm collecting data for a 3-minute examination as well, just in case that's interesting. Commented Mar 29, 2019 at 3:01
  • 3
    @NathanTuggy - It is good to get real data in the hopes of quantifying how many people actually view these questions, perhaps 500 is a bit of a stretch. I think that looking at 2 days worth of questions may be a little bit too small of a sample size though. Also to note, many users view titles and abstracts from the question list without actually viewing the question itself. I think something like "dozens of users" would be easily appropriate.
    – Travis J
    Commented Mar 29, 2019 at 4:26
  • Out of curiosity, did you intend to choose an example where the expected output matched the actual output already? Commented Apr 5, 2019 at 19:56
  • 1
    @PatrickRoberts - There are many problems with this example question :)
    – Travis J
    Commented Apr 6, 2019 at 6:07
31

Logged-out users get a 404 error when trying to access the wizard

When users who are logged out attempt to follow the link to the wizard, they receive a 404 error. The wizard link only seems to work for users signed into an account.

I understand that Stack Overflow (unlike most other SE sites) doesn't allow anonymous users to ask questions, but the normal "Ask" page shows a nice error message indicating that the user must be logged in. However, the Wizard link shows a 404 error, which has caused users to get confused.

Can we please make the Wizard link also show the same nice error, indicating that the user must be logged in?

30

Don't allow users to go to the Review tab if the other areas haven't been completed

It's easy to leapfrog the Tags, Title, and Description tabs and head straight to the Review tab without entering anything on them, with the big, blue Post Your Question button enabled. Leaving any of these fields blank prevents the question from being submitted and raises errors to the user, but why even show this page until they've successfully completed the first three tabs?

If the goal is to "provide structured guidance to newcomers", then force them to do the first parts of the wizard, and only bring them to the review when they've done so. As it stand now, it's easily avoided.

4
  • 1
    Your suggestion would be a good way to help with the issue mentioned in this answer too.
    – Davy M
    Commented Mar 23, 2019 at 21:43
  • What value does it add to impede movement through question editing? This was the first feature I checked for and was very relieved it didn't restrict my movement. Commented May 23, 2019 at 20:35
  • @sk8forether My FR has nothing to do with question editing. It has to do with allowing the user to skip past the important parts of the wizard and end up at the Review tab before they've completed what's been asked for.
    – j08691
    Commented May 23, 2019 at 20:46
  • @j08691 It seems completely reasonable to me to want to review your question throughout editing. Perhaps what you are really suggesting is not being able to submit a question before all sections are complete? I'm not sure I agree with that either, but it makes more sense to me than impeding movement. Commented May 23, 2019 at 20:58
28

Tag warnings are weird now

How to reproduce:

  1. Ask a question tagged .
  2. Go through the entire wizard.
  3. In the final step, note the tag warning at the bottom:

    tag warning for regular expressions

The problems with this is that this warning was made for the traditional mode, where it is fine as it is (if it gets actually shown). However, in the question wizard some of this is out of place:

  • Advice about other or more specific tags is best given on the tag page.
  • Reminders what questions are completely off-topic is also best given on the tag page or shortly afterwards (see the tag warning for for an example).
  • Some advice is obsolete as the wizard already incorporates it by default, e.g., as “show some code” or “describe expected and actual results”.
  • Some advice should be given before the question is fleshed out, e.g., the advice about including both, matching and non-matching examples in the above tag warning.

The probably easiest solution would be to split the bullet points in the tag warning into a handful of categories like:

  • Show after selecting tags.
  • Show before writing question.
  • Show at the end.
  • Don’t show in question wizard.

Then, show them according to their category in the wizard, and combine them in the traditional mode (like it is now).

21

– "Discard" should redirect to the beginning of the wizard

When you go to the "Review" page and click on "Discard", you should be redirected to the beginning of the guided tour. Currently, only all form fields are cleared but you stay on the current page.

21

There is still one aspect of this that is pretty unapproachable to new users.

Why in the world is there no formatting toolbar?

We get one in the normal asking/answering boxes, and it is much more user-friendly (though it still allows the exact same help that the guided mode does if you want to click the ? button and learn more.

20

I've commented on this proposal at every iteration, and I guess I'll once again register my dissent, although it feels pointless now. While this feature has improved since last iteration, I still disagree with its existence.

Most good questions on the site couldn't've been asked using Guided Mode. My posts are consistently well received, but I'm not sure if I've ever asked or answered a question that fit the 4-part structure guided mode asks for, and many of them couldn't possibly be contorted into it without damaging the question.

I don't really care if we have statistics showing an improvement in question quality if that improvement amounts to making what would've been bad debugging questions merely mediocre. I want us to get thoughtfully-crafted, widely-applicable questions that provide value to future readers. Guided mode is at best an irrelevance to that goal. The only "good" thing it can do is help thoroughly incompetent askers - people who are here to get their broken code debugged and who cannot even manage to coherently and answerably ask for that help if presented with an empty text box - to post better-polished turds. For what? How does that make us a better library of knowledge? Why does anyone care?

I guess my side has lost the debate; the comments and votes here make clear that the community seems to be enthusiastic about this feature. But I still want to say, one more time, to all of you: I think your enthusiasm is misguided. You will not get interesting questions that hold the attention of experts and produce value to future readers from this form. And, even with the option to swap to traditional mode, the signals about what questions are allowed here - like the form that only really supports debugging questions, or the instruction in the "Other" flow that only questions containing source code are acceptable - will drive away intelligent, conscientious contributors who would've asked thoughtful, broadly applicable questions if only we hadn't put up signs telling them that their contributions were unwelcome.

Which is a loss for us.

16
  • 3
    I'm...at odds with how to respond to this feedback. On one hand, yes, it does pigeonhole askers into a more guided way of asking a question, and that can lead to situations where some askers will be driven away due to the messaging we have for new users. On the other, we're starting to stem the tide of crap flowing in, something that's sorely needed. I guess the question is, what's more important? Potential askers not asking due to messaging? Or curators sorely needing a break from the flood? It seems to be six of one, and half a dozen of another.
    – fbueckert
    Commented Mar 25, 2019 at 19:57
  • 6
    @fbueckert: Curators don't need a "break" from the flood. They need a dam. If a feature like this can only prove that this is providing a break, what would happen next?
    – Makoto
    Commented Mar 25, 2019 at 20:02
  • 2
    To your point about statistics, Mark - if we have something objectively measurable, then we can go back to the PMs and identify the pain points of the site in terms they can understand. Nobody wants to expend development resources for marginal gain, and I get the impression that their numbers would hold a better conversation than either of us.
    – Makoto
    Commented Mar 25, 2019 at 20:04
  • 4
    In my opinion, this analysis is looking on the wrong side of the issue. You are examining questions which are posted by using this feature. First, those questions would have been posted anyway, so I disagree that improving them in any fashion is a loss. Second, and most important, this feature aims at preventing questions which should not have been posted by showing at least somewhat of a framework that needs to be completed in order to ask. Any percent gain of prevention by forcing users to at least consider the amount of work necessary to post will be beneficial.
    – Travis J
    Commented Mar 25, 2019 at 20:05
  • @Makoto Do we need a dam? Sure. I just don't think the Ask Question wizard is one, so I'm comparing what I see as the two potential scenarios.
    – fbueckert
    Commented Mar 25, 2019 at 20:07
  • 1
    @fbueckert: I don't think we can objectively prove one way or the other if it is a dam or not. I don't think it is either, honestly, but if you're expressing those as goals, we should be able to verify one over the other.
    – Makoto
    Commented Mar 25, 2019 at 20:12
  • @Makoto No issues there. Auditable data is a must to see how much of an impact it's having. It's just my opinion that a ~12% decrease in low quality doesn't do much but extend the period until curators burn out.
    – fbueckert
    Commented Mar 25, 2019 at 20:18
  • 2
    Asking thoughtful, widely-applicable questions isn't something you can make happen with some handholding, nor is it a common occurrence (otherwise "great" would be "mediocre"). I think this concern should be focused on ways the wizard prevents such questions from being asked rather than complaining that the wizard doesn't "encourage" such questions. Or perhaps your concerns should be addressed to primary/secondary school teachers across the globe who can do something about peoples' ability to think critically/at a high intellectual level, rather than here, far too far down the road.
    – TylerH
    Commented Mar 25, 2019 at 20:33
  • 5
    Mark, although I missed participating in the previous discussions, I'm very sympathetic to your concerns. I understand that with a wizard like this, we are essentially optimizing for passable "debug my code" questions. On the other hand, experience tells us that giving people a blank textbox and expecting them to draft a coherent question is not likely to be successful. And since "debug my code" is the most common type of questions from beginners, a bit of hand-holding to improve their quality seems like a reasonable first step. Our library of knowledge is becoming a dumping ground.
    – Cody Gray Mod
    Commented Mar 25, 2019 at 21:08
  • I agree with Cody. I think this is a case of it being the lesser of two evils.
    – BoltClock Mod
    Commented Mar 26, 2019 at 7:23
  • 6
    @TravisJ The feature may aim at preventing questions that should not have been posted, but it actually prevents anything that isn't a debugging question. Your view that anything that reduces the amount of bad questions must be good is blinkered, and exactly what I'm attacking. When a magical river of sewage and diamonds is running into your garden, and someone puts up a sign that says "Please refine your sewage before pouring; also, no diamond throwing", you don't accept the sign did good because it caused a 5% reduction in raw sewage. The sewage is unimportant. What about the diamonds?
    – Mark Amery
    Commented Mar 26, 2019 at 9:44
  • 2
    @MarkAmery - What a great analogy. So, in this magical river, there is 99.999% sewage, and randomly a diamond is somehow attached to an earring somewhere floating near the bottom. The sewage contains all sorts of filth, sometimes even dead animals. All this does is put in a very generous filter to only catch the dead animals. The earring will never hit it. If a user is highly proficient in asking and technical writing, they will switch out of guided mode.
    – Travis J
    Commented Mar 26, 2019 at 17:50
  • 8
    @TravisJ Our core disagreement then is perhaps not one of values but one of predictions. I expect the diamond earrings to get caught in the filter all the time - in fact, for the filter to extract a much bigger percentage of all the earrings than it does of the sewage. The trouble is that I expect skilled writers with interesting questions to disproportionately be conscientious, rule-following people. And I expect such people to be deterred when we present them with a wizard with instructions that suggest that their question doesn't belong, even if we don't outright block them.
    – Mark Amery
    Commented Mar 26, 2019 at 18:32
  • 5
    @TravisJ Note that to even get the option of switching out of guided mode, the user needs to have already selected a category and seen the guidance about it. For anything other than a homework problem or a question "about some code", it will tell them that they should only continue asking their question if it includes code. Plenty of good questions do not include code, but law-abiding new askers who want to ask them will be presented with instructions to not do so. That, I expect, will do more harm to us than a 5% sewage reduction does good.
    – Mark Amery
    Commented Mar 26, 2019 at 18:36
  • 6
    My opinion on this isn't quite as strong as Mark's, but I've started to see questions like this one that clearly went through the wizard, and may have become worse as a result.
    – BJ Myers
    Commented Mar 27, 2019 at 5:11
20

One thing that bothers me about the new wizard is that Stack Overflow was originally something of an attempt to collaboratively build an FAQ; the ideal was that people who had a question about programming wouldn't have to ask it on Stack Overflow, because the question would already be there, and the answer would already be there, thus there'd be no need to post a duplicate.

The emphasis on "show your code" in the new question wizard means that generic questions whose answers would benefit everyone are now more or less impossible to post. Let's take this question, which I selected semi-arbitrarily, as an example; I'd consider it a good example of an FAQ-style question which is likely to be of benefit to any reader which has a question about weak references in JavaScript. Now imagine a new user trying to post a good, ontopic, generally useful question like that one using the new question wizard.

Their first step is to list their type of question, and they already get stuck: it's not a question about code, it's not a homework problem, it's not asking for a recommendation, it's not a troubleshooting issue. So they have to choose "Other". Now for the question to be appropriate to SO, it needs to "include a bit of code", "concern a specific coding issue, algorithm, or language", "not be opinion-based". The second and third categories definitely fit. The first doesn't. Is this an "and" or an "or"? The page doesn't use a conjunction. Treating it as an "and" quickly reaches a dead end (even though it looks like one!), so let's assume our user decides to treat it as an "or" and continues asking on Stack Overflow.

The next step is tags (OK, , that's easy). Step after that is title; "Does JavaScript have weak references?" seems like a reasonable title. Then comes the duplicate check, and there are no duplicates listed. (Of course, because I'm using an existing question as an example for this thought experiment, there actually is a duplicate! But the duplicate check doesn't find it simply from the tags and title. That shouldn't be much of a surprise; the text of the post is the most helpful part for duplicate-searching, so the duplicate search and post-writing pretty much have to happen in parallel, like they do with the old workflow.)

Our hypothetical user, now that they think there are no duplicates, starts trying to write the text of the post, and everything starts falling apart:

  1. Summarize the problem
  2. Provide background including what you've already tried
  3. Show some code
  4. Describe expected and actual results

How many of these points fit? 1 sort-of, 2 and 4 very tenuously, 3 not at all. It's not possible to write this question using the template used by the new wizard, because it's a generic question describing a generic issue, and which gains as a result of that. The template is basically trying to force Stack questions posts to look like a "debug my code for me" or "help me finish my unfinished code" question. Now, it's pretty good at making those sorts of questions provide the information they need for people to solve them; but it's immediately repelling any other sort of question, including the fundamental questions that Stack Overflow derives most of its value from. Most frequently-asked-questions won't have a corresponding frequently-given-code-sample to go with them!

The fix to this would probably be to add an extra path through the wizard, but I'm not immediately sure what it would look like or what sort of information it would need to aim for.

2
20

The context of the section prompts are lost between the form and the final question.

What would it look like if you inserted the actual headers into the resulting question? (The author still has the opportunity to edit them out on the last page.)

Or take it a big step further (maybe too big for the legacy of SO), and maintain these four pieces of content as separate attributes on a question throughout, for formatting, searching, etc.

For example, in the Q/A format, this seems reasonable:

enter image description here

But without the context of the headers, the question is murky:

enter image description here

1
  • 4
    Yep! I never repeat prompts that are provided for me. It's actually a common mark of inexperience as a writer.
    – jpaugh
    Commented Apr 25, 2019 at 20:51
18

Okay, I'll make my position official.

Until I (as a layman) can see any queryable data as a result of users using this campaign, I will condemn this feature.

The percentages given aren't as amazing as I would want them to be; e.g. 5% overall doesn't compare with an unknown percentage of improvement or regression in our worst tags (PHP, JavaScript, C#, Java).

Until we can audit the data for ourselves to see how well this is going, I'm just flat-out refusing to agree that this wizard is actively helping users ask better questions because we have no way to prove it.

I will promise this much:

Once metrics are provided for querying, I will willfully withdraw my condemnation.
I want to use the metrics as a means of conversation and improvement, by asking what could be done to improve in certain tags, or what isn't working based on feedback from a denizen of a high-traffic tag.

27
  • 16
    Abstaining on a feature's merits is not that big of a deal, but that's very different from "condeming this feature" in boldface, which is a much bigger deal and a rather destructive criticism. This would be much better received, I think, if it were worded simply as a request for access to query-able data. Personally I don't think it's something worth querying, but I'd support people having access to the data if they wanted it. I can't support this kind of rude complaint, however.
    – TylerH
    Commented Mar 25, 2019 at 16:18
  • 8
    @TylerH: I find it less "rude" and more "pointed". I put this request in back in December when they were first discussing it, and we've heard crickets about it since. I'm stating that I have no way to trust that this is making the site a better place or making questions any better because we don't have any actual statistics to prove one way or another, in spite of what the desired outcome is.
    – Makoto
    Commented Mar 25, 2019 at 16:21
  • 5
    @TylerH: They've run this trial since about December when they first put it into a beta of sorts, and we've not had any auditable statistics about this, either. We just have the number of 1-5% of improvements. This doesn't tell us much. This doesn't say across what tags, across what technologies, or if there was a higher-than-average (or worse-than-average) trend in the hostly contested and most notorious tags on the site.
    – Makoto
    Commented Mar 25, 2019 at 16:22
  • 3
    @TylerH: If a feature comes out claiming to improve something, it should be backed up with some evidence. Until we can see that evidence, I have no reason to believe the claims. That's really all I'm stating here.
    – Makoto
    Commented Mar 25, 2019 at 16:23
  • 9
    It's not at all clear to me why you're taking such an obstinate stance on this. While I agree it'd be nice to see the data, why does the fact that no data has been published make you against the feature? Do you think the team is lying to us here? Is it not worth trying anyway? I mean, you kinda have to try something before you can generate meaningful data anyway. A small-scale test is really only to shake the bugs out of the wizard, not to provide representative data on which to draw meaningful conclusions.
    – Cody Gray Mod
    Commented Mar 25, 2019 at 17:29
  • 8
    I wanted to see if there were any takeaways from the last time that a feature like this was released, @CodyGray. I've been skeptically optimistic about if this feature would work at all, and at least in internal testing they said, "It did". Now I watch Java every day. I still see some of the same old poor questions in Java today as I did when this was still in Beta. I want some kind of proof that this is going to really work. I'm just left with trusting their word.
    – Makoto
    Commented Mar 25, 2019 at 18:13
  • 5
    @CodyGray: If nothing else, I hope this serves as an attention-grabber. If you're going to say that something is measurably and demonstratively better, then transparency is paramount. Without that transparency, we really don't have anything good to go off of. I mean, I can only look at what Java questions were posted today, y'know. I can't say one way or another if this is actually working without any way to see the data.
    – Makoto
    Commented Mar 25, 2019 at 18:14
  • 3
    @CodyGray: All they really need to do is make the metrics they're using publicly accessible. They're internal now, as far as I know it, but they exist in some form. Allowing us to query them to actually see how well they work for specific tags - not just the overall picture - would be more than enough to placate me.
    – Makoto
    Commented Mar 25, 2019 at 19:05
  • 2
    @Makoto What makes you think that user was even prompted with the wizard? They have ~240 rep more than is needed to not be prompted with it by default.
    – TylerH
    Commented Mar 25, 2019 at 20:13
  • 2
    @TylerH: Yeah, ya caught me. That was a rant. I'll withdraw that complaint.
    – Makoto
    Commented Mar 25, 2019 at 20:14
  • 2
    It is easily possible to have a strong effect on quality by limiting the lowest quality questions from even being posted. This is part of what the mentorship program accomplished. There are statistics to back that up as well. Once users realize they need to have some sort of structure for their post, then often end up rethinking if they should ask...
    – Travis J
    Commented Mar 25, 2019 at 20:19
  • 2
    ...Uncertainty leads to questions never being posted, which saves the community a whole heap of time and reduces the amount of low quality entering the system. The entire review system retroactively removes something like 10-15% of these from happening. By relation, 5% would be massive.
    – Travis J
    Commented Mar 25, 2019 at 20:19
  • 3
    @TravisJ: And all I'm asking for is that data to be made freely available already. Otherwise, I see this effort as largely fruitless.
    – Makoto
    Commented Mar 25, 2019 at 20:26
  • 3
    @TylerH: No, I don't really need to know what tags you're individually watching, since it doesn't prove that you're asking questions in those tags, or a good contributor in those tags, or anything else. How you choose to shape and view the content of the site is a personal decision, not tied to any metric of whether or not one is capable of asking a measurably good question.
    – Makoto
    Commented Mar 25, 2019 at 20:27
  • 3
    @Makoto, sometimes, expression of one's feelings is only a means to an end. I think if you carefully consider your position on this matter, you will see that "expressing your feelings" was not your end goal, but that what you actually wanted was "obtaining access to the data." Thus, it is prudent to carefully construct our statements not to express our feelings as accurately as possible, but to communicate a need to the community as effectively as possible. If I have misread this situation, please carry on.
    – Him
    Commented Apr 3, 2019 at 15:16
17

This is a very minor gripe, but there's currently no way to use the stack snippet generator thing. I'm not sure that new users would discover that feature anyways, but I certainly missed it when I was trying to test out the wizard.

It might be useful to point out its existence if users select , , or .

1
  • Related on older discussions: 1, 2, 3: currently, the formatting toolbar (and to the extent of markdown shortcut) is available only on the "Review" step.
    – Andrew T.
    Commented Mar 23, 2019 at 19:22
16

– The wizard is not correctly implemented on mobile.

Steps to re-create:

  1. Open Stack Overflow on a mobile browser in the mobile view of the page. (If you request the full site manually, you won't hit the error)

  2. Click "Ask Question" on an account with less than 111 rep, or use the wizard link from this question (I tried both). The view will be changed to that of the full site, but the wizard will appear.

  3. Select "I have a question about some code" and click "next" twice.

Instead of being taken to the next step in the wizard, the normal mobile traditional view appears, even though the URL is https://stackoverflow.com/questions/ask?guided=true&__=940538704 (Note the guided=true in the url).

Traditional Mobile View

In order to return to the wizard, a mobile user must scroll down to the bottom of the page and request the full site.

This could be considered a loophole for users to evade the wizard (I tried it on a brand new account and yes, I could bring up the normal Ask Question mobile view). Even if we don't care about users getting around the wizard in that way, it's still a very uncomfortable change to be forced into the full site view to use the wizard, dropped back into the mobile view without warning, and have to manually re-enable the full site view to continue with the wizard if you so desire.

2
  • 2
    I've had to do this in Brave to get anything at all to display properly. What browser were you using? I think this may just be a broader mobile display problem.
    – Makoto
    Commented Mar 22, 2019 at 19:05
  • @Makoto Chrome for Android, 73.0.3683.75.
    – Davy M
    Commented Mar 22, 2019 at 19:10
16

Neeeeeed a better page title:

Without the wizard, the page title is:

Ask a Question - Stack Overflow

With the wizard, the page title is as short as:

No title! This makes my browser (Chrome) fall back to page URL:

This is... not a good UX setting. Must fixxxxxx.

3
  • 9
    I think Cody's already covered this in this answer
    – Jon Clements Mod
    Commented Mar 23, 2019 at 12:10
  • 8
    On the plus side, nifty browser theme.
    – user241244
    Commented Mar 23, 2019 at 17:52
  • 5
    If by "nifty" you mean, "difficult to read" then yes I agree :P Commented Mar 29, 2019 at 17:54
14

The navigation needs an improvement. Every next button should lead somewhere where I also find a back button to return. Unfortunately, also the browser's back-button (or Alt) doesn't work as expected and only restarts the whole wizard.

Things like these quickly create frustration.

When ever a back button on the target page is not possible (at least not in the current implementation), I suggest to change the next button on the origin page to something which makes it clear that this is a one-way path, e. g. by renaming it to leave wizard and launch editor or similar.

1
  • 1
    The fastest improvement I can think of is to open links which lack a back button (and are thus outside of the wizard) in a different window or tab. This shouldn't be the final implementation of course, but it could quickly reduce stress for any tester.
    – Alfe
    Commented Mar 25, 2019 at 16:19
14

While selecting tags, the wizard is allowing me to type tags (seems like it is allowing the creation of new tags).

It should not allow me to type random tags in this step, in the final step it blocks me from adding new tags. It tells me that it requires 1500 reputation to create new tags.

See this See this

12

In the "Show some code" section, why not just automatically make that a code block instead of asking the user to provide the backticks? I guess you could put context e.g. ``` csharp.

I think it would have been more user friendly if the wizard automatically did it.

enter image description here

3
  • 8
    The wizard should also offer four space indentation as a method for code blocks since it's the original method and one that most users are probably familiar with.
    – TylerH
    Commented Mar 25, 2019 at 16:14
  • I have been on stack overflow for years. Admittedly, english is not my first language, but this is the first time I've ever heard the words backticks and tildes. I can guess, based on the examples though. Also, yes four spaces is what I've always used, and I was not aware that this was an option. I love the rest of the guide.
    – jumps4fun
    Commented Apr 9, 2019 at 13:52
  • Related other answer: meta.stackoverflow.com/a/382522
    – Mathieu K.
    Commented Apr 11, 2019 at 3:15
10

I find unhelpful that people that would ask off topic questions on this site (after not reading the little /help/on-topic page) would find being dropped into site.se/help with a tons of links and no clear path forward. Maybe we need a /help/landing-from-so on those sites with a very short introduction of the site topic (what questions should be asked and not be asked (depending on the site that redirected them there?)) and a pathway for searching for answers/asking their question.

4
  • 2
    A link to help/on-topic would be most appropriate in my opionion Commented Mar 23, 2019 at 3:10
  • 3
    also related: "Track the impact on the other sites redirected to by wizard..."
    – gnat
    Commented Mar 23, 2019 at 6:39
  • I'm a big fan of this idea. Get some of this guidance in front of people before we even send them to a different site.
    – BJ Myers
    Commented Mar 27, 2019 at 5:15
  • @BJMyers actually, this one is backwards. It's guidance after they have been sent to the other side.
    – Braiam
    Commented Mar 27, 2019 at 13:33
10

One of my most common gripes about questions asked by new(er) users is that the problem statement is something along the lines of "it doesn't work" or "it's not working" (e.g. this question). Is there any way the wizard can look for these commonly used phrases and provide a polite suggestion that perhaps the problem statement needs some work?

0

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .