428

A long overdue update to our last prototype announcement, our developers are pleased to announce that they've finished the review process and responsive design updates to the Wizard and it is now in testing.

First, some screenshots!!!

Question Wizard Problem Selection Screenshot


Question Wizard Tag Selection Screenshot


Question Wizard Guided Asking Screenshot

What does this mean for most of you?

For most people reading this, probably nothing. If you arrive to the site incognito and create a new account, you have approximately a 50/50 shot of seeing the new interface as you ask your first couple of questions, or perhaps first really great question, whichever happens to come first. We're going to be varying the criteria that sends folks 'off to see the wizard' during the experiment to determine what the optimal settings look like.

How long will this be in testing?

Quite some time. We can measure success and failure a number of different ways, ranging from how well questions 'land' after a few days of being asked, how fast they get answered, user interviews and even an uptick in abandoned questions might indicate healthy patterns as the wizard encourages you to think procedurally through your problem.

However, it's way more structured than what we have, which can be a daunting if not overwhelming empty text box to someone that doesn't really know what's supposed to go there, so we're going to have to work to separate improvements based on the introduction of structure alone from improvements coming from individual elements of the wizard itself, and that's going to take some time. It is, as I said, a rather large change.

Where should feedback go for this?

Here on Meta Stack Overflow is fine. Note that, as we iterate, circumstances are likely to be ephemeral so don't put too much time into things; a screen shot with a short paragraph or some free-hand circles is really helpful and (hopefully) won't result in grief if your feedback is just quickly culled with lots of other stuff because a change obviated it.

What else do you need users to do?

Nothing. Hopefully, enjoy a larger bounty of questions that are more representative of what folks are capable of writing if you give them some structure and guidelines. When you see folks propose improvements, remember that the needs they describe represent a perspective we really need to learn in order to help them more, so please see usefulness in their perspectives which show us how they're actually acclimating to what we build, not just how useful you might find their suggestions.

What's the criteria for the test group?

It's going to fluctuate. I can pretty confidently say that if you have enough rep to not see ads, you'll be extremely unlikely to see the wizard while it's in testing. It'll almost always be some combination of:

  • Account rep
  • Question history
  • Whether you've triggered a rolling rate limit

... and many other things. We'll probably start off with rep and work from there, but know it's bound to change. Someone can ask one question and hit the jackpot, get 300 rep out of it, then belly flop. While we're discussing this as one big experiment, it's probably going to be multiple experiments that run for 3 - 4 days each, some even concurrently.

We'll know fairly soon if we're going to graduate the experiment and will update this post at that time, then likely continue to run more experiments just to tweak the structure and interface.

I think the Earth is flat!

I think getting a spaceship and going up to check it out just so we can be, you know, sure is a great idea. But if you have a question or comment about anything in this post, please leave an answer below. If it looks like your feedback is turning into something that should probably become a new question altogether (or maybe an outright bug), we'll let you know in comments.

79
  • 79
    What is behind the "I need a software/hardware recommendation" options? I'm hoping it's something letting them know we don't do that here. Dec 19, 2018 at 14:49
  • 79
    @NicolBolas It is :) We capture intent that we want, just in other places, and redirect them to the appropriate resource.
    – user50049
    Dec 19, 2018 at 14:51
  • 72
    @NicolBolas it's sounds like a trap. If you select it, you will get banned automatically before asking. Good way to avoid bad questions :p Dec 19, 2018 at 14:56
  • 27
    @JamesWhiteley We're currently thinking you'll be able to toggle between the wizard and the current editing experience for all users, and new/low rep users will default to the wizard. It really depends on the outcome of the experiment(s).
    – Jon Chan
    Dec 19, 2018 at 15:01
  • 57
    "Only include software versions when absolutely necessary" I'm crying right now of happiness.
    – Braiam
    Dec 19, 2018 at 15:01
  • 24
    BTW, you guys are already measuring the time the user spends typing the posts for spam reasons, but throw that value away. Maybe it's time that you start saving that value somewhere.
    – Braiam
    Dec 19, 2018 at 15:09
  • 22
    It'd be nice if there'd be some sort of query string parameter or something that could be added to force the new wizard, just so people looking to test it can easily get to it.
    – Servy
    Dec 19, 2018 at 15:09
  • 9
    Can we expect any weirdness when seeing questions asked by people misusing this wizard? I remember previous ones had HTML comments that just got uncommented/mangled and included in the questions by some, are there comments/template content included now?
    – Erik A
    Dec 19, 2018 at 15:14
  • 205
    I swear the title should always be the last thing you write. I've never had a title survive intact after writing out the actual question.
    – user1228
    Dec 19, 2018 at 15:45
  • 9
    @Taplar maybe, but then the user can't complain 'but I didn't know'. We'll be able to tell them either 'you misclicked on the wizard, here is what you should have seen' or 'well you went against what the wizard said.... You only have yourself to blame'
    – Patrice
    Dec 19, 2018 at 16:42
  • 11
    @Taplar It still provides good guidance for people new to Stack Overflow who don't know better. By the time they've got used to the wizard and instinctively select the first option, they'll hopefully at least have an inkling that other sites exist. Dec 19, 2018 at 16:46
  • 34
    @Taplar: "Sure, but how does that help us?" Because not all of them will do that. Some users are actively malicious and don't care about our site's rules. But other users are simply ignorant of them; presenting the rules before letting them ask the question at least gives them a chance of not breaking them. This tool cannot stop perfidious misuse of the site, but hopefully, it will stop ignorant misuse. And if that cuts things down by only 20%, I consider that a win. Dec 19, 2018 at 17:11
  • 17
    @Will: I agree titles should be the last thing you write or at least the final edit. But it's important to get at least a draft title in early so that we can check for duplicates early. If you type in a tags and a title there's a step to see if search can find your question already asked. In addition, the final step (Review) gives you a chance to rephrase the title. Dec 19, 2018 at 20:38
  • 9
    @TinyGiant: If you pick "Other" you get a little blurb based on the on-topic page. In particular it suggests you might need "bit of source code". If you look at terrible questions, they are often vague requests based on a desire with no evidence they've tried anything. So yes I am hoping to have fewer of those questions.To encourage them from a new user seems like a good way to get more bad questions. Valuable questions are hard to write. But most people seem more concerned with utterly useless questions that this feature is designed to limit. Dec 19, 2018 at 20:51
  • 25
    Awesome! Glad to see this finally going in! Dec 21, 2018 at 10:36

38 Answers 38

1
2
-1

This wizard sucks. Where are all the buttons I see right now to paste a link? insert an image

enter image description here

Can I opt out?

-1

How does one get out of the wizard? It is far more cumbersome than using the regular tool. I think the wizard had value the first time I used it, as it provided a nice structure to laying out the question, but that is overshadowed by how much harder it is to actually ask your subsequent questions.

So how do I get myself out of wizard purgatory?

-1

I don't know if this would fit in the wizard. But I keep seeing two major things, besides the homework & code doesn't work questions

"I need help formatting my question" - Some people require help formatting their question. This might be able to get implemented with a tag? (needs formatting) preventing unnecessary downvotes due to bad formatting

"I can't write decent English" - Often I see potential great questions, but written by a non-native English speaker which results in a massive downvote because no one can understand the question.

Perhaps this can be solved with the help of someone who speaks the question asker's language and translate into readable (doesn't have to be perfect) English?

2
  • People who "need help formatting their questions" can be pointed to the Help centre. (I still have not seen this wizard, but perhaps it has a ? button for editing help, as the regular editor has.) And the danger of editing and then answering a severely sub-par English question is that the OP might not understand the answer!
    – Jongware
    Dec 31, 2018 at 13:53
  • What you are suggesting has a “meta-tag” feeling. We already have the H&I queue; and many users helping along outside of the queues as well. But “preventing” votes because you need help? I do not see how that would work.
    – yivi
    Dec 31, 2018 at 15:29
-1

To be honest, I consider the change not very pleasing. Your intention to help people to structure a better question is the right direction. However I tend to say that not every question fits in the scheme the assistant suggests. There are some quite higher rated answers regarding this question present that I think have given good advice. Here are some of my issues:

  1. Please avoid forcing the questions to be pure code-based instead of conceptual as well.

  2. Personally, I first write the main text and then reformulate the title and tags. This makes more sense to me. Forcing the user to formulate a single question might help to avoid duplicates (due to the implicit search) but normally I rephrase my question after writing the main matter completely.

  3. Also I need to click on the review button each time I want to write a question. This requires a few clicks more than before, rendering myself less productive.

6
  • On the other hand, if you're less productive but your questions are better formed, then that's a net gain as a whole for the site. I agree there's still room for improvement, the choose tag first part is, I hope, to get templates by tag in the future and makes sense, you should be at least aware of what language you'll ask about. Does it make sense ?
    – Tensibai
    Aug 1, 2019 at 13:53
  • Partially. I do not always ask related to a certain language. Many of my questions are either related to frameworks (which make it hard to create useful templates) or concepts (which are even broader). Also I tend to say that the personal benefit for me is comparably small. I know what a MWE is and try to give them when applicable. However there are many cases in my personal experience where I want to avoid a strict form of the question.... Aug 1, 2019 at 14:25
  • ... This can be for example the case if I have a question that is quite detailed about a certain point but I want to give the reader a chance to focus on the topic the first time he reads it. So I oftenly write a short "abstrct" (1 paragraph plus detailed question) and then the (not so) glory details of my question and what I thought/did/found yet. Doing it the other way around causes often quick shoots as answers because the question was not 100% analyzed. Aug 1, 2019 at 14:28
  • 1
    Well, for frameworks, they usually have tags as well, so I fail to see how giving a tag first can be impending in writing a question, at worst it force you to consider what the question is really about. Now for the code and question order, if you're comfortable enough you can dismiss the wizard entirely (as you found) and I don't remember something preventing you to re order things before submitting. To write an answer, I prefer to have relative datas first and the question at the end, that's less scroll to refer to the question when answering. So there's no ideal format here :)
    – Tensibai
    Aug 1, 2019 at 14:34
  • 2
    Thank you for this. I've been parroting that the ask question wizard doesn't support how-to style questions (which are very much on-topic, tend to be the most useful questions asked, and do not require any amount of code). It's important to get feedback from someone actually trying to use the wizard to ask a how-to style question. Thank you, thank you, thank you.
    – user4639281
    Aug 1, 2019 at 18:25
  • 1
    @TinyGiant, if you're looking for new users' reactions to the wizard, you might also be interested in meta.stackoverflow.com/q/381978/1709587, where a user came to Meta to try to figure out if they were even allowed to ask a non-debugging question any more. Sadly, with Hot Meta Questions gone, such a post would likely never be seen these days, and the template will succeed in driving those users away. Such is the nature of the so-called "welcoming" drive.
    – Mark Amery
    Aug 3, 2019 at 11:12
-7

A lot of time, "software" == "(my) code". It might be better to rephrase the usage of "software" to "Application" or "App".

"I need a software recommendation" could be a user asking for an algorithm recommendation, or a recommendation for how to code something.

"I need help with software or hardware issue" could be a user asking for general code issues.

5
  • 2
    Neither of those are things that should be asked on Stack Overflow. We don't do recommendations on how to code something, and code issues should be as explicit and narrow as possible.
    – Makoto
    Dec 22, 2018 at 15:46
  • @Makoto I agree, but most people don't read the help docs which say what is acceptable. This is meant to direct people to better places. Ultimately, it's more user friendly and that is good Dec 22, 2018 at 15:51
  • 4
    I think anything that's asking for a "software recommendation" is unambiguously off-topic, and that the wording there is fine as it is. However, I agree that "I need help with a software ... issue" is kind of perversely worded. Every on-topic question ever asked on Stack Overflow can be construed as asking for "help with a software issue".
    – Mark Amery
    Dec 23, 2018 at 17:29
  • yes, these phrases ARE off-topic. That's not the purpose of my answer. This is saying, if SO uses those phrases, then please change the wording to remove ambiguities. Dec 24, 2018 at 1:24
  • These phrases will direct new users to where they should post. It's well known that new users don't read the FAQ. They should be able to discover the correct locations without wasting our time. These off-topic options provide that Dec 24, 2018 at 8:32
-7

Just tried it. Maybe I've got really lucky, but got the wizard on the very first account creation attempt.

I know this is still an experimentation phase, earlier than testing proper; but I've got the wizard on the very first question I attempted to ask, just seconds after I opened my account.

As the first impression for the site, I felt it was a bit daunting and constraining. I would give users the opportunity to ask at least a question or two on their own before being pushed into the wizard.

Let them prove they have problems asking a question before helping them so forcefully.

Obviously, as a relatively experienced user and a meta regular, I'm probably a pretty poor test subject, but I kept feeling that the wizard was trying to force me into a very narrow path which did not necessarily match the idea I had for my question.

This can obviously be an artifact of experience, and just evidence that the wizard is not a good tool for more savvy users; but getting it immediately was slightly jarring experience, and I felt that a completely new user would not necessarily understand where the wizard was trying to guide them.

Further, if shown to a user that has spent some time on the site (a user with an account with more than 4 years just posted to complain bitterly about it), a least some introduction to the why and the nature of the experiment could come in handy, so more experienced users, but that otherwise can trigger the Wizard, can have some idea about what's going on.

Of course, all of this could be rendered null by further design iterations, but I thought worth mentioning.

2
  • 12
    I disagree with letting users have a freeform experience for a question or two -- if the wizard is designed well, then it should be a positive experience for a first-time asker, or perhaps even a veteran asker. This is our opportunity to make one of those exceedingly-important 'first impressions' on a user and show them "hey, we have this feature called Stack Snippets", "hey you can upload images straight to Stack Overflow" "hey, here's how you format your code and prettify it". It's a guided tour of the question feature set. Let people roam free first and you will just get poorly-made Qs...
    – TylerH
    Dec 28, 2018 at 22:17
  • 1
    I think this issue could be dealt with by making the wizard an opt-in thing Dec 31, 2018 at 21:19
-13

What's the i18n plan for the Wizard? The effectiveness of this UX may vary a lot based on cultural differences and language ability.

For example, I'd be concerned about the phrase "homework problem" for users with very limited English proficiency. I'd suggest testing a phrase like "school or homework problem" that includes "school" because it's likely one of the first English words that kids learn.

For the same reason, it'd be worth running the Wizard through Google Translate for the top N languages worldwide to see if any of the translations don't convey the same meaning as the English version.

It might be worth running a few country-specific A/B tests to verify that A vs. B outcomes are similar across geographies. It seems reasonable to expect that some parts of the Wizard might work great in some cultures but not in others.

9
  • 14
    If people don't understand the captions in the wizard, is it then likely they understand the help center or are able to communicate with others?
    – BDL
    Dec 20, 2018 at 7:57
  • 2
    Part of testing of the interface components individually will involve tweaks like this, "homework problem" was the phrase that dominated feedback both about and by users that had bad experiences with these types of questions. The natural next phrase to test is "school class assignment" But, we may or may not have an AI engine that can predict if a question is an assignment with near pinpoint accuracy, so that particular part might be moot going forward (and a model for determining things and offering JIT guidance instead of UX prompts that might be unclear).
    – user50049
    Dec 20, 2018 at 13:55
  • 6
    If you're serious about foreign language support, you don't use Google Translate
    – TylerH
    Dec 20, 2018 at 23:51
  • @TimPost - Sounds right, thanks much for the note. The AI homework detection sounds promising and really cool if it works well. Dec 21, 2018 at 4:52
  • @TylerH - I meant that users on English SO might run GT to translate English SO to their own language, not that SO would use it for translation. Dec 21, 2018 at 4:54
  • 2
    @BDL - Users with very limited English skills are already asking lots of questions on English SO today, whether or not (often not) they understand the help center or communicate well with others. If we want to guide these users to ask better questions (or not to ask them at all, or to ask them on a local-language site, etc.), then it'd be smart to keep language and concepts as globally-accessible as possible. Dec 21, 2018 at 5:17
  • @JustinGrant Ah, see "it'd be worth running the Wizard through Google Translate for the top N languages worldwide to see if any of the translations don't convey the same meaning as the English version" sounds like you are suggesting SO do it to check consistency across languages.
    – TylerH
    Dec 21, 2018 at 15:06
  • 4
    Hah, this post got so many downvotes that I earned the Sun Wukong secret hat! meta.stackexchange.com/questions/319838/… "Write a post on a Meta site (MSE is considered a meta site too) that receives at least 5 up votes and 5 down votes." Dec 22, 2018 at 4:01
  • 1
    I want to upvote it for raising the topic of internationalisation, but want to downvote it for the paragraph about school or homework. Dec 31, 2018 at 21:15
-13

Give to new users the possibility to declare "I'm a beginner in this tech" using a checkbox. Then a small icon or system text indicating that would accompany the question.

They always write something like this and will never stop doing it (since this is important for them). But by providing them a GUI option you can get the cleaner question text without arguing.

11
  • 4
    Just to be clear, your proposal is to provide the checkbox but not do anything with it?
    – jscs
    Dec 20, 2018 at 23:04
  • 3
    @JoshCaswell We could make it trigger a new "Tech beginner" flag below their profile, like the "New contributor" one. (ew.)
    – jpmc26
    Dec 21, 2018 at 2:13
  • 1
    @jpmc26 I like the idea of a “Tech Beginner” flag. Possibly belongs in its own feature-request for all questions, not just on the wizard.
    – Eb946207
    Dec 22, 2018 at 20:36
  • 3
    @EthanK ...I was making an absolutely horrible joke. The "New contributor" flag is bad enough.
    – jpmc26
    Dec 22, 2018 at 20:42
  • 1
    @jomc26 I kind of like it, though. It would help me find which answers I should not answer and just give up on. I need a way to find out what questions are not noob ones and are good, unlike most “why doesn’t this work” questions on the [python] tag and others. The number of “I don’t understand” questions is too much! I need this feature!
    – Eb946207
    Dec 22, 2018 at 20:46
  • @EthanK I have proposed this only as realistic way to remove "I'm beginner " from the text... But your start commenting compleatly different aspects of SO/SE. So I feel need to tell you how ratings economics works. For 250 bounty you could order a highly complex research work. but you should get those 250 rating first. There you could start searching for simple (answerable but may be not very clear) questions that are simple and quick to guess. Of course you can use SO without understanding rating economics value - but have in minds that not only "perfect" questions have value there. ok? Dec 22, 2018 at 21:50
  • Why @jpmc26 is joking - "political" aspects are more important for his party. They call it meritocracy and feel need to underline that only "quality" is important on SO. You can read about it there: meta.stackoverflow.com/questions/366858/… Actually, weak quality questions have the value also if you are going to participate in ratings economics. Dec 22, 2018 at 22:14
  • 3
    @RomanPokrovskij That isn't very welcoming. =p Actually, you might wanna read here. Fundamentally, a huge part of the problem is that SO has rather explicitly ranked that mandate as less important than pleasing new users. This is ultimately not good for the site's long term health as a useful resource. Poorly presented questions are typically only particularly useful for the asker. They aren't likely to be clear enough for someone with a similar skill level to extract the info they need out of them.
    – jpmc26
    Dec 23, 2018 at 1:56
  • @jpmc26 - your party see only "pleasing new users" when smb improve and answer to a weak question. when my "rating economics party" see that this just a trade deal. You are interesting in closed meritocracy heaven for "people who solve problems", I'm interested in open and stable ratings/bounties economics. On many topics we have the same opinion (against 'opinion based' and etc.) but I'm only smiling when you are fighting with innocent "new contributor" label. Dec 23, 2018 at 9:59
  • 3
    @RomanPokrovskij: There's nothing stable about a ratings/bounties economy with no other moderation, because votes are not an economy. They don't involve transfer of value, the rep from upvotes is created out of thin air. So there's no incentive for people to spend their votes wisely.
    – Ben Voigt
    Dec 29, 2018 at 18:48
  • @BenVoigt first of all thank you that you accept to discuss moderation from ratings economics point of view. second, I agree that the moderation is required for stability of ratings economics. But my point is: that the idiology of "SO is meritocracy heaven" (e.g. hate of excuses "I'm new" and hate of appeals "close only after you can't edit") is contrpoductive for open rating economics. Dec 29, 2018 at 19:05
1
2

You must log in to answer this question.