A long overdue update to our last prototype announcement, our developers are pleased to announce that they've finished the review process and responsive design updates to the Wizard and it is now in testing.
First, some screenshots!!!
What does this mean for most of you?
For most people reading this, probably nothing. If you arrive to the site incognito and create a new account, you have approximately a 50/50 shot of seeing the new interface as you ask your first couple of questions, or perhaps first really great question, whichever happens to come first. We're going to be varying the criteria that sends folks 'off to see the wizard' during the experiment to determine what the optimal settings look like.
How long will this be in testing?
Quite some time. We can measure success and failure a number of different ways, ranging from how well questions 'land' after a few days of being asked, how fast they get answered, user interviews and even an uptick in abandoned questions might indicate healthy patterns as the wizard encourages you to think procedurally through your problem.
However, it's way more structured than what we have, which can be a daunting if not overwhelming empty text box to someone that doesn't really know what's supposed to go there, so we're going to have to work to separate improvements based on the introduction of structure alone from improvements coming from individual elements of the wizard itself, and that's going to take some time. It is, as I said, a rather large change.
Where should feedback go for this?
Here on Meta Stack Overflow is fine. Note that, as we iterate, circumstances are likely to be ephemeral so don't put too much time into things; a screen shot with a short paragraph or some free-hand circles is really helpful and (hopefully) won't result in grief if your feedback is just quickly culled with lots of other stuff because a change obviated it.
What else do you need users to do?
Nothing. Hopefully, enjoy a larger bounty of questions that are more representative of what folks are capable of writing if you give them some structure and guidelines. When you see folks propose improvements, remember that the needs they describe represent a perspective we really need to learn in order to help them more, so please see usefulness in their perspectives which show us how they're actually acclimating to what we build, not just how useful you might find their suggestions.
What's the criteria for the test group?
It's going to fluctuate. I can pretty confidently say that if you have enough rep to not see ads, you'll be extremely unlikely to see the wizard while it's in testing. It'll almost always be some combination of:
- Account rep
- Question history
- Whether you've triggered a rolling rate limit
... and many other things. We'll probably start off with rep and work from there, but know it's bound to change. Someone can ask one question and hit the jackpot, get 300 rep out of it, then belly flop. While we're discussing this as one big experiment, it's probably going to be multiple experiments that run for 3 - 4 days each, some even concurrently.
We'll know fairly soon if we're going to graduate the experiment and will update this post at that time, then likely continue to run more experiments just to tweak the structure and interface.
I think the Earth is flat!
I think getting a spaceship and going up to check it out just so we can be, you know, sure is a great idea. But if you have a question or comment about anything in this post, please leave an answer below. If it looks like your feedback is turning into something that should probably become a new question altogether (or maybe an outright bug), we'll let you know in comments.