A sort of running summary on key take-aways from this:
###One template doesn't fit all
One template doesn't fit all
We're off to see the Wizard. Well, something Wizard-y. Trying to predict intent while someone asks a question programmatically is simply way too error prone, so we'd do better giving new users the opportunity to use a guided interface (and strongly suggest it). Something like (e.g.)
- I need help debugging a problem
- I'm stuck on how to accomplish something
- I don't understand how a library or tool works
- ...
- ...
- Your question is probably off-topic (think of something that would actually deter people from asking instead of just ignoring the message, like turtles, or something)
... something like that. We'd have to really work on the copy here so we're much more likely than not to present the user with a clear choice, and the menu selection needs to be really short (like no more than 5 things).
Then, we load a template from it, break out text inputs instead of using commented prompts, and then concatenate everything as the final question (with a preview perhaps). Whew! That's a lot and we need to take baby steps here, or we might end up realizing it broke some time ago but not really be able to tell when.
###Titles are still hard
Titles are still hard
So, good questions do get folks off to a better start (as in they don't have a horrible experience because their stuff got closed or down-voted), but we need to help them attract the right folks to give answers, too!
I firmly believe that we need a title-strength-o-meter similar to those password strength meters. Measure common words, words that are tags too often appearing, capitalization, punctuation, length, presence of verbs, etc. We also need to tell folks this is your chance to get the Jon Skeet of COBOL to actually read your question, she's only going to see the title in the tag feed she reads to find things to answer.
Will update this as a scratch pad of sorts of things to keep in mind as we go with this. Due to even trivial changes needing a few days to test, things are going to go a little slow, but they are moving and the results do look promising.
Feel free to add to this!