What about self-classification?
Wait, wait, I'm not talking about a beginner checkbox, specifying difficulty, or anything like that.
Much less "let's spend a few months tweaking an automatic filter" and much more "let's make some changes and roll them out", and automatic filters will likely either have too many false positive, or too many false negatives, regardless of how much time is spent on them.
(This is an attempt at a more manual process - while I have something more idealistic in mind, I doubt it will work well / get accepted by the community. Feel free to suggest your own more manual process)
- Give users a "What have you tried" textbox when asking a question.
Make sure to indicate that this is optional.
Make sure that we specify that this is for concrete evidence - something as vague as "I looked around and couldn't find an answer" should not be tolerated.
This could come with a couple of other advantages:
Users will be more inclined to show what they've tried. This is useful, if for no other reason than to put a few of us at ease to help.
Separation of what you've tried and the actual question. This tends to make for a way more useful question.
What's written here could just be appended to your question (separated by a line?).
If this text box is empty, it will automatically get classified as low quality.
- Make users pick what type of question they're asking.
Pretty straight-forward, and so are the advantages.
Even though some may argue that there may be acceptable "why doesn't my code work" questionssome may argue that there may be acceptable "why doesn't my code work" questions, I argue that all of them are low quality (I hope I'm not alone here) - if so, this allows us to at least classify some questions as low quality based purely on what it's about.
Low quality:
- "Why doesn't my code work" question.
- ???
High quality:
- (Some stuff - we'll figure it out)
Perhaps straight into "Low Quality" review queue, since it's probably off topic:
- "Something not listed here."
In order to prevent users from just figuring this out and classify incorrectly to prevent getting classified as low quality, **incorrect classification should be treated as
- Some automatic rules.
Any of the following can classify a question as low quality:
- A few downvotes (and no or few upvotes).
- A history of low quality posts by the user.
- The title - we have word-based filters for titles, which plenty of people agree are a horrible idea - why not just classify these as low quality instead? How many people do we think have actually changed their (planned) question significantly after just being prevented from using some title?
- ...