The problem:
Currently, to ask a question, a user has to tick a button at the bottom of a page of text:
Nowhere am I told that Stack Overflow isn't a forum. At no point is it checked that I have read the page of text. There's no delay before I can tick it. I do not need to have opened any of the links on the page. My expectations are that this site will accept my question because it's about programming. How different can it be to other groups?
This causes new users to think that any question will be accepted here, and then they feel unwelcome because we rapidly downvote and close their post.
In comparison, if I want to join a closed Facebook group (with much lower quality standards) I am presented with the rules. I have to read these rules because - and here's the key step - I am quizzed on these rules. A text box pops up and says "Is XYZ allowed in our group?". This answer is manually checked by the Admins, and after that I can join.
The proposal
Stack Overflow obviously gets too many new users for each one to be manually approved. Instead, we should have an automated test. It looks like this:
This page has 5 questions from a list of 20+. They are randomly selected and ordered. Critically, they are all answered in the link to the help centre.
A user should read the link, and then tick the correct questions. A "Continue" button will appear. If the user got all 5 right, they are allowed to proceed to the Ask Question page.
If they get it wrong, they are told that they got them wrong, and then asked to re-read the help centre page, which is linked. The questions will also be re-generated, to help prevent guessing.
After 3 incorrect answers, the user is given a 5 minute cooldown, to force them to take the time to read the help centre page.
This continues until they get all 5 questions correct, and they are redirected to the Ask Question page.
Advantages
- Increase the probability that users will have read the linked help centre page.
- Decrease the number of off-topic / poorly presented questions which experienced users have to sort through - and hopefully the increase overall quality of Stack Overflow.
- Consequently, decrease the number of downvotes / close votes given to new users. This will make the website feel more welcoming.
- Clarify new users' expectations - even if they don't read the help centre page especially thoroughly, they know that we're a bit different - few sites have a 5 question quiz to join.
- This treats everyone the same. Women and minorities are not being singled out / treated differently by this page. Claims of discrimination should rapidly drop.
Disadvantages:
- This reduces the number of new users asking questions (and the total number of questions), which reduces views, user engagement, and ad-revenue.
- People will still leave thinking that Stack Overflow is "super elitist" (1 2 3 4 5) and "doesn't want to help anyone" because they have to do a quiz to get in.
- 3% of users will be able to get in by just guessing the answers to these questions. More questions would reduce this - 10 questions drops to 0.1% can guess.