My name is Jane and I have been working at Stack Overflow for almost six months. I started out as an apprentice last year and now I've graduated to developer. I was the lead dev on this project.
One of the most vexing problems with Stack Overflow getting old is that our repeated question problem is getting worse. It's frustrating for question curators and answerers and also for people new to the site. One of the common worries we hear is accidentally asking a question that is already answered on the site. The hypothesis of this experiment is that the way we currently display possible duplicate questions isn't helping as much as it could:
This is the title search. There is also a right sidebar box that sometimes loads based on what the asker enters in the body textbox. Since the title of a question isn't usually enough to go on and since the numbers can be confusing, we're going to try out a new display:
For half of users (randomly assigned) this box will appear between the body and the tags after the user starts typing a title. As they fill in the body, the list of questions will be regenerated from time to time based on that new data. There is no sidebar box to be ignored or confused by. (Ironically, the sidebar often duplicated potential duplicate questions.) Taking a page from the ask wizard, the new display is more prominently placed which increases the odds askers will see it. Clicking on a question opens a new tab so that the asker can evaluate it without risking losing their work.
Normally we wouldn't pre-announce an A/B experiment, but in this case the change is visible enough we're certain to get people asking about it anyway. The primary metric we are looking at is click-through rate on similar questions. But we also are monitoring:
- Question volume
- The volume and % of duplicate questions (closed within three days of creation)
- Question grades
- Whether users scroll through the list of similar questions
A small decrease in question volume is to be expected if users really are finding answers in the similar questions list.
As usual, please use the answers below for bugs, concerns, and suggestions.