Update
The Downvotes survey was turned off Nov 12. It ran for four weeks and produced 1,455 responses. View the results
Original post
Starting tomorrow, we are launching a survey to gain insight into why users downvote questions and answers on Stack Overflow. When you click the downvote button, you may see an invitation to take the four-question survey.
Please note, we are not seeking feedback on the survey methodology or questions. We already asked moderators for their thoughts, and we incorporated some of their feedback. The purpose of this post is to give you a heads up on what we are doing and why.
Why are we researching downvotes?
That's a question that some of you posed when we mentioned this research in our Q3 Roadmap blog post.
Here's the answer.
In our ongoing Site Satisfaction Survey, voting is consistently one of the top 10 things that users find most frustrating or unappealing about using Stack Overflow. Many users report feeling confused and discouraged when their posts are downvoted.
What's more, they often don't understand why they are getting downvoted, and they often don't get guidance on what they can do to improve their posts.
On the other hand, downvoting is one of the primary mechanisms we use to protect our site quality. So we want to categorize the reasons why users downvote and see which categories are most likely to drive the decision. We also want to understand whether users tend to take additional actions after they downvote, such as commenting, editing, or voting to close.
In the long term, we want to strike a better balance between ensuring site quality and providing a constructive, inclusive experience for all. We will use the qualitative data from this survey as a starting point for exploring how to improve the downvote experience and potentially provide more constructive feedback for post authors. There is no development planned at this stage.
How will we conduct the survey?
A random sample of users who click the downvote button will see the survey invitation. We will start the sampling at 10%, but may increase it depending on the response rate. Our goal is to collect at least 500 completed surveys. Based on the projected volume of downvotes and survey completions, we estimate that it may take four months to hit this target.
To prevent users from being bombarded with survey invitations, we will exclude users who have received an invitation to take the Site Satisfaction Survey within the last 90 days, those who previously dismissed the Downvote Survey invitation, and those who previously clicked through to the survey.
After we've analyzed the survey results, we'll report back to you with our findings.
Here are the questions we're asking
Why did you choose to downvote this last post? Select all that apply.
The question or answer was unclear or unuseful
The post-author should make an edit
The post was obviously spam (unsolicited advertisement)
The post did not demonstrate that sufficient research or sufficient effort was put in by the post-author
Other (please describe): [text box]
In addition to your downvote, what other actions did you or will you take on this post? Select all that apply.
I only downvoted
I left a comment
I made/suggested an edit
I voted to close
I voted to delete
I upvoted an existing comment
I flagged the post
I followed the post
Other (please describe): [text box]
Who do you think your downvote helps to inform?
The post-author
Other users
Both the post-author and other users
Neither the post-author nor other users
(Optional) Please elaborate on your answer to the previous question (whether you think your downvote helped inform the post-author and other users): [text box]
Let me introduce myself đź‘‹
In case you are wondering: "Who is the person writing this?" I am a product manager who joined the Public Platform team in September. This team has gone by many names over the last few years, but we are the team that directly works on improving and maintaining our Q&A sites.
I have been a Stack Overflow employee for nearly four years and have held a variety of roles, including leading the team that produces our annual Developer Survey.
I have admiration and respect for all of the experts and dedicated volunteers who make our sites an invaluable resource, so let me officially say thank you. I am excited to build things that make it easier for you to curate our sites and easier for developers of all skill levels to get the answers they need.