Skip to main content
edited tags
Link
Machavity Mod
  • 31.6k
  • 38
  • 283
  • 382
Became Hot Meta Post
edited tags
Link
Machavity Mod
  • 31.6k
  • 38
  • 283
  • 382
Source Link

Downvotes Survey results

Last fall, we conducted a survey on why users downvote on Stack Overflow. It ran for four weeks and produced 1,455 responses. Here is what we learned.

  • Improving content quality and reducing noise are the two main motivators for users who downvote.

  • Most users downvote because the author didn’t demonstrate enough research or because the post was unclear/unhelpful.

  • On questions, users tend to downvote to inform the author. On answers, they downvote to inform other users.

  • More experienced users are more likely to leave a comment/upvote a comment or vote to close a post along with their downvote.

Who took the survey

We randomly sampled 10% of users who clicked the downvote icon on a question or answer. When they clicked to downvote, they saw a call-to-action to take the survey. More downvotes came from answers (57.2%) than questions (42.8%).

Downvoting is a privilege reserved for registered users of Stack Overflow who have a reputation of at least 125. Almost 90% of the respondents were registered users, and 56.5% actually had the downvote privilege. (Anonymous and lower-reputation users can click the downvote icon, but their votes don't affect the score.)

Reputation Percent of respondents
0-9 10.9%
10-49 13.7%
50-124 12.2%
125-1999 29.8%
2000+ 33.3%

Survey results

Why did you choose to downvote this last post? Select all that apply.

Option Percent
The post did not demonstrate that sufficient research or sufficient effort was put in by the post-author 46.94%
The question or answer was unclear or unuseful 42.54%
Other 30.17%
The post-author should make an edit 14.78%
The post was obviously spam (unsolicited advertisement) 3.44%

Half of the registered respondents chose “The post did not demonstrate that sufficient research or sufficient effort was put in by the post-author,” compared to ~35% of anonymous users. This makes sense since registered users are more likely to be familiar with the norms of Stack Overflow and the level of detail required for a question to be useful.

There were differences in downvoting behavior between questions and answers.

For questions:

  • Users wanted to improve question quality and reduce noise.

  • Off-topic questions, homework/free-coding requests and questions with a lack of detail were the most likely to receive downvotes.

  • ~70% of the respondents chose to downvote questions because the post did not demonstrate enough research or effort by the author.

  • A higher percentage of respondents also said that authors should edit questions vs. answers.

For answers:

  • Users wanted to reduce noise — especially when there were other qualified answers —  to help other users who were seeking the correct answer.

  • Answers that contained incorrect information, low quality info or off-topic material were the most likely to receive downvotes.

In addition to your downvote, what other actions did you or will you take on this post? Select all that apply.

Option Percent
I only downvoted 54.66%
I left a comment 22.49%
I upvoted an existing comment 13.91%
I voted to close 12.57%
Other 7.47%
I flagged the post 5.62%
I made/suggested an edit 5.55%
I voted to delete 5.55%
I followed the post 2.74%

70% of anonymous users noted that they “only downvoted.” This makes sense, as anonymous users do not have any of the listed privileges.

For registered users, almost 25% of respondents said that they left or would leave a comment, which is consistent with normal observed behavior on the site. The response with the next highest rate for registered users was “I upvoted an existing comment.” This suggests that in the context of downvoting, comments are primarily used as a way to provide feedback for the original poster.

When splitting by rep level, 27.5% of 2000+ rep users said that they would vote to close the question. Closing questions is a privilege that is earned at 3000 rep, so most respondents didn't have this ability.

Who do you think your downvote helps to inform?

Option Percent
Both the post-author and other users 55.61%
Other users 25.83%
The post-author 15.76%
Neither the post-author nor other users 2.80%

Registered users (>50%) were more likely to select that the downvote is for both the post-author and other users, whereas anonymous users were more likely to say that the downvote was only to help inform other users.

For downvotes on questions, respondents were more likely to note that the downvote was to help inform the post-author. For answers, the respondents were more likely to say that the downvote was for other users. This implies that for questions, the downvote was to give feedback to the original poster that there was an issue with the question, whereas for answers, it is to warn other users that there is an issue with the answer and it needs more scrutiny.

Next steps: how we'll use this data

We are in early discovery on a project to improve new user onboarding (stay tuned for a Meta post). We've identified a subset of users that we call "strugglers." These users actively participate on Stack Overflow, but experience negative outcomes from their actions, such as being downvoted often and frequently having their questions closed.

Our goal is to help these new users better understand the rules and norms of Stack Overflow so that they can participate successfully on the platform. The insights gained from this downvotes survey will help influence our approach to user onboarding.