๐ Welcome to June's installment of data science research updates for Meta! You can check out the most recent installment here, or last month's UX research update here.
This month, I'm cross-posting with our blog about recent work focused on a very common badge, the Tumbleweed badge. ๐๐พ
Tumbleweed and its impact
The Tumbleweed badge is awarded to questions with zero score, no answers, no comments, and low views for a week. It's an incredibly common badge, the 9th most common badge awarded over the past year.
Although this badge was originally intended to be somewhat humorous and as a consolation prize, we know that many users over the years have experienced earning this badge negatively. ๐ We can use data to explore what the impact of this badge is, compared to a similar interaction. Jon Ericson suggested that we compare a set of questions that were similar in that each caused their asker to receive exactly one interaction. We compared questions that got
- only an upvote
- only a comment
- only an answer
- only a downvote
- the Tumbleweed badge
How many questions did users ask after these single-interaction questions?
We don't see evidence that the Tumbleweed badge is an effective consolation prize, even compared to getting a downvote!
What can we learn about the questions that users ask after these interactions?
For users who do ask questions after these low-interaction questions of various kinds, those who earned the Tumbleweed badge don't fare differently from those who got an answer or comment. We don't see evidence that, as a population overall, the Tumbleweed earners ask particularly bad questions, just that they are less likely to ask again.
Why worry about all these Tumbleweeds rolling along?
So the Tumbleweed badge isn't helping, and it may be hurting. This is the opposite of what our incentive systems are intended to do, so we have decided to retire the Tumbleweed badge, starting today. We are also introducing two shiny new badges, focused on reversing the score of a negative question; read more about it in Jon's blog post.
Thanks so much for reading! ๐ What have been your experiences with badges on Stack Overflow? Has earning any particular badge stood out to you, either positively or negatively?