👋Hello! This is our second installment of UX research updates for Meta. You can check out the first installment here.
This month, I’ll talk about findings from user research we did last year about how users with lower reputation perceive and use reputation and privileges.
Research background
This research was motivated by earlier qualitative research that found many users consider the reputation system to be a barrier to participation. In order to participate “in a more quiet way, like upvoting answers,” users need to get reputation. But in order to do so, they need to participate in more visible but daunting ways, like asking and answering questions. As one user stated:
“I feel like I joined Stack Overflow too late. I feel stuck at the bottom because I have almost no reputation and can’t do much.”
The goal of this research was to get broader insight into lower reputation users’ interactions with reputation, specifically:
- What do people with lower reputation know about reputation and privileges?
- How, if at all, are they motivated by this system?
We conducted 1:1 user interviews with recently active Stack Overflow users with <=100 reputation, sourced from our research email list. Out of respect for people’s privacy, any quotes I’ve included here have been paraphrased.
Also, note that we consider users of all reputation levels to be important parts of the Stack Overflow ecosystem, and this research doesn’t seek to invalidate the broad range of experiences that users have with reputation. Rather, it seeks to gain more insight into a large but less visible segment of users and their experiences with the reputation and privileges system.
What do people with lower reputation know about reputation and privileges?
Users vaguely understood how the reputation system works (“If your answer is good, you get more points”). Most were unsure of what privileges they currently had or how to unlock the next privilege.
“I tried to comment and it told me I couldn’t. If I could comment, I would say things like ‘I did this and it worked.’ It’s a contribution, but it’s not different enough to be an answer.”
Most participants didn’t know they could earn reputation by editing other people’s questions and answers. When they learned about this option, they were averse to the idea of editing other people’s content.
“Editing another person’s question without them knowing would be weird. How I see someone’s question isn’t the way that they see their question.”
How, if at all, are they motivated by this system?
Participants were uninterested in earning reputation as part of the “game”.
“The idea of helping others is good in itself. I don’t need privileges to answer questions or to get more rep.”
“More relevant questions [to answer] would incentivize me. I’m not motivated by points.”
Participants primarily expressed interest in earning privileges about core Q&A (eg. voting, commenting) that would make their existing tasks easier. They were either uninterested or unaware of privileges that would introduce new interactions to their experience, such as the community wiki, chat, or moderation.
“Privileges allow you to do things you’re already doing more easily… for me to want privileges, it would have to ease my interaction… and save time.”
“The only ones I really cared about were basic things like comment on answers (to be able to join in on discussion).”
Next Steps
✌️Thanks for reading! This research was exploratory and is one of the inputs used when determining our product strategy. If you’d like to participate in future user research sessions, you can join the research email list via your email settings.
If there’s any research insights you’re interested in seeing, let me know in the comments! In the meantime, what have been your experiences with reputation and privileges, and what motivates you to participate in Stack Overflow? How, if at all, have these things changed if you’ve gained reputation over time?