Announcing our Content Discovery initiative. In this post, we will explain what the initiative is all about, why it’s being prioritized, our initial plans, and how Meta can help us in continuing to make Stack Overflow the destination for developers and technologists.
Background
In 2022, 82% of our traffic came from organic search. For the most part, these users visit one page and bounce, never exploring further or engaging with the community. Some are finding the information they wanted, and we certainly want them to find that content more easily. However, we think surfacing more related content to their problem and making it easier to discover content better serves users so that Stack Overflow can continue to be a destination for ongoing learning and exploration.
Site satisfaction surveys have made it clear that discovering helpful content is a pain point for many visitors to Stack Overflow. Out of the 21,595 responses to the survey year to date, only 11% of participants mentioned that discoverability was one of the most valuable aspects of Stack Overflow. However, when asked “What would you most like to improve about using Stack Overflow?”, discoverability ranked third in responses, indicating that it’s important to prioritize.
To explore how we can improve in that area, we are launching an initiative focused on Content Discovery. This will start with a series of experiments to help us understand how we might help users find content more easily. We believe improving this experience will help visitors get more out of Stack Overflow every time they visit. The learnings may also surface opportunities to address other pain points within the user journey and can lead to more users engaging and contributing in the community.
Content discovery is a broad topic and we have a lot of avenues that we can take toward the goals of providing a better holistic experience and guiding folks to the information they need to find. Historically, we have also heard from Meta about the pain points and frustrations with using the embedded site search to find information and rely heavily on Google to fulfill the need. From prior research, we know that users ping pong between Stack Overflow and searching on Google to further refine their query until they are able to find an answer. How might we be able to help make it easier to do so on the platform?
Why is this being prioritized?
This initiative builds on learnings from the Outdated Answers initiative, which focused on helping users find the most current and relevant information. The primary goal for this initiative is to make it easier for users to find content that addresses their needs. There are several product development teams at Stack Overflow and we have a dedicated team focused on improving the general experience for the millions of users who visit the site every month. This team kicked off the initiative with discovery and research workshops, as well as interviews with community members which focused on their motivations for using the platform and their specific needs when they’re here.
Here are our initial plans
We're structuring this initiative by focusing on experimentation on Stack Overflow and using insights from experimentation to deepen our understanding about behavioral patterns for content consumers. Since this will have a number of small trials over time, it's worth talking about how we want to organize discussion of this initiative. This post is announcing the broader initiative and there are some related questions at the end. We will use this post as an ongoing index of the individual experiments, which will serve to collate the history of the initiative.
Content discovery experimentation
Here you will find the list of experiments that are currently running and a history of past experiments:
Currently testing:
Pending tests:
Testing concluded:
- A/B testing moving Related Questions higher on question pages
- A/B testing the separation of The Overflow Blog from the Community Bulletin
- A/B testing related questions within the answers list
- A/B testing new "Most Asked in Topic" module for anonymous users.
Meta literature review
Here are some posts that we’ve found on Meta while doing our initial research through the lens of finding relevant content and contributing on the platform.
Discussion
We will continue to look at current user behavior and trends, but I also want to make sure we're opening the floor for brainstorming and discussion.
- When you land on a question page from Google, what is your thought process and behavior when you determine that you may need to explore a little more to find what you are looking for?
- Assuming you do find what you’re looking for, what makes it more likely that you will continue reading other content that’s related to your initial need?
- Conversely, when you are unsuccessful in finding something, what steps do you take next?
Learning more about common behaviors and patterns will help us determine where our focus should be in making it easier to find the relevant content for your needs.