Welcome to February's installment of the regular, bite-size, data-focused updates I am sharing with Meta! You can check out previous posts if you like. We just wrapped up the fielding period for the 2019 Developer Survey, so for this month, I want to share one more analysis from 2018's data, before I buckle down with my teammates to the task of the new batch of survey responses.
In 2018, one of the questions we asked respondents was:
How would you describe the Stack Overflow community, as a whole?
You can see the most common words that respondents used to answer this question in the main analysis/report. Respondents said that the Stack Overflow community is helpful, good/great/the best, focused on questions and answers, and so on.
We have more information about the survey respondents who gave us these answers, though, so we can dig deeper into these kinds of opinions about the Stack Overflow community. For example, how do the words people use to describe Stack Overflow change with years of coding experience?
We can answer this question with the following modeling approach, similar to what I lay out in this blog post:
- Count words used by users of each experience level
- Model these word counts as a function of years of experience
- Find the words that change (either up or down) significantly, in the sense of p-value and effect size
These words are the ones that change the most with years of experience. They are not the most common for each level of experience (those are mostly the same as the most common overall) but instead are the ones that demonstrate a change in how they are used by less and more experienced developers.
The most experienced developers are more likely to see the Stack Overflow community as a group of focused geeks, and are more likely to use the word "diverse" to describe the community. I was curious what these users meant by that, so I looked at these responses in their entirety. It turns out these responses are addressing diversity of technical background, interest, and nationality.
Less experienced developers are more likely to talk about Stack Overflow as a community for learning.
- "best place to learn"
- "source to learn and share knowledge"
More experienced developers, by contrast, are more likely to frame their understanding of the Stack Overflow community in terms of a resource.
- "very effective and valuable resource"
- "an invaluable resource for any programmer"
Sometimes we as a community experience these understandings of site identity in tension, and we can see these differences in the very words our respondents use to describe who we are as a community.
It's unlikely we'll resolve these deep tensions in this single post, but what are your thoughts or reflections? Do you have topic ideas for future data science explorations?