It's unclear to me (and to many others, it seems) what you actually want from SO—and SE. What are the goals of this or any other change?
Activity as a KPI
Higher activity numbers can be valuable, particularly if the company is resting on the laurels of that number as a KPI—but I'm going to sincerely question what KPIs you're going after and why. Is activity a primary KPI—and if so, why?
SO has always been marketed as a place that's at a nexus point between Wikipedia and traditional forums (or Reddit, now). Philippe is uniquely placed to understand how KPIs differ between those two platforms, so what is the goal for SO and what KPIs are you considering from each of the two and why?
Chasing activity numbers is important on sites that are highly needing activity as the primary value add. Reddit, Twitter, Facebook, etc... but, while I'm guessing Wikipedia does look at activity, I don't think it's as important as quality and completeness of the content. For most people, Wikipedia is a static resource they consume; only so many people are going to be active.
Now, activity on SO is still more important than it is on Wikipedia because people ask questions here every day so it's necessary to have experts and curators who can review the new questions and either answer them or point the asker at an existing question that solves their problem.
Both of these are things that need significant focus. The percentage of new questions that get closed on SO is highly concerning. That's frustrating to both the askers and the curators/answerers—now, you've been working on search and improving the question asking workflow, which is good, provided the goal is preventing questions that shouldn't be asked in the first place (low-quality duplicates, off topic) while ensuring novel questions are complete enough to be answered. Bonus points if off topic questions are pointed to SE sites where they do fit.
Voting as the key activity metric
Voting is absolutely the simplest entry point for any user on the Internet, so it's understandably tempting to start there. Whether you call it voting, liking, starring—whatever—people understand it. This is a simplification because, as SE users will remind you, voting here means something more than just "I like this". Voting is the core way of indicating quality of content on the site, but it's also the way we reward users for that content—i.e. reputation—or prevent them from creating more—a.k.a. question bans.
Right now, voting is the bottom floor of a house of cards and a lot of the concerns you're hearing from users stem from fears of bringing down the entire structure. I'd argue that you'd be better served to address the upper levels before touching voting.
Everything builds upon voting. Having content upvoted gets you reputation, which gets you privileges and access, not only on the site you're using, but on the entire network. This means there's tons of incentive to cheat. The converse is also true. Having content downvoted can cause you to lose privileges and access, along with allowing your content to be deleted. Those bans being practically permanent also leads to people wanting to cheat.
This is the crux of things. Voting is too tangled up in all of this to be opened up now.
- Privileges and access (at least some of them) need to be awarded based on merit and need rather than by reputation.
- Methods for content and user moderation that don't rely on post score alone (or at all) should be investigated.
- Content quality indications (positive and negative) must exist, but they should be clearly defined and meaningful.
- Effort should be made to investigate how quality indicators can be separated from "I like this" or "I support you" responses.
- Understand reasons for socking and make it less attractive while also ensuring it's more easily found and managed.
- For example, if people are socking to earn the privilege of commenting, give them reputation-free ways to earn the privilege that ensure initial comments are being used appropriately.
Once you've done these things, you've likely addressed most of the upper layers of the card stack and you can safely change this privilege, too—or you may no longer need to.
It's easy enough to say you need to chase activity numbers because people are leaving SO in favor of AI bots which, despite their issues, are nicer or people can get answers faster. But the issues with reduction in site activity far predate AI, so looking to boost activity can not address what I consider the deeper core issue on Stack Overflow—issues with content discoverability and quality on an aging platform.
Content Quality as a KPI
When it comes to content quality, the elephant in the room is that there's so much content, it'd be practically impossible to determine whether it's useful or not. Much of the content is rarely or never accessed and, after 15 years, there's not as many people around to review and ensure the content is still good.
Step 1—Take out the trash.
SO has 24 million questions, based on the all sites page—that's a lot. How can we ensure those 24 million questions are all actually useful and not clogging up search results?
There's at least 1 million zero-score questions that have no answers but haven't been roombaed because they have 2 or more comments. That's nearly 5% of the site's content. No one is going to use or review those. Just delete them. These questions could be confusing people, making the site look like a ghost town. Shog, Robert and I wrote a document about this in 2019, including plans for how to ensure there weren't any diamonds in the trash, but I am doubtful there's much there worth saving.
Step 2—Review and reward curation of old content
The first part here is a continuation of Step 1—so much of the existing content is truly repetitive. So, further reduce the 24 million by finding ways make it easier to identify and address duplicate content.
This might actually be a great opportunity to use AI... (correct me if that's wrong). Start a project looking through existing questions/answers to find potential duplicates and put them in a queue for review. Then let reviewers recommend closing, merging, or deleting those questions. Yes, I said merging. Stop limiting merges to moderators and give well-trained curators access to merges.
Also have a queue for ambiguously-scored content >1 year old that was previously nominated for closure, but aged out and that hasn't been caught up by roomba for some reason. Close/delete/merge as appropriate.
Once we've reduced the overall question count, we need to start working on actual curation. There have been efforts in the past to address issues of outdated content, which lead to the "Trending" sort and investigations into answer labelling that would allow the community to classify answers by the version of software it relates to, among other things. The Teams Team also spends a lot of time investigating content curation and freshness for Teams—which are only 6 years old. Imagine the backlog on SO after 15 years!
Unfortunately, very little has come of this work due to the complexity and changing priorities. How can we draw attention to older content to ensure it's good and reward users for updating or adding more up-to-date solutions?
We also need to understand how trustworthy current indications of answer quality are. These indicators need to be cognizant of time passing and technology changing so we can ensure search results are going to actually point people at solutions that work.
Some random thoughts on content quality and "the way we do things here":
- How can we encourage and simplify review of older questions with 10+ answers to ensure that all of the answers are unique and useful?
- At some point, does it make sense to compile many answers into one summary answer or create a table of contents that help users identify which answer might be better-suited to their needs.
- How can we ensure community consensus on what duplicate questions are and when to close?
- Is it still good or useful to retain "wrong" answers. For a platform so focused on reducing noise, retaining the wrong stuff seems confusing to me.
Rewarding activity here is core—both the curators and the original content creators need recognition and reward. Should that reward be reputation? I don't know—what else could it be? If reputation doesn't give privileges, does it matter? Maybe there are other rewards people would be incentivised by.
In addition to the above, if you're looking for stuff to focus on, I'd offer a few suggestions:
- Look at all of the privileges and find ones with barriers that prevent users from stepping into curation because they don't want to post questions and answers. Particularly ones that already have some checks-and-balances in place. Hints:
- The suggested edits queue is huge, so clearly people want to suggest edits. Some of them are actually good at it. Consider granting full edit privileges based on a quantity of successful suggested edits, such as 20 suggestions, of which 80% are accepted or improved.
- The close queue is overburdened, with around half of reviews aging out (as of last check). Find ways to identify people who are good at identifying close-worthy questions and give them full access to close reviewing. See also Should trusted close/reopen voters and reviewers have their votes weighted more than others'?.
- Education is so important. I know Philippe wants better onboarding. Work on that.
- E.g. Don't just give people access to votes (with no apparent training). When there's clearer onboarding, there's potentially less risk for abuse. People clearly don't understand how SO is intended to work. While that's never going to be perfect, do better—teach them how SO is different than Reddit and other forums.
- Create a primer to voting and let people take it and give them some votes.
- Change the voting button text—make it customizable per-site.
- Update the close reason copy—please! This project was 90% of the way. Just get something better there for voters, post owners and visitors so that the close reasons and notices are informative and clear.
I don't have a newsletter, but I hope y'all find this helpful.