We made a change quite a while ago to the homepage of Stack Overflow which was well-intentioned, but I'm starting to think may have been a mistake.
The change was to switch Stack Overflow away from showing all recent activity to showing a slice of recent activity. So far so good: there's too much stuff happening to show it all (the homepage of the site was spanning all of about 3 minutes at the time), so each user gets their own personalized slice. It emphasizes your tags, so you see more of the stuff you like.
However, as part of the same change we decided to emphasize unanswered questions. You can read the exact algorithm in the original post but the upshot is this: good, answered questions fall off the homepage really fast, if they ever show up at all.
I decided to do some informal comparisons of other sites that still use the old algorithm. Mostly I don't have any activity on those sites, so I'm seeing what a new or anonymous user would see:
Stack Overflow (logged in) 81% 0 score or 0 answers 19% upvoted & answered
Stack Overflow (logged out) 91% 9%
Super User 65% 35%
Server Fault 69% 31%
Ask Ubuntu 65% 35%
Mathematics 58% 42%
Gaming 31% 69%
Significantly, on every one of those other sites I usually saw at least 3 or 4 highly upvoted & viewed posts, and on Stack Overflow rarely saw even 1. Here's a comparison of the top 10 questions on the logged-out Ask Ubuntu homepage vs. Stack Overflow. Ask Ubuntu has 4 top questions in the list, SO has 0 (click for bigger version):
The other sites use a simple algorithm: show the most recently touched stuff. It ends up working out like this:
- Crappy questions get one pass through the homepage and fall off fairly quickly
- Good questions get multiple passes through the homepage, bumping back up every time they're edited or answered
The end result is that Stack Overflow is highlighting the junk instead of the good posts. It's doing it for a good reason, to try to get these questions answered, but it creates:
- A "broken window" effect where all new users see on SO are crappy questions, which seems to justify their crappy question.
- A reinforcement cycle, where poor questions get more time on the homepage because they aren't getting answered
- An overall impression that Stack Overflow is drowning in junk.
Now, to be clear, Stack Overflow quality is slowly declining as the site gets bigger. The answer rate has dropped to 77% now. But Ask Ubuntu's answer rate is an even worse 67% and you'd still come away from its homepage with an idea of why the site is good.
So here's my proposal:
- By default, show a mix of hot & unanswered questions on the homepage, more in line with other sites (35% / 65% or so).
- Add quick filter options to narrow down to just unanswered or just hot, for people looking only for one or the other.
- In line with my other proposal, give some extra filter options for power users to control what they see.
Something like this (WARNING: UNPOLISHED MOCKUP AHEAD):
At first, this'd just be an alternative to the "interesting" tab, but when it's ready it'd replace it as the homepage.
Obviously this doesn't really solve the quality problems, but it'd at least be a start towards highlighting the better content while at the same time making it even easier to find something to answer. It's one small step, with many more to come.