As you may know, Stack Overflow has a penalty in a formula that determines whether to allow a post to go into HNQ or not:
Limited (by hotness score)
These sites can still contribute the same number of questions to Hot Network Questions, but their questions need higher hotness score to be selected.
Heavily (80% penalty factor)
80% penalty factor means that arbitrary hotness points for any question on Stack Overflow is 5x less than that of a question with similar activity from a non-penalized site.
Is it worth it?
How about reducing the penalty? (I'm not saying to remove it altogether, I'm suggesting to reduce it)
Times has changed and activity on Stack Overflow is arguably not that impressive that is used to be: questions generally do not attract really many votes, which apparently may lead to a few questions from Stack Overflow to be present in the list. I mean, check this, among 100 listed questions there're no posts from Stack Overflow at this time at all.
If I did not convince you... consider an outcome of following Data Explorer query (this one includes data from Jan 2022 to today, that's around 13.5 months):
Note: the linked query may look terrible but it serves its function at least, I have no idea how to properly compose these frikin TSQL queries, vastly different from MySQL that I'm used to
Note 2: I have no idea why Numbers use spaces as thousands separators and found no setting to tweak it
Let's then check out the formula to understand what does 80% penalty do:
(MIN(AnswerCount, 10) * QScore) / 5 + AnswerScore
-------------------------------------------------
(QAgeInHours + 1) ^ 1.4
If we make some simplifications, it would mean that Stack Overflow has a same chance to reach hot network questions with a post of 50+ score as any other site has the chance to reach the HNQ with a post of 10+ score (50 - 80% penalty = 10).
Meanwhile, how many questions with a score of 50+ has Stack Overflow got during 2022? The answer is 134 according to Data Explorer, which puts Stack Overflow on 27th place in the table I've shown above. No wonder we see the posts from Stack Overflow so rarely in HNQ!
Of course this assumption is rough, we can see that the formula does prioritize answers, the general point remains; one could build a query to compare answer scores, I still doubt 27th-place-figure changes significantly, my point was to lessen the penalty and not remove it altogether
You see, Stack Overflow generated 1800 questions with a score >= 10, which may sound like a solid first place, until you consider that:
- it's outrageously small compared to the total number of questions posted
- 73% of all questions on Stack Exchange network during 2022 were asked on Stack Overflow. However, out of all questions with a score >= 10 only 16% of questions were asked on Stack Overflow during the same time.
- as I said hotness score for Stack Overflow is divided by 5, and according to formula that would put Stack Overflow onto a 27th place in a table shown above:
For 2022 I have also checked stats but for posts with score >= 20, the results are almost the same so not including them
We can also see how these numbers changed throughout the years, but I believe here an impact from search engines is starting to outweight scores accumulated due to inner traffic. Probably activity also dropped, but I doubt that by such a large margin.
Year | Total questions | Score >= 10 | Stack Overflow share | SO score >= 10 share |
---|---|---|---|---|
2022 | 2,242,510 | 13,287 | 1,641,895 (73%) | 2,133 (16%) |
2021 | 2,203,458 | 21,573 | 1,552,201 (70%) | 6,667 (31%) |
2020 | 2,664,455 | 33,992 | 1,869,505 (70%) | 14,492 (42%) |
2019 | 2,578,082 | 50,531 | 1,765,594 (68%) | 24,271 (48%) |
2018 | 2,739,531 | 70,383 | 1,887,749 (69%) | 38,042 (54%) |
2017 | 3,020,634 | 92,953 | 2,115,000 (70%) | 51,399 (55%) |
2016 | 3,093,226 | 111,236 | 2,199,648 (71%) | 61,620 (55%) |
Check out the query that generates this (year-by-year) (especially revisions)
Having said that I further emphasize on the fact that Stack Overflow may not generate such a lot of high-score content that it is expected or was expected when the penalty was introduced.
Why am I proposing the change?
I believe that such a big penalty as 80% defeats the whole purpose of Hot Network Questions. One may argue that HNQ is useless, however I think not: it is specifically designed to drive attention to worthy posts. Considering there’s a lot of questions on Stack Overflow, it’s somewhat easy for a good question to “drown” among mediocre ones.
Bottom line:
Can we probably revisit the penalty value applied to the hotness score in a way of reducing it? It looks like Stack Overflow does not generate so much high-quality content that it would justify 80% penalty today.
oh yeah not so bottom line, p.s. incoming in 3...2...1...
P.S.: this also may relate to the other couple of penalized sites, however I do not expect this post to generate any feedback elsewhere, so I'm posting it here.
P.P.S. interesting over-the-years data actually, something to think of...
P.P.P.S. while writing this post and collecting data I'm now even more interested how is that possible that score>10 stats are so different for the past years (yeah search engines and all of that but that different?)