"Design Lessons from the Fastest Q&A Site in the West", a 2011 study of Stack Overflow, suggested several measures of Q&A success:
- Number of active users,
- Percent of questions answered,
- Speed of answers, and
- Question views.
Here is the current Stack Overflow baseline for some of these measures:
Tag/Site questions views score closed answers accepted answer TTA
median avg % avg avg % *
------------------- ----- ----- ----- ------ ------- -------- ------ ---
Stack Overflow 8032148 248 1.6 4.5 1.7 57.5 88.4 24
TTA
stands for time to answer and represents the median time from asking to the first answer of open and non-negatively-scored questions since Jan. 1, 2014. All other statistics are for all time. Below are matched pairs of tags and sites. I extracted the numbers from public data so you can add your own site or tag to the list. Tag are listed first in [lowercase] and sites are Capitalized.
[blender] 843 238 1 4.4 1.1 45.3 77.3 601
Blender.SE 4496 139 3.3 10.7 1.3 57.3 86.7 101
[drupal] 14676 346 0.9 2.8 1.5 53 90 118
Drupal.SE 42867 175 1.1 4.2 1.3 46.6 81.7 74
[joomla] 11112 258 0.4 4 1.4 45.3 86.2 115
Joomla.SE 806 54 2 2.9 1.7 58.7 94.7 104
[latex] 3437 658 4.4 8.9 1.9 63.4 89 52
TeX/LaTeX.SE 71579 266 5.5 11.5 1.4 63.5 86.8 54
[magento] 25961 369 0.8 2.3 1.3 44 82.4 110
Magento.SE 12131 90 0.7 5.7 1.2 43 82.3 55
[tridion] 1144 222 3.5 3.9 1.9 69.5 98.4 44
Tridion.SE 2386 98 4.6 2 1.7 52.2 96 71
[wolfram-mathematica] 2993 360 4 2.2 1.9 66.7 92.5 51
Mathematica.SE 17724 186 4.8 10.5 1.6 57.7 86.1 62
[wordpress] 59188 132 0.4 3.6 1.2 42.8 80.4 33
WordPress.SE 49355 187 0.8 6 1.3 51.5 85.7 61
Between them, these topics have more than 100k questions on Stack Overflow. It wouldn't be fair to say that the tags are abandoned; many people monitor several sites. In fact, by splitting of sites that non-programmers use, we might be increasing the overall number of contributors. That depends entirely on the new sites posing questions that would be not be answered on Stack Overflow. (Note: with the exception of latex, none of the tags I sampled actually have a higher close rate than average on SO.)
In general, the new sites do slightly better in terms of questions answered and speed of answers. These are encouraging signs. But answers are helping fewer people, since the questions are less visible when not hosted by Stack Overflow itself. With the exception of WordPress, the best way to get your question seen is to use an SO tag. However, the sites we spun off so far tend to address a slightly different audience than the core demographic of programmers. TeX and Mathematica are used by mathematicians, Blender by 3D animators, and the CMS sites are for authors and publishers. Therefore, these are not so much topic splits as topic expansions.
This is why I emphasized that an Emacs site needs to go beyond programming. Considering that Emacs is a programmable editor designed by and for programmers using a programable programming language, that's a tall order. But we think it's worth a shot in private beta.
For reference, here are the stats for Emacs tags and the upcoming Vi/Vim proposal:
[elisp] 2884 160 3.2 1.9 1.9 77.8 97.1 55
[emacs] 11505 227 3.6 3.3 1.9 68.9 93.5 68
[vi] 1087 289 11.1 6.9 2.9 71.7 96.2 9
[vim] 14637 260 5.1 4.4 2.1 73.6 96.1 22
These tags are already well served on Stack Overflow, so we will be paying close attention to the sorts of questions asked during private beta. If it becomes clear that the sites merely split rather than expand the audience, we will do what's necessary to reverse the split.