So... I gotta admit up-front, this isn't the sort of analysis that's gonna make me feel good at the end of the day: we don't often bring up politics on meta, and when we do it's definitely not for the purpose of generating harmony and togetherness among users of the site. If we're bringing up some topical governance issue here, it's because we believe - right or wrong - that it stands to harm the ability of this site and its users to function effectively, and thus it is worth a bit of disharmony to spread the word.
And so, we're probably gonna keep doing this on rare occasions regardless of the outcome. But... That's no reason not to look at the outcome! It's sorta meaningless to say, "we'll do this regardless of cost" if you don't know the cost: y'aint really sticking your neck out if you secretly believe there's nothing to lose. So, without further ado, here's what I found...
Who I looked at
The first critical question here is: which people am I looking at? There are millions of people visiting Stack Overflow; most of 'em never saw the "taking a stand" post, so measuring overall trends isn't likely to produce meaningful results. The view counter shows not quite 64K views; the actual number of people who clicked through to the post is probably a bit more than that. But again, the section of those people who have any meaningful activity on Stack Overflow is likely to be small; the section who actually read the post or the ensuing discussion and were meaningfully affected by it are almost certainly drowned out by an immense number of people who clicked and bounced and no longer even recall that this ever happened.
What we're really interested in here are the small subsection of users who were both strongly affected by the post and engaged in Stack Overflow proper. To that end, I decided to look at a smaller and much more well-defined group: those users who interacted in some way with the 'Stand post:
- Folks who voted on the post
- Folks who posted answers to the post
- Folks who voted on answers to the post
- Folks who commented on the post
- Folks who commented on answers to the post
- Folks who voted on comments to the post
- Folks who voted on comments to answers to the post
This gave me a list of 3439 users, which seems like a reasonable sample. Of those users, 3401 had joined Stack Overflow at least 30 days prior to the 'Stand post's creation, giving me an opportunity to compare their activity before and after.
Those who left
First, it's important to note that 10 of the users who participated in ways described above have since deleted their accounts. The rest of the data here excludes them for my convenience; while it's not appropriate to assume that all of them deleted their accounts because of the post, it's probably safe to assume that they were not happy being members of the site anymore at some point after their initial participation in the thread.
One user disassociated their answer, but did not remove their account. Their activity is counted below.
Signs of controversy: interactions between participants on main
Goal here is to look for an up-tick in rude/abusive flagging between participants in the discussion on the main site. Also, any series of downvotes that might indicate an effort to "punish" folks who the voter disagreed with (again, on the main site). I'll be looking at the activity 30 days prior to and 30 days after the date the Take A Stand question was posted.
Offended Flagging
This counts all rude/abusive flags raised by a participant in the discussion on a post or comment authored by another participant. In the 30 days prior to the post, 14 such flags were raised; in the 30 days that followed 8 were raised.
Targeted Downvoting
This counts serial downvoting by a participant in the discussion on posts authored by another participant. In the 30 days prior to the post, 4 such downvote series were detected; in the 30 days that followed 10 were detected.
What they did: before and after
Goal here is to gauge participation: was there a noticeable drop-off in activity by folks who were involved in the discussion? I'll again be contrasting the 30 days prior to with the 30 days following the post, and as with the checks in the previous section this is liable to be heavily affected by the overall trends of participation on the site: there's generally an increase in activity across the board as we move away from the holidays and toward spring / end-of-semester activity...
Therefore, any decrease by members of this particular group is interesting, but even an increase that's less than the overall increase is worth considering.
To that end, I'm representing the rest of these findings as a percentage increase from the month prior to the month following the discussion - and including the site-wide increase for comparison. Since you have to have at least 15 rep to vote on meta (and thus be considered a "participant" for the purpose of this answer), I'm also including the percentage increase for all users with >= 15 rep in these results.
visited the site
This counts the total number of days visited by users in each group for the period.
% Increase: participants % Increase: 15-rep+ users % Increase: all
------------------------ ------------------------- ---------------
5.877919006798 7.880587852816 5.996004455345
posting
This counts the total number of questions and answers created by users in each group for the period.
% Increase: participants % Increase: 15-rep+ users % Increase: all
------------------------ ------------------------- ---------------
-1.105074700581 5.919611320585 5.375062335412
voting
This counts the total number of up- and down-votes created by users in each group for the period.
% Increase: participants % Increase: 15-rep+ users % Increase: all
------------------------ ------------------------- ---------------
0.785248545186 5.891314530941 5.916338381861
editing
This counts the total number of edits (to anyone's posts) made by users in each group for the period.
% Increase: participants % Increase: 15-rep+ users % Increase: all
------------------------ ------------------------- ---------------
-5.301593989187 3.776750206507 6.548879708592
flagging
This counts the total number of flags (and close votes, and reopen votes) made by users in each group for the period.
% Increase: participants % Increase: 15-rep+ users % Increase: all
------------------------ ------------------------- ---------------
8.558332496905 11.11673803198 11.413804242489
review
This counts the total number of reviews made by users in each group for the period.
% Increase: participants % Increase: 15-rep+ users % Increase: all
------------------------ ------------------------- ---------------
16.78161236315 18.973242718737 18.773005834371
Conclusions
I suspected going in that any effect we might observe here would be pretty subtle; most of the folks who participated are still around and have long ago moved on to other concerns. But there does appear to have been an effect: participation was lower than might otherwise be expected for pretty much every activity following the discussion, and in two categories actually decreased significantly from the month prior.
There's no denying that such an event can be fairly disruptive for those involved; the tone and volume of comments attests to that if nothing else. Fortunately, the controversy did not appear to inspire anything approaching outright war on the site: cross-flagging and revenge-voting remained rare enough to be discounted following the discussion. While we'll always strive to improve the way we conduct such discussions, it's still good to see that boundaries and some amount of mutual respect isn't a strange notion to folks in this community.
Finally, thank you for your patience. I've had this post half-written for a good many months now, but struggled to find the time to finish it. Hopefully you're still interested...
(e.g. permanently locked with comments disabled)
They've explicitly said that they won't do this.