Collectives were presented (Beta release of Collectives and The user research behind collectives) as a way to increase participation, for example by reducing barriers to entry or by forming communities or by calculating and displaying leaderboards. And the number of members in the respective collectives (4-5k) looks impressive.
Is there already such an effect visible? Has the activity, participation or quality of recently generated content significantly improved in the tag sets defining the two existing collectives?
Quantity of created content could have improved or quality or both or maybe no change is visible yet.
It may depend on how quality of content or activity is measured. Some possibilities would be:
- number of (positively scoring) questions asked
- number of answers given (and upvoted)
- fraction of questions answered
- number of answers per question
- number of unique answerers
- number of votes given
See for example How is question quality measured in A/B tests for a possible definition of question quality.
To see if a change is significant one could take one month after the introduction and compare to a couple of months before possibly with a seasonal adjustment.
What makes gathering the statistics a bit difficult is that the tag sets are quite large and I'm not sure how to efficiently search within them.