Skip to main content
OCD: list consistency edit
Source Link
Wai Ha Lee
  • 8.8k
  • 7
  • 45
  • 70

I don't have access to the data for that anymore, but going from memory:

  • there were a LOT of problems running that test. Most of them are documented in the discussions had at the time, so I won't rehash them other than to note: we thought it was gonna be a hard test, and... It was harder than we thought it would be.
  • we got a lot of data back, but in the end not enough to draw conclusive results. Given the severe disruption caused by the changes being tested, the decision was made to not continue it for a longer period.
  • there did not appear to be a clear win for hiding post scores in any scenario tested.
  • there may have actually been negative consequences - for authors, for moderators, even for readers.

There's probably more to learn here, but... I strongly suspect this approach was a dead-end; more useful gains would probably arise from changes to other aspects of the voting, scoring, or ranking systems. Donna has done a fair bit of research in this area; we had at one point planned to write about this on the blog, and I very much hope that she will still find time to do so eventually!

I don't have access to the data for that anymore, but going from memory:

  • there were a LOT of problems running that test. Most of them are documented in the discussions had at the time, so I won't rehash them other than to note: we thought it was gonna be a hard test, and... It was harder than we thought it would be.
  • we got a lot of data back, but in the end not enough to draw conclusive results. Given the severe disruption caused by the changes being tested, the decision was made to not continue it for a longer period.
  • there did not appear to be a clear win for hiding post scores in any scenario tested
  • there may have actually been negative consequences - for authors, for moderators, even for readers.

There's probably more to learn here, but... I strongly suspect this approach was a dead-end; more useful gains would probably arise from changes to other aspects of the voting, scoring, or ranking systems. Donna has done a fair bit of research in this area; we had at one point planned to write about this on the blog, and I very much hope that she will still find time to do so eventually!

I don't have access to the data for that anymore, but going from memory:

  • there were a LOT of problems running that test. Most of them are documented in the discussions had at the time, so I won't rehash them other than to note: we thought it was gonna be a hard test, and... It was harder than we thought it would be.
  • we got a lot of data back, but in the end not enough to draw conclusive results. Given the severe disruption caused by the changes being tested, the decision was made to not continue it for a longer period.
  • there did not appear to be a clear win for hiding post scores in any scenario tested.
  • there may have actually been negative consequences - for authors, for moderators, even for readers.

There's probably more to learn here, but... I strongly suspect this approach was a dead-end; more useful gains would probably arise from changes to other aspects of the voting, scoring, or ranking systems. Donna has done a fair bit of research in this area; we had at one point planned to write about this on the blog, and I very much hope that she will still find time to do so eventually!

Source Link
Shog9
  • 159.4k
  • 177
  • 1.2k
  • 1.2k

I don't have access to the data for that anymore, but going from memory:

  • there were a LOT of problems running that test. Most of them are documented in the discussions had at the time, so I won't rehash them other than to note: we thought it was gonna be a hard test, and... It was harder than we thought it would be.
  • we got a lot of data back, but in the end not enough to draw conclusive results. Given the severe disruption caused by the changes being tested, the decision was made to not continue it for a longer period.
  • there did not appear to be a clear win for hiding post scores in any scenario tested
  • there may have actually been negative consequences - for authors, for moderators, even for readers.

There's probably more to learn here, but... I strongly suspect this approach was a dead-end; more useful gains would probably arise from changes to other aspects of the voting, scoring, or ranking systems. Donna has done a fair bit of research in this area; we had at one point planned to write about this on the blog, and I very much hope that she will still find time to do so eventually!