Skip to main content
added 305 characters in body
Source Link
Braiam
  • 4.5k
  • 13
  • 154
  • 265

This experiment is now live

Since this is a experiment, there should be test goals. How are those goals measured?

We're going to measure how copy and voting behavior changes between the default Score sort and the four Trending sorts

The copying can be misleading. Yes, I may copy the top answer, but only to test it out. Or I may not copy it at all, because I couldn't figure out how it applies to my problem.

We're also watching the rate at which users change between the different Sort options

Apparently, I'm not savvy enough to see those options.

enter image description here

We want to ship one of these four algorithms

What if there isn't any statistical difference between trending and score based sorting? Is that part of the test? Intervention vs no intervention should also be evaluated, not only the several kinds of interventions against themselves. Control groups are required.

Also, I would like to see some chaos ordering. Totally random. It could not be a default option, but a option. And no, it's not a joke option either. If the trending vs score vs random makes no difference to certain posts, that's something that "experienced (with the topic) users" may want to evaluate.

This experiment is now live

Since this is a experiment, there should be test goals. How are those goals measured?

We're going to measure how copy and voting behavior changes between the default Score sort and the four Trending sorts

The copying can be misleading. Yes, I may copy the top answer, but only to test it out. Or I may not copy it at all, because I couldn't figure out how it applies to my problem.

We're also watching the rate at which users change between the different Sort options

Apparently, I'm not savvy enough to see those options.

enter image description here

We want to ship one of these four algorithms

What if there isn't any statistical difference between trending and score based sorting? Is that part of the test? Intervention vs no intervention should also be evaluated, not only the several kinds of interventions against themselves. Control groups are required.

This experiment is now live

Since this is a experiment, there should be test goals. How are those goals measured?

We're going to measure how copy and voting behavior changes between the default Score sort and the four Trending sorts

The copying can be misleading. Yes, I may copy the top answer, but only to test it out. Or I may not copy it at all, because I couldn't figure out how it applies to my problem.

We're also watching the rate at which users change between the different Sort options

Apparently, I'm not savvy enough to see those options.

enter image description here

We want to ship one of these four algorithms

What if there isn't any statistical difference between trending and score based sorting? Is that part of the test? Intervention vs no intervention should also be evaluated, not only the several kinds of interventions against themselves. Control groups are required.

Also, I would like to see some chaos ordering. Totally random. It could not be a default option, but a option. And no, it's not a joke option either. If the trending vs score vs random makes no difference to certain posts, that's something that "experienced (with the topic) users" may want to evaluate.

Source Link
Braiam
  • 4.5k
  • 13
  • 154
  • 265

This experiment is now live

Since this is a experiment, there should be test goals. How are those goals measured?

We're going to measure how copy and voting behavior changes between the default Score sort and the four Trending sorts

The copying can be misleading. Yes, I may copy the top answer, but only to test it out. Or I may not copy it at all, because I couldn't figure out how it applies to my problem.

We're also watching the rate at which users change between the different Sort options

Apparently, I'm not savvy enough to see those options.

enter image description here

We want to ship one of these four algorithms

What if there isn't any statistical difference between trending and score based sorting? Is that part of the test? Intervention vs no intervention should also be evaluated, not only the several kinds of interventions against themselves. Control groups are required.