Timeline for A/B testing of a "Trending" sort option for answers
Current License: CC BY-SA 4.0
17 events
when toggle format | what | by | license | comment | |
---|---|---|---|---|---|
Apr 25, 2022 at 15:20 | comment | added | M. Justin | @Holger In the interest of full disclosure, one of those six of mine actually is an answer that retells what other answers say. However, it's doing it for a very specific reason, and is completely up-front about that (going so far as to link to the other answers). Namely, that none of the existing answers tells the whole story. It also goes into further detail than many of them do. stackoverflow.com/a/65748081/1108305 | |
Apr 25, 2022 at 9:08 | comment | added | Holger | It’s a good thing for an answer like yours, just like intended. Unfortunately, I have seen a lot of bad answers moved to the front by this new algorithm. All it takes, is posting an actually obsolete answer to an old, highly voted question, retelling what other answers said and get a few upvotes and there you are. In fact, we know that a lot of such “late answers” are bad, that’s why they go to the review queue automatically. But a criteria like “obsolete because not telling something new” does not exist. As long as they are not outright plagiarism, they benefit much from the new system. | |
Apr 22, 2022 at 15:15 | comment | added | M. Justin | I'd say it seems to heavily favor the one with the highest score, which is probably a combination of it being a good answer and the first thing users see (so they upvote it if it looks good). In all these cases, there are ones with higher scores that are further down on the list. Though 2 of the 6 answers had something other than the one with the highest score on top. | |
Apr 22, 2022 at 10:42 | comment | added | Braiam | These examples show that it still heavily favors the one with more upvotes (or higher score). And while yes, it promotes later comers, the top answer is still the same in all scenarios. | |
Apr 20, 2022 at 3:39 | comment | added | M. Justin | Honestly, it actually feels more extreme to me than what I have here. | |
Apr 20, 2022 at 3:38 | comment | added | M. Justin | @ScottyJamison Yeah, a single upvote isn't a trend. 5 upvotes for something on the third page over something on the first page with 1000 upvotes, that's starting to sound more reasonable to float to the top. | |
Apr 20, 2022 at 3:38 | comment | added | Scotty Jamison | ...I guess I'd like to see a little more stability in the ordering from this algorithm. Right now it feels the answers are too free-floating, able to move far distances with a few votes. Yes I want to see trending answers above dated ones, but I'm also ok if they still have to work a bit to get there. | |
Apr 20, 2022 at 3:34 | comment | added | Scotty Jamison | I posted an answer, it got one upvote, and jumped ahead of 24 other answers, one of which had 64 votes. Not quite as extreme as what's shown here, but still, I feel this not good. if you see a one-vote answer followed by a 64-vote answer, which one are you going to be more interested in? Which would you want to see first? The answer that a single person out there recently thought was pretty good, or an answer that a fairly large subset of the community found useful at some point in time? | |
Apr 19, 2022 at 16:40 | history | edited | M. Justin | CC BY-SA 4.0 |
Intro sentence; add main example to table
|
Apr 19, 2022 at 16:35 | comment | added | 0Valt | @M.Justin nice, thank you for adding some data points! | |
Apr 19, 2022 at 16:23 | comment | added | M. Justin | @OlegValteriswithUkraine I've gone through my own necromancy posts & added 5 more similar examples. It's not the dozen more, but it is more data points. | |
Apr 19, 2022 at 16:22 | history | edited | M. Justin | CC BY-SA 4.0 |
Add similar examples & observation
|
Apr 19, 2022 at 15:59 | comment | added | 0Valt | It's a good observation, @VLAZ - if the new sort is able to do that, I feel like it might be worthwhile. That said, this answer can benefit from some generalisation - a dozen more examples of where a new answer outpaces an immensely voted one would be nice. | |
Apr 19, 2022 at 15:53 | comment | added | M. Justin | @VLAZ I can certainly delete it if it's not useful for the discussion. | |
Apr 19, 2022 at 15:52 | comment | added | M. Justin | @VLAZ An observation of its effect in a rather extreme example. | |
Apr 19, 2022 at 15:50 | comment | added | VLAZ | I'm not sure I understand why you've posted this. Is this supposed to be a problem? Or a good thing? | |
Apr 19, 2022 at 15:48 | history | answered | M. Justin | CC BY-SA 4.0 |