172 votes

A/B testing related questions within the answers list (experiment has graduated)

Gah!!! This change is counterproductive, unless the selection of "related" posts is substantially improved. Before making the "related posts" section be in your face, the selection ...
Makyen's user avatar
  • 32.2k
98 votes

A/B testing related questions within the answers list (experiment has graduated)

First, this is a bad change. It requires users to scroll further down to see related content compared to when it was on the sidebar, making that section even more useless, especially given how narrow ...
TylerH's user avatar
  • 20.9k
75 votes

Do you observe increased relevance of Related Questions with our Machine Learning experiment?

Can we get some transparency into how this is working? What kind of model is being used? More importantly (to me), how was the model trained? What inputs is it given for a post? What parts of the ...
starball's user avatar
  • 25.3k
60 votes

A/B testing related questions within the answers list (experiment has graduated)

This is not useful for people answering questions I kind of see the value of this feature for people coming from search engines, looking for a solution to their problem (setting aside the quality of ...
HolyBlackCat's user avatar
60 votes

Do you observe increased relevance of Related Questions with our Machine Learning experiment?

The way I can tell if a question is related is to click on it and examine the content. The title alone is often not enough to rule a question completely irrelevant or totally relevant. Would these ...
VLAZ's user avatar
  • 26.8k
50 votes

A/B testing related questions within the answers list (experiment has graduated)

Positioning this list so prominently is completely nonsensical if the contents of the list are completely unrelated. Fix that first, before changing the layout. In this example, the user is asking for ...
Cerbrus's user avatar
  • 71.3k
48 votes

Content Discovery initiative April 13 update: Related questions using a Machine Learning model [experiment concluded] Results & V2 experiment plan

I understand that this initiative is for collecting feedback (from a comment by Rosie): We want to make it easier for everyone to have awareness of what changes are happening and a way to give ...
VLAZ's user avatar
  • 26.8k
45 votes

Content Discovery initiative April 13 update: Related questions using a Machine Learning model [experiment concluded] Results & V2 experiment plan

In all honesty, your progression seems backwards. You are promoting content which you already know doesn't answer people's questions (it has been one of the major pain points for the almost 12 years I ...
tripleee's user avatar
  • 178k
44 votes

A/B testing related questions within the answers list (experiment has graduated)

During the experiment, we observed a statistically significant 900%+ increase in clickthrough rates (CTR) in both experiment groups. Users in the experiment were engaging with related questions at an ...
kaya3's user avatar
  • 48.3k
41 votes

Do you observe increased relevance of Related Questions with our Machine Learning experiment?

I am not sure if this is what leads to what I am seeing if I want to answer this new question: Anyhow, that's the worst related questions I have seen so far. Normally, when I ask a question, there is ...
Simon's user avatar
  • 495
40 votes

A/B testing related questions within the answers list (experiment has graduated)

During the experiment, we observed a statistically significant 900%+ increase in clickthrough rates (CTR) in both experiment groups. Users in the experiment were engaging with related questions at an ...
CodeCaster's user avatar
  • 149k
38 votes

A/B testing related questions within the answers list (experiment has graduated)

It feels wrong(? not sure what word to use) to put things that are not intended to be answers in the space dedicated for answers. I've seen my share of "related" posts that are hardly even ...
starball's user avatar
  • 25.3k
37 votes

Announcing the Content Discovery initiative

I will post a slightly cynical reply but nonetheless very true. When you land on a question page from Google, what is your thought process and behavior when you determine that you may need to explore ...
Dharman's user avatar
  • 31.4k
37 votes

Do you observe increased relevance of Related Questions with our Machine Learning experiment?

One of the things you should keep in mind when judging question relevance is that quite often "Related questions" show questions for completely different technology stacks that are of zero ...
Dalija Prasnikar's user avatar
32 votes

Content Discovery initiative April 13 update: Related questions using a Machine Learning model [experiment concluded] Results & V2 experiment plan

For each of those experiments, we’ve created a post here on meta that discusses the experiment and links back to the initiative. While this simplifies things in the sense that each topic has a ...
starball's user avatar
  • 25.3k
27 votes

A/B testing related questions within the answers list (experiment has graduated)

I have published a userstyle on Stack Apps which removes the Related Questions from the middle of the page. For posterity: See the code on GitHub (Direct installation) In case you never used ...
VLAZ's user avatar
  • 26.8k
27 votes

We are graduating the "Related questions using Machine Learning" experiment

Thank you very much for giving this a dedicated Q&A post. the related questions displayed on pages of questions asked since February 2023 will still be generated by Elasticsearch, but we plan to ...
starball's user avatar
  • 25.3k
24 votes

Announcing the Content Discovery initiative

A caveat to my answers, is that I am not a new developer. I think this is going to influence my process of finding answers and how I utilize Stack Overflow to find answers compared to a newer ...
Andy's user avatar
  • 49.4k
23 votes

A/B testing related questions within the answers list (experiment has graduated)

Based on a request, I have updated my userscript ReduceClutter (install) to move the "Related questions" module back to it's original position in the sidebar. This userscript does much more ...
Samuel Liew's user avatar
  • 77.3k
21 votes

A/B testing related questions within the answers list (experiment has graduated)

I hope it can be turned off per site. The posts appearing on Stack Overflow em Português are only "related" by chance, and it's another change our community didn't asked (but we have some ...
Largato's user avatar
  • 779
21 votes

We are graduating the "Related questions using Machine Learning" experiment

However, we were able to check the data and determined that those who had reported seeing less relevancy in the suggested related questions were not part of the experiment group, meaning they were not ...
Oleg Valter is with Ukraine's user avatar
20 votes

A/B testing related questions within the answers list (experiment has graduated)

feature-request I have nothing to say about this new position that other haven't said yet. But if you insist on keeping this location for Related questions, then at least allow us to minimize that ...
Dalija Prasnikar's user avatar
19 votes

A/B testing related questions within the answers list (experiment has graduated)

feature-request (or maybe bug) The "new answers" notification appears below the related questions, which makes it hard to notice. Please move it above. For completeness, this is what it ...
wjandrea's user avatar
  • 29.1k
19 votes

Content Discovery initiative April 13 update: Related questions using a Machine Learning model [experiment concluded] Results & V2 experiment plan

Moving forward, we'll announce new experiment releases as an update on this post and the table below, instead of a standalone Meta post for each experiment. This is a terrible idea. It will hinder ...
Travis J's user avatar
  • 81.4k
19 votes

Do you observe increased relevance of Related Questions with our Machine Learning experiment?

I don't know if I'm in the ML group, but for me the RQs are still missing the key topic of a question. Example: Sum of numbers "around" a number with NumPy Putting aside the convolution ...
tdy's user avatar
  • 37.6k
17 votes

A/B testing related questions within the answers list (experiment has graduated)

When Stack Overflow itself enters the "click count" game, I fear for the future of the platform. It seems there is a big confusion, it's not a social media or anything alike, we're not on ...
Fareanor's user avatar
  • 6,333
17 votes

Content Discovery initiative April 13 update: Related questions using a Machine Learning model [experiment concluded] Results & V2 experiment plan

Using machine learning to recommend more relevant related questions using the question title and tags This is a big change that should be its own featured post & not an unpublicized unexplained ...
philipxy's user avatar
  • 14.8k
17 votes

Do you observe increased relevance of Related Questions with our Machine Learning experiment?

One concern I have with this - people don't always know what they're looking for. Take this question for example. Absent any context, you'd assume that this person is looking at a way to encrypt a ...
Makoto's user avatar
  • 105k
17 votes

Do you observe increased relevance of Related Questions with our Machine Learning experiment?

Here are a few examples of the related question list not working. First we have why is my comparator function not working? and the top three suggestions are Why can templates only be implemented in ...
NathanOliver's user avatar
16 votes

Do you observe increased relevance of Related Questions with our Machine Learning experiment?

From a comment of Abdul Aziz Barkat The stated objective is to "improve the relevance of related questions" why then is the metric measured click through rate? How is the CTR related to the ...
NoDataDumpNoContribution's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible