172
votes
A/B testing related questions within the answers list (experiment has graduated)
Gah!!!
This change is counterproductive, unless the selection of "related" posts is substantially improved.
Before making the "related posts" section be in your face, the selection ...

MakyenMod
- 32.2k
98
votes
A/B testing related questions within the answers list (experiment has graduated)
First, this is a bad change. It requires users to scroll further down to see related content compared to when it was on the sidebar, making that section even more useless, especially given how narrow ...
75
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
Can we get some transparency into how this is working?
What kind of model is being used?
More importantly (to me), how was the model trained?
What inputs is it given for a post? What parts of the ...
60
votes
A/B testing related questions within the answers list (experiment has graduated)
This is not useful for people answering questions
I kind of see the value of this feature for people coming from search engines, looking for a solution to their problem (setting aside the quality of ...
60
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
The way I can tell if a question is related is to click on it and examine the content. The title alone is often not enough to rule a question completely irrelevant or totally relevant.
Would these ...
50
votes
A/B testing related questions within the answers list (experiment has graduated)
Positioning this list so prominently is completely nonsensical if the contents of the list are completely unrelated.
Fix that first, before changing the layout.
In this example, the user is asking for ...
48
votes
Content Discovery initiative April 13 update: Related questions using a Machine Learning model [experiment concluded] Results & V2 experiment plan
I understand that this initiative is for collecting feedback (from a comment by Rosie):
We want to make it easier for everyone to have awareness of what changes are happening and a way to give ...
45
votes
Content Discovery initiative April 13 update: Related questions using a Machine Learning model [experiment concluded] Results & V2 experiment plan
In all honesty, your progression seems backwards. You are promoting content which you already know doesn't answer people's questions (it has been one of the major pain points for the almost 12 years I ...
44
votes
A/B testing related questions within the answers list (experiment has graduated)
During the experiment, we observed a statistically significant 900%+ increase in clickthrough rates (CTR) in both experiment groups. Users in the experiment were engaging with related questions at an ...
41
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
I am not sure if this is what leads to what I am seeing if I want to answer this new question:
Anyhow, that's the worst related questions I have seen so far. Normally, when I ask a question, there is ...
40
votes
A/B testing related questions within the answers list (experiment has graduated)
During the experiment, we observed a statistically significant 900%+ increase in clickthrough rates (CTR) in both experiment groups. Users in the experiment were engaging with related questions at an ...
38
votes
A/B testing related questions within the answers list (experiment has graduated)
It feels wrong(? not sure what word to use) to put things that are not intended to be answers in the space dedicated for answers. I've seen my share of "related" posts that are hardly even ...
37
votes
Announcing the Content Discovery initiative
I will post a slightly cynical reply but nonetheless very true.
When you land on a question page from Google, what is your thought process and behavior when you determine that you may need to explore ...

DharmanMod
- 31.4k
37
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
One of the things you should keep in mind when judging question relevance is that quite often "Related questions" show questions for completely different technology stacks that are of zero ...
32
votes
Content Discovery initiative April 13 update: Related questions using a Machine Learning model [experiment concluded] Results & V2 experiment plan
For each of those experiments, we’ve created a post here on meta that discusses the experiment and links back to the initiative.
While this simplifies things in the sense that each topic has a ...
27
votes
A/B testing related questions within the answers list (experiment has graduated)
I have published a userstyle on Stack Apps which removes the Related Questions from the middle of the page.
For posterity:
See the code on GitHub (Direct installation)
In case you never used ...
27
votes
We are graduating the "Related questions using Machine Learning" experiment
Thank you very much for giving this a dedicated Q&A post.
the related questions displayed on pages of questions asked since February 2023 will still be generated by Elasticsearch, but we plan to ...
24
votes
Announcing the Content Discovery initiative
A caveat to my answers, is that I am not a new developer. I think this is going to influence my process of finding answers and how I utilize Stack Overflow to find answers compared to a newer ...

AndyMod
- 49.4k
23
votes
A/B testing related questions within the answers list (experiment has graduated)
Based on a request, I have updated my userscript ReduceClutter (install) to move the "Related questions" module back to it's original position in the sidebar.
This userscript does much more ...

Samuel LiewMod
- 77.3k
21
votes
A/B testing related questions within the answers list (experiment has graduated)
I hope it can be turned off per site.
The posts appearing on Stack Overflow em Português are only "related" by chance, and it's another change our community didn't asked (but we have some ...
21
votes
We are graduating the "Related questions using Machine Learning" experiment
However, we were able to check the data and determined that those who had reported seeing less relevancy in the suggested related questions were not part of the experiment group, meaning they were not ...
20
votes
A/B testing related questions within the answers list (experiment has graduated)
feature-request
I have nothing to say about this new position that other haven't said yet. But if you insist on keeping this location for Related questions, then at least allow us to minimize that ...
19
votes
A/B testing related questions within the answers list (experiment has graduated)
feature-request (or maybe bug)
The "new answers" notification appears below the related questions, which makes it hard to notice. Please move it above.
For completeness, this is what it ...
19
votes
Content Discovery initiative April 13 update: Related questions using a Machine Learning model [experiment concluded] Results & V2 experiment plan
Moving forward, we'll announce new experiment releases as an update on this post and the table below, instead of a standalone Meta post for each experiment.
This is a terrible idea. It will hinder ...
19
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
I don't know if I'm in the ML group, but for me the RQs are still missing the key topic of a question.
Example: Sum of numbers "around" a number with NumPy
Putting aside the convolution ...
17
votes
A/B testing related questions within the answers list (experiment has graduated)
When Stack Overflow itself enters the "click count" game, I fear for the future of the platform. It seems there is a big confusion, it's not a social media or anything alike, we're not on ...
17
votes
Content Discovery initiative April 13 update: Related questions using a Machine Learning model [experiment concluded] Results & V2 experiment plan
Using machine learning to recommend more relevant related questions using the question title and tags
This is a big change that should be its own featured post & not an unpublicized unexplained ...
17
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
One concern I have with this - people don't always know what they're looking for.
Take this question for example. Absent any context, you'd assume that this person is looking at a way to encrypt a ...
17
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
Here are a few examples of the related question list not working.
First we have why is my comparator function not working? and the top three suggestions are
Why can templates only be implemented in ...
16
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
From a comment of Abdul Aziz Barkat
The stated objective is to "improve the relevance of related questions" why then is the metric measured click through rate? How is the CTR related to the ...
Only top scored, non community-wiki answers of a minimum length are eligible
Related Tags
discussion × 8content-discovery × 8
related-questions × 6
announcement × 5
a-b-testing × 2
product-discovery × 1