172
votes
A/B testing related questions within the answers list (experiment has graduated)
Gah!!!
This change is counterproductive, unless the selection of "related" posts is substantially improved.
Before making the "related posts" section be in your face, the selection ...

MakyenMod
- 32.2k
98
votes
A/B testing related questions within the answers list (experiment has graduated)
First, this is a bad change. It requires users to scroll further down to see related content compared to when it was on the sidebar, making that section even more useless, especially given how narrow ...
75
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
Can we get some transparency into how this is working?
What kind of model is being used?
More importantly (to me), how was the model trained?
What inputs is it given for a post? What parts of the ...
60
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
The way I can tell if a question is related is to click on it and examine the content. The title alone is often not enough to rule a question completely irrelevant or totally relevant.
Would these ...
60
votes
A/B testing related questions within the answers list (experiment has graduated)
This is not useful for people answering questions
I kind of see the value of this feature for people coming from search engines, looking for a solution to their problem (setting aside the quality of ...
50
votes
A/B testing related questions within the answers list (experiment has graduated)
Positioning this list so prominently is completely nonsensical if the contents of the list are completely unrelated.
Fix that first, before changing the layout.
In this example, the user is asking for ...
48
votes
Content Discovery initiative April 13 update: Related questions using a Machine Learning model [experiment concluded] Results & V2 experiment plan
I understand that this initiative is for collecting feedback (from a comment by Rosie):
We want to make it easier for everyone to have awareness of what changes are happening and a way to give ...
45
votes
Content Discovery initiative April 13 update: Related questions using a Machine Learning model [experiment concluded] Results & V2 experiment plan
In all honesty, your progression seems backwards. You are promoting content which you already know doesn't answer people's questions (it has been one of the major pain points for the almost 12 years I ...
44
votes
A/B testing related questions within the answers list (experiment has graduated)
During the experiment, we observed a statistically significant 900%+ increase in clickthrough rates (CTR) in both experiment groups. Users in the experiment were engaging with related questions at an ...
41
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
I am not sure if this is what leads to what I am seeing if I want to answer this new question:
Anyhow, that's the worst related questions I have seen so far. Normally, when I ask a question, there is ...
40
votes
A/B testing related questions within the answers list (experiment has graduated)
During the experiment, we observed a statistically significant 900%+ increase in clickthrough rates (CTR) in both experiment groups. Users in the experiment were engaging with related questions at an ...
38
votes
A/B testing related questions within the answers list (experiment has graduated)
It feels wrong(? not sure what word to use) to put things that are not intended to be answers in the space dedicated for answers. I've seen my share of "related" posts that are hardly even ...
37
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
One of the things you should keep in mind when judging question relevance is that quite often "Related questions" show questions for completely different technology stacks that are of zero ...
32
votes
Content Discovery initiative April 13 update: Related questions using a Machine Learning model [experiment concluded] Results & V2 experiment plan
For each of those experiments, we’ve created a post here on meta that discusses the experiment and links back to the initiative.
While this simplifies things in the sense that each topic has a ...
27
votes
A/B testing related questions within the answers list (experiment has graduated)
I have published a userstyle on Stack Apps which removes the Related Questions from the middle of the page.
For posterity:
See the code on GitHub (Direct installation)
In case you never used ...
27
votes
We are graduating the "Related questions using Machine Learning" experiment
Thank you very much for giving this a dedicated Q&A post.
the related questions displayed on pages of questions asked since February 2023 will still be generated by Elasticsearch, but we plan to ...
23
votes
A/B testing related questions within the answers list (experiment has graduated)
Based on a request, I have updated my userscript ReduceClutter (install) to move the "Related questions" module back to it's original position in the sidebar.
This userscript does much more ...

Samuel LiewMod
- 77.3k
21
votes
A/B testing related questions within the answers list (experiment has graduated)
I hope it can be turned off per site.
The posts appearing on Stack Overflow em Português are only "related" by chance, and it's another change our community didn't asked (but we have some ...
21
votes
We are graduating the "Related questions using Machine Learning" experiment
However, we were able to check the data and determined that those who had reported seeing less relevancy in the suggested related questions were not part of the experiment group, meaning they were not ...
20
votes
A/B testing related questions within the answers list (experiment has graduated)
feature-request
I have nothing to say about this new position that other haven't said yet. But if you insist on keeping this location for Related questions, then at least allow us to minimize that ...
19
votes
A/B testing related questions within the answers list (experiment has graduated)
feature-request (or maybe bug)
The "new answers" notification appears below the related questions, which makes it hard to notice. Please move it above.
For completeness, this is what it ...
19
votes
Content Discovery initiative April 13 update: Related questions using a Machine Learning model [experiment concluded] Results & V2 experiment plan
Moving forward, we'll announce new experiment releases as an update on this post and the table below, instead of a standalone Meta post for each experiment.
This is a terrible idea. It will hinder ...
19
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
I don't know if I'm in the ML group, but for me the RQs are still missing the key topic of a question.
Example: Sum of numbers "around" a number with NumPy
Putting aside the convolution ...
17
votes
A/B testing related questions within the answers list (experiment has graduated)
When Stack Overflow itself enters the "click count" game, I fear for the future of the platform. It seems there is a big confusion, it's not a social media or anything alike, we're not on ...
17
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
One concern I have with this - people don't always know what they're looking for.
Take this question for example. Absent any context, you'd assume that this person is looking at a way to encrypt a ...
17
votes
Content Discovery initiative April 13 update: Related questions using a Machine Learning model [experiment concluded] Results & V2 experiment plan
Using machine learning to recommend more relevant related questions using the question title and tags
This is a big change that should be its own featured post & not an unpublicized unexplained ...
17
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
Here are a few examples of the related question list not working.
First we have why is my comparator function not working? and the top three suggestions are
Why can templates only be implemented in ...
16
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
From a comment of Abdul Aziz Barkat
The stated objective is to "improve the relevance of related questions" why then is the metric measured click through rate? How is the CTR related to the ...
14
votes
Content Discovery initiative April 13 update: Related questions using a Machine Learning model [experiment concluded] Results & V2 experiment plan
We plan on sharing the results of that experiment on or around April 19, as an edit to this post
PLEASE make a dedicated post for it!
Make a dedicated post for it, and then just link to that ...
13
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
I have noticed a new list "related questions" below unanswered questions. I had no idea there was an experiment going on, but as it happens I've been on the verge to bug reporting this one ...
Only top scored, non community-wiki answers of a minimum length are eligible
Related Tags
discussion × 8content-discovery × 8
related-questions × 6
announcement × 5
a-b-testing × 2
product-discovery × 1