173
votes
A/B testing related questions within the answers list (experiment has graduated)
Gah!!!
This change is counterproductive, unless the selection of "related" posts is substantially improved.
Before making the "related posts" section be in your face, the selection ...
MakyenMod
- 33.1k
99
votes
A/B testing related questions within the answers list (experiment has graduated)
First, this is a bad change. It requires users to scroll further down to see related content compared to when it was on the sidebar, making that section even more useless, especially given how narrow ...
75
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
Can we get some transparency into how this is working?
What kind of model is being used?
More importantly (to me), how was the model trained?
What inputs is it given for a post? What parts of the ...
61
votes
A/B testing related questions within the answers list (experiment has graduated)
This is not useful for people answering questions
I kind of see the value of this feature for people coming from search engines, looking for a solution to their problem (setting aside the quality of ...
60
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
The way I can tell if a question is related is to click on it and examine the content. The title alone is often not enough to rule a question completely irrelevant or totally relevant.
Would these ...
50
votes
A/B testing related questions within the answers list (experiment has graduated)
Positioning this list so prominently is completely nonsensical if the contents of the list are completely unrelated.
Fix that first, before changing the layout.
In this example, the user is asking for ...
48
votes
Don't show closed, downvoted questions in the "Questions that may already have your answer" list
My biggest concern about entirely eliminating these poor/closed questions from the "dupe checker" is that it will only increase the likelihood that these [poor | closed] questions will be asked again ...
45
votes
A/B testing related questions within the answers list (experiment has graduated)
During the experiment, we observed a statistically significant 900%+ increase in clickthrough rates (CTR) in both experiment groups. Users in the experiment were engaging with related questions at an ...
41
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
I am not sure if this is what leads to what I am seeing if I want to answer this new question:
Anyhow, that's the worst related questions I have seen so far. Normally, when I ask a question, there is ...
40
votes
A/B testing related questions within the answers list (experiment has graduated)
During the experiment, we observed a statistically significant 900%+ increase in clickthrough rates (CTR) in both experiment groups. Users in the experiment were engaging with related questions at an ...
39
votes
A/B testing related questions within the answers list (experiment has graduated)
It feels wrong(? not sure what word to use) to put things that are not intended to be answers in the space dedicated for answers. I've seen my share of "related" posts that are hardly even ...
37
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
One of the things you should keep in mind when judging question relevance is that quite often "Related questions" show questions for completely different technology stacks that are of zero ...
27
votes
A/B testing related questions within the answers list (experiment has graduated)
I have published a userstyle on Stack Apps which removes the Related Questions from the middle of the page.
For posterity:
See the code on GitHub (Direct installation)
In case you never used ...
27
votes
We are graduating the "Related questions using Machine Learning" experiment
Thank you very much for giving this a dedicated Q&A post.
the related questions displayed on pages of questions asked since February 2023 will still be generated by Elasticsearch, but we plan to ...
26
votes
Don't show closed, downvoted questions in the "Questions that may already have your answer" list
I'm going to take a bit of a contrarian view. The type of user who sees that list of questions and waves it around as an invitation to post more without ever viewing any needs more than a "quick fix" ...
24
votes
A/B testing related questions within the answers list (experiment has graduated)
Based on a request, I have updated my userscript ReduceClutter (install) to move the "Related questions" module back to it's original position in the sidebar.
This userscript does much more ...
22
votes
We are graduating the "Related questions using Machine Learning" experiment
However, we were able to check the data and determined that those who had reported seeing less relevancy in the suggested related questions were not part of the experiment group, meaning they were not ...
21
votes
A/B testing related questions within the answers list (experiment has graduated)
I hope it can be turned off per site.
The posts appearing on Stack Overflow em Português are only "related" by chance, and it's another change our community didn't asked (but we have some ...
20
votes
A/B testing related questions within the answers list (experiment has graduated)
feature-request
I have nothing to say about this new position that other haven't said yet. But if you insist on keeping this location for Related questions, then at least allow us to minimize that ...
19
votes
A/B testing related questions within the answers list (experiment has graduated)
feature-request (or maybe bug)
The "new answers" notification appears below the related questions, which makes it hard to notice. Please move it above.
For completeness, this is what it ...
19
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
I don't know if I'm in the ML group, but for me the RQs are still missing the key topic of a question.
Example: Sum of numbers "around" a number with NumPy
Putting aside the convolution ...
18
votes
A/B testing related questions within the answers list (experiment has graduated)
When Stack Overflow itself enters the "click count" game, I fear for the future of the platform. It seems there is a big confusion, it's not a social media or anything alike, we're not on ...
17
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
One concern I have with this - people don't always know what they're looking for.
Take this question for example. Absent any context, you'd assume that this person is looking at a way to encrypt a ...
17
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
Here are a few examples of the related question list not working.
First we have why is my comparator function not working? and the top three suggestions are
Why can templates only be implemented in ...
16
votes
Accepted
Don't show closed, downvoted questions in the "Questions that may already have your answer" list
We've implemented a new warning that bounces off some of the ideas in this question. Essentially, we're going to count the number of closed and the number of deleted questions that show up in the ...
16
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
From a comment of Abdul Aziz Barkat
The stated objective is to "improve the relevance of related questions" why then is the metric measured click through rate? How is the CTR related to the ...
13
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
I have noticed a new list "related questions" below unanswered questions. I had no idea there was an experiment going on, but as it happens I've been on the verge to bug reporting this one ...
11
votes
A/B testing related questions within the answers list (experiment has graduated)
I don't think this feature makes sense for the average logged-in user. Anonymous users? Sure, they're literally searching for content. Showing more content when appropriate in that case is useful. If ...
11
votes
Do you observe increased relevance of Related Questions with our Machine Learning experiment?
All I see now are high traffic questions with little to no relevance beyond perhaps a common tag. The number of times I've seen "Is Java "pass-by-reference" or "pass-by-value"?...
10
votes
A/B testing: moving Related Questions higher on question pages (A/B testing has concluded)
What will the position be if a question is part of a collective?
There is a "collective" banner on the top of the sidebar, will that remain in place, or will it also shift down (I'm not ...
Only top scored, non community-wiki answers of a minimum length are eligible
Related Tags
related-questions × 43discussion × 19
bug × 12
feature-request × 12
content-discovery × 6
support × 4
status-completed × 4
linked-questions × 4
design × 3
announcement × 3
asking-questions × 2
search × 2
a-b-testing × 2
tags × 1
answers × 1
comments × 1
status-declined × 1
status-bydesign × 1
meta × 1
accepted-answer × 1
user-interface × 1
hyperlinks × 1
user-experience × 1
data-explorer × 1
site-crossover × 1