Questions tagged [a-b-testing]

For questions regarding functionality on Stack Exchange which is subject to A/B testing.

Filter by
Sorted by
Tagged with
-142 votes
16 answers
2k views

A/B testing related questions within the answers list (experiment has graduated)

Update Mar 21: TL;DR: Today, we graduated the experiment for Stack Overflow question pages with zero answers, specifically the variant where three related questions are shown by default, with a link ...
  • 101
-8 votes
2 answers
453 views

A/B testing the separation of The Overflow Blog from the Community Bulletin (testing concluded)

Update Feb 9: Testing has concluded. Update Jan 30: Test is now active on Stack Overflow for anonymous users. Background As part of the Content Discovery initiative, we’re announcing the next ...
  • 101
30 votes
2 answers
740 views

A/B testing: moving Related Questions higher on question pages (A/B testing has concluded)

Update Nov 22: V2 experiment has concluded. We will share results and next steps soon. Update Nov 17: V2 of the experiment is now active. The experiment will conclude tomorrow. We will update Meta ...
  • 101
11 votes
0 answers
523 views

Results of the vote arrows styling experiment

TL;DR: Overall, the experiment was a success with a positive lift in overall votes in the variant group, however, we will not be graduating the experiment. In June, we conducted an experiment to test ...
  • 101
-286 votes
21 answers
13k views

Updated button styling for vote arrows: A/B testing has concluded

This experiment has concluded. We've gathered and analyzed the results in Results of the voting arrow experiment. This week, we're rolling out a test to update the appearance of voting arrows for ...
  • 101
45 votes
2 answers
837 views

Results of the Trending sort experiment

In this post, we'll go over how the Trending sort experiment went and why we chose Decay-50 as our preferred choice as announced in Trending: A new answer sorting option. We'll summarize both the ...
  • 2,124
31 votes
9 answers
8k views

Ask Wizard Test Results and Next Steps

Three months ago we ran an experiment testing a new Ask Wizard on Stack Overflow. The Ask Wizard is planned as the first phase of the Staging Ground project (see here and here for more info), and we ...
  • 40.4k
77 votes
13 answers
8k views

Ask Wizard for New Users Feature Test is complete

Update: This feature test was live on Stack Overflow from 2022-03-21 through 2022-04-06. The overall results from this test were very positive and are available in a separate post. A couple of weeks ...
  • 40.4k
158 votes
22 answers
15k views

A/B testing of a "Trending" sort option for answers

This experiment has concluded. We've gathered and analyzed the results in Results of the Trending sort experiment. As we’ve been moving forward on the Outdated Answers project, one of the things that’...
  • 2,124
117 votes
13 answers
6k views

A/B testing on the Ask page

Update (2021-12-14): This experiment has launched on Stack Overflow. Since we announced the start of product discovery for the new user onboarding project we have been focused on gathering user ...
  • 1
169 votes
2 answers
5k views

Outdated Answers: unpinning the accepted answer A/B test

Update (2021-09-08): The experiment ran 2021-09-02 through 2021-09-08. We permanently unpinned the accepted answer 2021-09-08. As we mentioned two weeks ago, tomorrow we are shipping a test on Stack ...
43 votes
1 answer
678 views

What were the results of the A/B experiment where negative question scores were clamped to 0?

In October 2019 the company conducted an experiment on Stack Overflow with A/B testing in which they showed score 0 if the score was in truth negative. The experiment lasted two weeks and after voting ...
  • 10.4k
7 votes
1 answer
166 views

Different post notices from different machines

This is the post notice I see from my home machine: And this is the post notice I see from my work machine for the same question: According to my understanding, this should not happen; from the Meta ...
  • 56.5k
103 votes
18 answers
18k views

New Post Notices (Closed/On Hold/etc.) rolling out on Stack Overflow

Today, we are rolling out a major redesign of Post Notices (the banners displaying the reason why a question is "Closed" or "On Hold") on Stack Overflow. For our purposes, a "post notice" includes ...
  • 40.4k
17 votes
1 answer
294 views

Attempting to downvote a -3 post on Teams makes the score display as -1 [closed]

I am in the -1 group in the current Stack Overflow experiment. On the Charcoal Team, there is this post. It has -3 score and vote count +2/-5. I have six reputation there, and thus can't downvote it. ...
36 votes
4 answers
2k views

Ethical considerations of the ongoing experiment re not displaying negative scores

(This post is about the ongoing experiment regarding the display of a post's total score, discussed in New popup message when voting on a question/answer?, and not a duplicate of that thread) May I ...
  • 56.5k
26 votes
1 answer
332 views

Can we please show negative votes for red flags?

It's weird to see 0 votes on a spam post. Any alternative suggestion? I am not against the change and welcome new users, but spam posts should be an exception. Is there any way to prevent seeing a ...
  • 21.6k
8 votes
1 answer
160 views

Privilege achieved without meeting the reputation goal [duplicate]

So, currently I have 558 reputation on my SO account. To get this privilege "See votes,expandable usercard", I need 1000+ rep as mentioned here. However, I noticed that I can click on the score of any ...
244 votes
11 answers
5k views

Why can I no longer see that a post has a negative score?

Thanks for your vote! Your vote has been recorded and it affects this post's ranking. Since this post has reached the minimum score of 0 your vote will not be displayed. I just downvoted a question ...
  • 29.9k
34 votes
2 answers
607 views

Thoughts on the new Ask (Public) Question page

I went to ask a question just now, and was met by a new page: This seems like it's pretty new and I haven't seen any meta posts on it. I thought I'd give some immediate gut-thoughts on this new page ...
127 votes
11 answers
2k views

Duplicate questions display experiment

My name is Jane and I have been working at Stack Overflow for almost six months. I started out as an apprentice last year and now I've graduated to developer. I was the lead dev on this project. One ...
  • 101
97 votes
2 answers
1k views

Add reasoning on what the job reactions mean

What do the following job reactions mean? The first three are obvious. What does it mean if I give a job a unicorn? What about crying hysterically. And doesn't :( mean thumbs down? This is very ...
  • 32.6k
429 votes
38 answers
12k views

The Ask Question Wizard Is Now In Testing!

A long overdue update to our last prototype announcement, our developers are pleased to announce that they've finished the review process and responsive design updates to the Wizard and it is now in ...
  • 33.1k
60 votes
2 answers
938 views

Experiment request: Temporarily stop showing characteristics about a user in the question preview to certain users

Judging from my overall experience on Stack Overflow and what I've seen happening with others, it might be that users' votes are confounded based on the reputation of the post author, or based on ...
  • 1,958
48 votes
0 answers
475 views

Request for additional confirmation if reviewer picks Requires Editing at question with many votes down and close

Suggest to perform a-b-testing of a feature such that when Triage reviewer picks Requires Editing on a question with multiple votes down and close (say 3-4) system would show them additional popup ...
  • 6,222
82 votes
1 answer
1k views

Have we started trying question templates?

I just came across these HTML comments when I went to edit a question: <!-- What are you trying to accomplish? (Please include sample data.) --> <!-- Paste the part of the code that shows ...
  • 40.9k
108 votes
2 answers
3k views

When I look at the review icon, I see red

I like the new notification version of the review icon, which I'm guessing is still undergoing A/B testing: It does a better job at saying "attention here, please" than the old icon which was almost ...
  • 20.6k
44 votes
2 answers
1k views

Jobs tab title is dynamically changing, it is for A/B testing or else?

There are various number of titles are placed instead of the Jobs tab in the top bar. Browse Jobs Find a Job Job Board Developer Jobs Explore Jobs Search Jobs These are dynamically changing when we ...
  • 12.9k
42 votes
1 answer
693 views

How does Stack Overflow (technically) perform opt-in like A/B tests?

I've only recently seen the new post about the top bar being A/B tested during these weeks, and that currently this week bug tests will be their focus. Nevertheless, how do you structure the system in ...
  • 3,513
23 votes
1 answer
358 views

Low contrast in the nav headers in the New SO Nav (currently in testing)

Overall, I love the new nav that's currently being tested. The organization makes more sense to me, and it's got a nice, updated look. My one suggestion: Consider more contrast/visual signals for ...
  • 251
60 votes
7 answers
3k views

We're Soon to be A/B Testing Some Changes to the Top Nav

As what Stack Overflow has to offer folks has grown considerably in the last year, we're going to be testing some changes to the top navigation that we hope will help new users find all of the things ...
  • 33.1k
27 votes
1 answer
554 views

Downvote without comment notification doesn't show up properly

This is a bug report for Move the vote button which is currently in A/B testing on Stack Overflow. Today I tried to downvote question which is lengthy in size. So I've scrolled down to read and ...
  • 6,112
1 vote
1 answer
98 views

Possible bug with scrolling voting button A/B Test

I know that there is a scrolling voting button A/B Test is in progress. However, I'm seeing some inconsistency due to this(?). see the screenshot, there is some unwanted space introduced. Is it a ...
49 votes
5 answers
1k views

Scrolling voting buttons [closed]

The voting buttons scrolling for the question is very disorienting. It even happens for answers. Can I have that turned off? The div.vote gets the class js-vote-sticky attached to it. It looks ...