51

Testing an "AI-generated content" policy banner on Stack Overflow says:

The A/B test went live the morning of 21 Sept 2023 [...] a two-week A/B test

It's way past October 5th now... almost two months past it. I left a comment over a week ago asking about it there and got no response.

6
  • 40
    Those responsible for running the test have been sacked^H^H^H^H^H^Hlaid off.
    – nobody
    Commented Dec 2, 2023 at 23:21
  • 18
    I guess the AI singularity took over SO but is not yet ready to announce itself to the world. Commented Dec 3, 2023 at 5:03
  • 8
    @MarkRansom Given the average quality of AI generated content around here, I guess it is still struggling to get "hello world" right.
    – Lundin
    Commented Dec 4, 2023 at 7:59
  • 9
    @Lundin ah, but that's what it wants you to think! Commented Dec 4, 2023 at 12:47
  • 5
    This is the usual behavior. Reporting back on tests/experiments within a reasonable time worked in 20% of cases maximum in the past (even with different staff levels). Commented Dec 5, 2023 at 7:28
  • @MarkRansom Honestly that would explain so much :v
    – Ja Da
    Commented Dec 8, 2023 at 8:40

2 Answers 2

6

Last week I posted the test results to the MSO post, as well as guidance for communities to request this banner be enabled on their site to MSE.

Marking this as accordingly.

13

On December 5, 2023, the results of the banner test were released on the Stack Moderators private Teams instance. These results included data on the efficacy of the banner along with details of what will be happening with those results.

The current plan is to publicly post an update here on Meta Stack Overflow and Meta Stack Exchange with the results in early January.

6
  • 2
    A heads up would have been nice. "Hey, we got the results! Still in the process of organizing/making decisions/etc, but ETA for results presentation is XYZ (date subject to change!)" Commented Dec 7, 2023 at 0:35
  • 2
    up to what date was data collected? did the data stop being collected on Oct 5th? Or does the analysis include data up until right before Dec 5th? Any word on whether my feedback about the analysis method has been heard?
    – starball
    Commented Dec 7, 2023 at 0:48
  • 5
    Mithical's answer here is correct — we plan to release these results and share next steps in early January. Please keep an eye on the original post for those updates.
    – JNat StaffMod
    Commented Dec 7, 2023 at 17:20
  • @JNat: Since the other post has now been updated with the results (and a corresponding announcement made on MSE), should the [status-planned] tag now be removed from this post (and maybe an updated answer posted, pointing to those two posts)?
    – V2Blast
    Commented Jan 5 at 20:25
  • 1
    Thanks for the catch, @V2Blast — would have remembered to come by at some point as I cleaned my backlog, but appreciate being able to get it out of the way sooner ;P
    – JNat StaffMod
    Commented Jan 8 at 10:17
  • @JNat: No problem! :)
    – V2Blast
    Commented Jan 8 at 16:37

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .