I, personally, think that there's not much we, as a community, can do to stop AI-generated content from being used on the site in the long term. Furthermore, I think that the long-term is what we should be focusing on.
The future of AI in a different timeline
The current banhammer stopgap may work for now, but it's a simple solution requiring manpower, and it won't be viable forever. Who here remembers when Dragon Naturally Speaking came out on CD in the 90s? I was 8 or 9 when my grandfather got us a copy. We had an old beige microphone, and my friends and family were absolutely amazed at the speech recognition capability. They could dictate documents directly into Microsoft Works, and I could.... Well... Do what 9-year-olds do best: See how many curse words it could recognize... Even if you had to enunciate them.
Fast forward a couple of years and the same software could recognize multiple individuals in a single conversation and create a transcript including respective speakers. Fast forward a few more years and Microsoft has added "Train your computer to better understand you"1, so enunciation is no longer an obstacle.
That 10-year timespan I just covered would be easy to react to as a community. The problem is AI doesn't take 10 years, it takes 10 hours2. It's easy to spot right now (question rephrased to statement followed by bullet points for your vanilla ChatGPT) but what happens when we get the option to "Train your computer to better type like you"? The Insider Build of Windows 11 (Dev Channel) currently has a Copilot preview that can access your active tab3. I'm certain Microsoft Office access will be next, so It's only a few steps away at most in my opinion.
My opinion moving forward
My thought is this... The banhammer on AI-generated content that isn't cited should continue. However, we should move towards a system that accepts it, so long as it's clearly marked/cited as machine generated4 and there should rarely, if ever, be a top answer marked that is wholly AI-generated. As we move towards that system, the 30-day bans need to turn into 90-day bans. If we incorporate automated detection at some point, it should be human-reviewed, and 90 days should turn into 180 days. I do not see this as too harsh of a punishment so long as users have been explicitly warned.
I believe that if history (as a whole) has shown us anything, it's that we cannot simply ignore a problem, sweep it under the run, and expect it to go away. Band-aids are temporary, but AI is not. Humans have suppressed so many different things over the years... Catholics persecuted Presbyterians as heretics in the Middle Ages, Americans in the land of the free bought and sold black slaves to tend their households and farmlands, women were expected to quietly obey their husbands without a voice to vote until the 1900s, and Jews... Well, Jews have gotten the shaft since the dawn of time.
I'm not saying that AI deserves citizenship or human rights[5]. But as widespread as AI will inevitably become, and as integrated into our lives as it will we need to treat it that way.
TLDR:
We should standardize a boilerplate for AI content and require anyone incorporating it into their content to use it. We should continue the 30-day ban stopgap until a point where it's no longer needed. We should work towards a way of automating the recognition of AI-generated content that isn't cited, always require human review of this automation's output to reduce false positives and implement very steep consequences for those who violate the rules.
Again, all of this is just my opinion. I've been a lurker for 7 years, but as you can see from my reputation, I haven't been active until this past week (I've started to enjoy teaching and tutoring in IT). So, in the grand scheme of things, my 2 cents is literally just that, 2 cents. But I hope that at least a few of you will share somewhat similar opinions. Thanks for your time :)
Clarification on long-term viability and manpower
I do not necessarily think there will be a need to patrol AI-generated content forever. At least, I hope there isn't... However, dumping everything into implementing 30-day bans as stopgaps can't be the answer. Because if we're relying on humans to recognize AI-generated content, we will fail no matter what. I'm not necessarily saying we should absolutely do anything specific. I'm only saying that we need to look much further ahead than much of the discussion going on here.
I do not know what technology drives Stack Exchange on the backend. But the technology has to move forward to account for AI content. Whether you call this a forum, a wiki, an image board, a social media network, or anything else... The technology underneath needs to move forward. To stress this point again if we're relying on humans to recognize AI-generated content, we're going to fail no matter what
What's stopping users from simply not adding the boilerplate?
As Stack Overflow is built on a foundation of user trust, there's nothing that can be done to prevent this except moderating content. Though, in my opinion, adding the boilerplate at least lets the userbase know it's expected. I found out via a comment warning when skimming through questions.
But AI content can't reliably be detected?
I'm not asking for someone to look into this or share information related to site analytics or any other privileged information. However, I would postulate that greater than 65% of users who have been banned for posting AI generated content are newer users trying to boost their reputation. Furthermore, I would estimate that greater than 80% of those are using a vanilla ChatGPT based AI, of which greater than 95% are "non-precise" style (This high percentage is based on the difficulty of getting a reliable output to open ended questions.)
I want to point out an assumption in my argument. I'm looking at this from the point of view that if you know enough about AI to use anything outside of what's available on the mainstream channels, you likely have the experience to answer the questions without using AI content or to examine the content for accuracy before posting it. As mentioned in the previous section, I am basing this assumption off the foundation of trust.
If those numbers are remotely close, then the additional review queue should not require much additional overhead to patrol a large portion of violations. I can quite easily imagine a natural language string analysis algorithm combined with a user event timing algorithm that could pick out a relatively high percentage of violations. I'm sure there are many users way more talented than myself who could imagine the same in a far more optimized and efficient way.
An alternative
If patrolling content and review queues are too far-fetched, then maybe instead of targeting users, we should target posts (I thought this was mentioned in one of the comment threads, but I couldn't find it on a second look). Automated boilerplate addition to user posts if they are flagged as AI generated by an algorithm. A certain reputation level allows an individual to remove the boilerplate. A higher reputation level will automatically bypass the check on their posts.
If policing content isn't the answer, then decriminalization and regulation is.
[1] There was a step in between, where Microsoft let you correct its understanding with input rather than via prompt; See This MiPad Research Article
[2] Keep in mind that AI can't just pick up any task and do it quicker and better. Take for instance the following study in which it took an AI 924 hours to learn a game that would take humans less than 30 minutes:
- Lake, Brenden & Ullman, Tomer & Tenenbaum, Joshua & Gershman, Samuel. (2016). Building Machines That Learn and Think Like People. CBMM Memo No. 046.
[3] Verified the knowledge is public before posting, See This Public Blog Post on Windows.com
[4] We should probably require citing the exact AI that generated it. I foresee that as an upcoming IP battle in the near future. Plus, as always, there are going to be biases on AI sources that could affect the community as a whole if we don't.
[5] Yet... But I can't convince myself to rule that out at some point in the future, the human brain is only so complex, and technology is surely, albeit slowly, getting there.