I recently came across some suspicious (plain nonsense) answers sharing the same characteristics:
The pattern
- all answers have arbitrary code snippets – remotely matching the topic: e.g SVG, JS, HTML etc
- no explanation/description
- there is no response to comments
- all these responses were posted at short intervals
Why this strategy is quite "clever" or efficient
- answers with snippets appear unsuspicious for members reviewing flagged posts in a review chain
- the text length is OK so the community bot won't find an obvious issue
seriously: do we always thoroughly test every posted code?As commented by @TylerH we should always pay attention to details when reviewing and should't be tricked by at first-glance "plausible" code
Flagging
I already flagged these via custom In need of moderator intervention
option.
It's perfectly clear that we must be very cautious before assuming a user may be a Bot/AI or Spammer with malicious intententions.
It's also clear, moderators can't always evaluate if an answer is
- "just not great/very helpful" but not harmful – the community should decide via downvotes
very-low-quality
(imho, the most quirky/ambigious flagging category)not an answer
(usually quite obvious, if the answer raises a new question or doesn't provide a new solution)Spam
(actually not always easy to distinguish from lackluster "link-only" answers)
But I'm 100% sure we're facing a new (or maybe not that new) Bot/AI strategy based on circumventing the current SO heuristics which are mainly focused on missing code examples, too short text content or just indications of spam.
Problems with the current flagging system
- report text length limit is too low: It is quite tricky, to report a more complex issue precisely within the current limits. Here is my report pretty cramped into the allowed text length:
Bot: The (nonsense) answers by user:26995695 never include any description/explanation but always includes a "remotely" plausible snippet (see also previously rejected flag for user:20786021). These snippets completely ignore present OP's code examples – even snippets – you would usually refer to as a human community member. It's a new bot strategy to circumvent common heuristics (too short description, no code)! Please investigate on it.
While keeping reports as concise as possible is obviously a good idea – it makes reporting rather complex issues overly complicated – especially if you're not a native speaker.
Suggestions
- tweak the publishing requirement: When posting a new answer, the system may require at least some portions of non-code text. If an answer is code-only the form may simply reject submission. This may also have the benefit to better detect Bot/AI generated content due to characteristic wording patterns (e.g we can pretty easily detect chatGPT answers this way)
- increase text limit for custom flags (as explained before)
- snippet-IDs Maybe SO snippets could introduce something like a snippet ID/hash. This meta-data ID would only be appended to a snippet markdown if the snippet was inserted via the snippet editor. If a newer (2024) post without any description doesn't contain this metadata the community bot could at least return some alert
- Extra flag for suspected AI/Bot content This could add more focus on generative content spam ideally in the review chain. So if a post is flagged as "Potential AI/Bot-content" community members revising this (hypothetical new) review chain could pay more attention to the characteristics of automated content generation
Incentives for community based moderation?
This may deserve its own post, but there is a lot of talk about incentives for new users to post a question. Perhaps SO/Stack Exchange should consider "rewarding" members for spotting and removing bad content.
Referring to @gnat's comment downvote penalties should be removed:
AFAIK, when a post I previously downvoted gets deleted I receive a "payback" as described here "https://meta.stackoverflow.com/questions/261651/does-deleting-questions-with-negative-vote-undo-the-negative-rep-lost"
However, we may also reward all
- users contributing to the deletion of harmful/misleading post may be rewarded with 1+ reputation
Admittedly, this may also introduce new misuse scenarios.
While I'm not an AI hater – it is quite obvious we are increasingly spammed by Bot/AI generated "content"
Examples
React injecting iframe with max z-index on reload after changes (development)
Border removing, using inline script which is included within file
How to scale svg to viewport, but keep aspect ratio on filled image
How do I go about making an SVG image accessible to screen readers by using the aria-*
Highcharts adds duplicate xmlns attribute to SVG element in IE
Admittedly the described answers are not harmful by means of spreading spam. What do you think?