59

At the suggestion of a Mod in chat, I'm putting out a call for help in flagging the chaos in the answers which I (and several others) have noticed.

I'm not an expert in this area, but even I can see the obvious, multiple, very-low-quality and duplicate answers being posted on many of the questions in that tag. It's a bit of an odd look for Stack Overflow, honestly. We're (usually) much more curated than this.

I've done some flagging in this area, but:

  1. It's a time-consuming slog, and I could use some help
  2. Someone with more expertise here will be able to cull more answers than I can, especially when comparing SQL queries that may essentially be duplicates of each other.
  3. Spreading the work out will (hopefully) keep any one person from going insane ;-)
  4. If we can get this cleaned up quickly, I can get back to focusing on flagging AI answers (1,450+ flags and counting).

Some additional notes if you are willing to help:

  • As the Mod who responded to my other flags reminded me, also use downvotes as appropriate when flagging. If we get a number of downvotes on each answer, that can also be a sign that it's already been handled/flagged and doesn't need our attention.

  • Don't get overly zealous (of course) - As always, if a post legitimately seems to improve upon existing answers, it likely has value. And, of course, the first post with the info should probably get priority if it's of reasonable quality.

    I only say this because it can be too easy to get carried away when handling literally dozens (or hundreds) of these.

  • Many of the questions, as well, appear off-topic and should be VTC'd. IMHO, installing or configuring a database extension isn't a "programming" topic.

  • Special thanks to @GeneralGrievance and @AndrewT in the comments for discovering that there may be an undisclosed affiliation in many of them. BOLO for these and flag appropriately.

  • Keep an eye out for AI-generated answers as well. While the major problem here is just VLQ's/duplicates, some are AI-generated. Follow the user-profile to see if they have a history of AI answers and flag those appropriately as well if you would. Honestly - This is part of the reason it's such a slog for me, as I often get pulled on a half-dozen rabbit trails in each of these questions.

Also, for any Mod reading this, in addition to curation of the content itself, it seems to me that some users could use warnings on the VLQ nature of their posts

Some examples:

And many more ...

28
  • 1
    "At least 5 answers that say, *"use age instead of age-server" there is 7 answers total. That means 71% are just the same.
    – VLAZ
    Commented Aug 30, 2023 at 13:53
  • 9
    «10 answers, all of which essentially say, "No"». This is weird. Commented Aug 30, 2023 at 14:00
  • 8
    @AndreasismovingtoCodidact Yes, the whole situation is weird. I just don't understand what is driving these duplicate/VLQ answers in this particular tag. Commented Aug 30, 2023 at 14:03
  • 1
    I (who is monitoring the [postgresql] tag) too noticed an influx of low-quality questions and answers related to [apache-age], to the point where I stopped ignoring them (mostly because I don't know the project and am not interested in it). Did they pull some popularity stunt that caused this sudden increase over the last months? Is it limited to a certain region of the world?
    – Bergi
    Commented Aug 30, 2023 at 14:59
  • 5
    My personal experience is with the question Does the Apache Age database support multiple versions of the PostgreSQL protocol, including the extended query protocol?, which got 9 answers but has barely 140 views. Why is this simple question (which is not motivated by a particular use case) so popular? I don't get it.
    – Bergi
    Commented Aug 30, 2023 at 15:03
  • 1
    For someone who wants to move to graph databases and is looking at evaluating AGE, this is a bit concerning. Wouldn't know where to even begin, though.
    – Makoto
    Commented Aug 30, 2023 at 15:21
  • 6
    Hm... a lot of same users doing this. Might be good to check for voting-rings/sockpuppet accounts too. Commented Aug 30, 2023 at 15:28
  • 2
    @GeneralGrievance One of my first thoughts, and I did identify one voting ring out of it a while back. However, most of the answers aren't even upvoted! Commented Aug 30, 2023 at 15:30
  • 10
    The general weirdness around Apache AGE isn't new music. I've done cleanup rounds more than once, but apparently the deluge never stops. Glad that this is now a publicly known issue.
    – blackgreen Mod
    Commented Aug 30, 2023 at 22:25
  • 2
    On what conditions should we flag posts with dev.to links? I feel like this could get messy without a mod involved. Commented Aug 31, 2023 at 13:46
  • 1
    @TylerH What about the authors that are interns but link to other employees' posts? Would that be a custom flag for non-overt affiliation? Commented Aug 31, 2023 at 14:27
  • 3
  • 1
    @QBrute I don't think so. More likely DavidW's comment would explain it. That or a bot is doing a convincing job imitating this behavior. Commented Sep 1, 2023 at 15:05
  • 2
    @PeterMortensen just pulled out questions and answers and think I've invalidated my hypothesis. I don't see any clustering by date (of the question or answer) nor does there seem to be any obvious groups of users in a graph where edges are drawn between question and answer OwnerUserIds
    – Sam Mason
    Commented Sep 2, 2023 at 14:23
  • 2

2 Answers 2

46

Strange pattern indeed. As some of us have noted, there's a lot of repeat users answering these questions. At first, I thought that there could have been voting fraud. However, NotTheDr01ds pointed out that a lot of these posts don't ever get upvoted, so it's unlikely to be the full story, though there does seem to be some involved.

Still, I thought this was weird, so I decided to Google two of them together, and I found that they are active contributors on dev.to under the #postgres tag. With the two I searched, they both turned out to be interns at Bitnine, the original owners of Apache AGE. Visiting a few more profiles, I saw several other employees or interns.

Andrew T. then noticed in a comment that there were several posts (Updated after some cleanup) under the tag that linked to dev.to articles and stated that they may be spamming/astroturfing here on SO. In response, I started looking at each of these answers and their authors. I tried to visit one post from every unique author of an answer.

Findings:

  • Total posts visited: 24
  • Confirmed Interns/Employees at Bitnine: 19. 18 interns, 1 associate developer.
  • Profiles indicate recent/pending graduation, or internship of some kind: 22

Notes:

  • Most, but not all of these linked to dev.to posts that were written by the author of the SO answers, and that I sometimes had to search dev.to directly to find the matching authors.
  • It is also just a slice of the posts written by these users. Not everything they post here has a link.
  • I think it's unlikely that these actions are motivated purely by self-promotion of their articles or SO reputation, but astroturfing for Bitnine/Apache AGE sounds very plausible.
  • I don't have actual stats on this, but several users posting these repeat answers even without links also have accounts indicating internships at Bitnine.
7
  • 19
    My view is that this is probably mostly exploitative by Bitnine - they've clearly decided to outsource their development mainly to a bunch of interns who are mainly motivated by the possibility of getting a job (although I doubt any or many jobs are really on offer). It's all fairly odd, but to me it feels really sketchy by Bitnine and I just feel a bit sorry for the interns. It doesn't change the fact that a lot of the content doesn't belong on Stack Overflow of course.
    – DavidW
    Commented Aug 30, 2023 at 21:27
  • I expect this is similar to the astroturfing that goes on with apache-iotdb. Every few months I go on a flagging/downvote spree but it's impossible to keep up with it all.
    – miken32
    Commented Aug 31, 2023 at 19:44
  • 2
    Also, one of them has even put the tag on a totally unrelated question and is hashtagging every single answer posted. Commented Aug 31, 2023 at 20:04
  • 3
    @GeneralGrievance Maybe they're just (ab)using StackOverflow's [apache-age] as a forum for their interns? Someone should reach out to them and recommend getting a private Team for that…
    – Bergi
    Commented Aug 31, 2023 at 20:08
  • 2
    It was viewed 158 times (till date) and got 12 answers. Isn't that an unusual conversion rate? Commented Aug 31, 2023 at 20:18
  • 1
    @PeterMortensen If you mean the ratio, then yes, for sure. A lot of other questions with this tag have similar characteristics. Commented Sep 1, 2023 at 13:40
  • 4
    Slight rabbit hole/update: Of the 20 top-answerers of all time, I found evidence that 15 of them have some kind of affiliation with Bitnine (some are a little sneaky about it), mostly through LinkedIn or Dev.to. I don't think there's nothing wrong with working for a company and posting here, but of course our posting guidelines do still apply. Commented Sep 1, 2023 at 15:03
15

Here's a SEDE query that shows the questions sorted by number of answers if you'd like to tackle the potential low-hanging fruit first.

On the downside, it will (hopefully) quickly become out-of-date as duplicates are culled.

2
  • 6
    Was just having a look at some of the answers and they're basically comments. There is one user who has 71 undeleted answers, 67 in that tag, and only 10 have a score > 0. 10 also have a score < 0 (so they have 51 zero score answers). Blargh.
    – Thom A
    Commented Aug 30, 2023 at 17:06
  • 2
    @ThomA Yup - Blargh, along with "Despair" and "chaos", are really the nicest things we can say about it :-) Commented Aug 30, 2023 at 17:26

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .