220

I'm referencing what these three users are doing:

https://stackoverflow.com/questions/36954611/java-line-spaces-concept-related-to-comma-separated-string

See their profiles, they're answering each other's questions and giving upvotes. I've flagged this for moderator attention (we'll see what happens), but generally, what is the best way to handle stuff like this?

I can totally see it possibly being ignored by a moderator (due to all the other/more important work they have and the fact that those questions/answers can indeed look legit - which is something the posters would go for if they were any smarter) and stuff like this will generate tons of bad content on SO.

Should we have a way to flag users, not just answers and questions?

20
  • 32
    There has been a spike in such voting rings recently:( Commented Apr 30, 2016 at 12:21
  • 1
    @MartinJames any chance bots are doing that?
    – Shomz
    Commented Apr 30, 2016 at 12:22
  • 4
    I suppose it's possible. The mods will have to sort it out, but they are somewhat overloaded with voting fraud ATM:( Commented Apr 30, 2016 at 12:24
  • 99
    Brad the Mod: 'As an FYI, if y'all have been seeing a spike in plagiarized content or absolute crap coming into the site over the last few days, we appear to be getting targeted by a wave of students from the B.V.B. College of Engineering and Technology. They've been posting complete trash en masse, posting tons of plagiarized answers, and have formed a massive voting ring. They tend to cross-answer each other, so be on the lookout for new accounts posting nonsense and getting plagiarized answers. ' Commented Apr 30, 2016 at 12:25
  • 1
    Cool, where did you find that? Can we (or they, the devs) make tighter registration process for those IP addresses?
    – Shomz
    Commented Apr 30, 2016 at 12:26
  • 4
    He posted it in the SOCVR chatroom. Commented Apr 30, 2016 at 12:27
  • 4
    Oh good, I see mods are wiping their account right now.
    – Shomz
    Commented Apr 30, 2016 at 12:38
  • 94
    I can totally see it possibly being ignored by a moderator - err no - this sort of thing is why we're here :)
    – Jon Clements Mod
    Commented Apr 30, 2016 at 12:47
  • 4
    @JonClements Hah, sorry, I was thinking of rephrasing that. I meant due to other work the mods have and the fact that those questions/answers can look legit.
    – Shomz
    Commented Apr 30, 2016 at 12:56
  • 1
    Clustering algorithms + smart humans or PageRank. Commented Apr 30, 2016 at 17:52
  • 11
    Here's one solution a colleague of mine came up with to detect voting rings using HyperLogLog opensourceconnections.com/blog/2013/10/14/…
    – Doug T.
    Commented May 1, 2016 at 1:54
  • 3
    @Charlie, why did you delete your answer? It was a good discussion and those downvotes don't affect your reputation.
    – Shomz
    Commented May 1, 2016 at 2:30
  • 3
    @DougT. Interesting read! Almost more interesting is how you got me to read that without any, ahem, "extortion or even threats of physical harm" ;-)
    – cat
    Commented May 1, 2016 at 16:18
  • 2
    @Shomz: we're smarter than you think.
    – BoltClock Mod
    Commented May 2, 2016 at 12:13
  • 2
    @Shomz: I mean it with regard to the posts looking legit. They usually look too good to be true, which in itself is a red flag for plagiarized content.
    – BoltClock Mod
    Commented May 2, 2016 at 12:19

2 Answers 2

270

As Martin points out, multiple Stack Exchange sites have been hit hard by what appears to be a flood of students from a single university. This started about a month ago over on Computer Science, but has gotten real bad over the last few days on Stack Overflow, Computer Science, and Theoretical Computer Science.

These students have created dozens of accounts (I've deleted over 50 of them in the last couple of days) that dump terrible questions on the site, have other accounts answer them using mostly plagiarized content, and then vote in a tight ring to hugely inflate the votes on these posts. The amount of plagiarized content they have posted on this site, CS, CS Theory, Hinduism, Travel, and others is just disgusting. For a brief period on Thursday, the entire front page of CS Theory was made of posts by these folks.

Multiple members of this ring were warned and suspended a month ago when this started, and yet they continue to do so, so we are now deleting their new accounts at the first indication of any shenanigans. A broad range of IPs related to these students have been blocked, and we're feeding any new accounts into the anti-trolling system to extend these IP blocks, but they appear to be trying to actively work around them.

I don't know what their endgame is, but until they tire of this be on the lookout for new accounts that have associated accounts on CS or CS Theory that are cross-answering each other, getting suspicious amounts of upvotes, and / or posting obviously plagiarized content. If they don't have an associated CS or CS Theory account, they're most likely not part of this ring, because that's their signature.

Sorry to everyone in the Close Votes or Low Quality Posts queue that has had to review this stuff, as I've seen quite a few flags from reviewers on this.

34
  • 4
    Perfect, thank you! Do you think it might be a good idea to delegate some of that stuff to the community (us), say, by giving high-rep members right to (almost) directly deal with those users?
    – Shomz
    Commented Apr 30, 2016 at 13:04
  • 27
    @Shomz - Deleting the accounts and their content is a fast process. The hard part is identification. Providing flags for users abusing the site and matching the profile described above is how people can help. There's also voting to close and downvoting terrible questions and identifying original sources of plagiarized content. Stack Overflow's done a great job of this so far, and most people haven't noticed. If you do have an account capable of voting on CS or CS Theory, maybe volunteer a little extra time to help them out. They're taking the brunt of this.
    – Brad Larson Mod
    Commented Apr 30, 2016 at 13:13
  • 111
    have you tried reaching out to their university? I can't imagine their university wants to get a reputation for "that university whos immature students once tried to damage SO". They might want to help educate their students about the proper behavior. Or not. But reaching out can#t hurt, can it?
    – Polygnome
    Commented Apr 30, 2016 at 15:38
  • 128
    @Polygnome - Last time something of this scale happened: meta.stackexchange.com/a/53807/135615 I recall that someone from SE wrote the chancellor and informed them that the entire university would be completely banned from SO (not just post-banned, but blocked from even reading the site) if this didn't stop. That seemed to be pretty effective then.
    – Brad Larson Mod
    Commented Apr 30, 2016 at 15:52
  • 16
    @BradLarson Then why don't you even do the same thing to this university? Commented Apr 30, 2016 at 15:59
  • 153
    I wonder if some professors attempted to encourage students to be active on StackOverflow and offered extra credit to students who can show an account with high reputation.
    – Akavall
    Commented Apr 30, 2016 at 17:49
  • 5
    Ugh! Thanks for staying on top of this even on the weekend, Brad. This kind of collusion to distort post scores is an Achilles' heel for SO.
    – jscs
    Commented Apr 30, 2016 at 19:16
  • 17
    RE endgame: SO and some sister sites are huge in their industries now. If I could get a high rep on Stack Overflow it'd be quite easy to get a programming job. I am certain some low quality, target-hitting professors or learning providers would be actively encouraging learners to accumulate rep on SO to get a programming job. Sadly, if it gets too prevalent, and blagging job-hunters turn out to be full of brown stuff, employers will no longer consider SO rep as an interesting factor when hiring, which could have all sorts of negative affects for SE and its users in the long term.
    – Dom
    Commented Apr 30, 2016 at 20:27
  • 13
    @Dom: "If I could get a high rep on Stack Overflow it'd be quite easy to get a programming job." What? I'm not sure I would want to work for someone who used SO rep into account for hiring purposes... Commented Apr 30, 2016 at 21:15
  • 38
    @NicolBolas Well a lot of employers are interested if you have rep on SO. I doubt they'd hold it against you if you didn't, but when you do it shows you can explain well and help your less experienced team mates; which is an attractive attribute for leadership positions. If you were an active, positively contributing user, I don't know why you wouldn't want them to take the countless hours you've volunteered into consideration. It's not required, but it helps, and I'm sure plenty of SO's users are at least partially motivated by it.
    – Dom
    Commented Apr 30, 2016 at 21:46
  • 15
    A big thank-you to everyone who is working to catch and prevent this toxic behavior. Stack Exchange sites thrive on a community that helps each other, and reputation should reflect that. Get those bad actors out! Commented May 1, 2016 at 1:48
  • 6
    As a student at a prestigious university taking a well-known computer science class, I frequently encounter questions directly ripped from the homework assignments on here by other students in the same class or equivalent classes with the same textbook. My policy in the past has been to down vote, flag as homework, and then write an answer which explains the theory without just providing the lines of code to fix it, so they can figure it out themselves. Is that the correct approach? Commented May 1, 2016 at 19:50
  • 5
    @MaxvonHippel, that could be a new question on Meta in its own right! I think that's a reasonable response. Some others just downvote and then don't answer (why act as an enabler for homework dumps?). Vote to close if appropriate. Finally, you might consider informing the instructor; I suspect many instructors might appreciate knowing about it.
    – D.W.
    Commented May 1, 2016 at 19:58
  • 4
    @emery - That's a new question, but I've talked about this in a couple of places: meta.stackoverflow.com/a/285871/19679 meta.stackoverflow.com/a/299784/19679 . We recognize code snippets get reused, and generally we don't consider that plagiarism. The plagiarism I'm referring to here is the word-for-word copying of answers, Wikipedia entries, other websites, even Facebook and LinkedIn posts. People arrive at the same code by chance, and copy it around. There are always other ways to word things, so copying that is clearly plagiarism.
    – Brad Larson Mod
    Commented May 2, 2016 at 18:13
  • 17
    Dont know if this will be read or not but I attended a similar school in India and the CS department wanted us to have SO accounts with a high rep so that it looks good on the resume when on campus hire season is on. Luckily no one had the brains to create upvote rings.
    – letsc
    Commented May 2, 2016 at 22:09
14

I like the way SO/SE are user moderated and that over time individuals becomes trusted and gain greater permissions. Though it would be worthwhile thinking about the underlying architecture of trust and identifying individuals / groups that are abusing the trust structure.

A suggestion on how to identify these groups of individuals, is to use a graph database like neo4j of questions / answers / users which will show certain users having a high affinity to other users.

If there is too high a correlation then you could automatically disallow some up votes. You would still want overall manual control and the ability to override, but this would allow individuals to be flagged.

Edit: You could argue that this is a fraudulent type behaviour, and thus could be detected and engaged with using modern data analytic fraud techniques. It is quite possible that these types of tools exist, but perhaps their specifics are hidden from lower level users to improve their effectiveness.

7
  • 20
    Stack Overflow has systems in place to detect voting rings. One issue is users who are active in "small" tags - tags for technologies that only a few people here use. They may run into each other's answers often and legimately vote for each other's answers. Commented May 3, 2016 at 12:39
  • 3
    very true. users working in low volume tags are more likely to be overlapping, though you can add extra analytics to look at other aspects, first login/signup date, location, etc which will give extra information. I'm in the Datascience side of things and these are the types of techniques we use in fraud detection.
    – Marcus D
    Commented May 3, 2016 at 12:44
  • 10
    In response to your edit: Stack Overflows fraud detection schemes are hidden from all users. To prevent users from gaming them. Only some of the Stack Overflow employees know them. Commented May 3, 2016 at 12:48
  • 4
    @S.L.Barth Not only within "small" tags. Even within large tags [C#] for instance, developers will build up specialities (for example, I often find myself upvoting Stephen Cleary in C#, simply because he is one of the best within async).
    – Aron
    Commented May 6, 2016 at 8:39
  • 1
    @Aron Yes, I too keep bumping into the same 10-12 people in the [java] tag. (Not that I mind but I feel like I almost know them personally :)), and they usually already gave the answer I wanted to give, so I just vote instead. But I'm sure it can still be told apart (relying on the extra data Marcus is alluding to, for example) from a voting ring.
    – biziclop
    Commented Jul 21, 2016 at 9:24
  • 1
    @biziclop That's a very interesting social phenomena. I feel almost the same with people I only know from answers on SO. Commented Feb 2, 2017 at 9:21
  • @S.L. Barth I think the right way towards a correct detection of these voting patterns is to use a graph database for posts, as reported in Marcus D. 's answer. Assume we have a weighted multigraph in which nodes represent users and and arrow A -> B represents A voting some B's post. Would it be a good idea to run algorithms to detect, say, strongly connected components, measure their weight and discriminating legal/illegal situations accordingly, for example, to the popularity of the topic and other criteria?
    – Alberto
    Commented Nov 23, 2019 at 7:42

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .