62

A large number of contributors have contributed high quality posts over the years on Stack Overflow, and the community collectively moderates to keep the standards of the site high. However, some users end up using other people's contributions and posts without attribution, which results in plagiarism.

At present, users can flag any such post for moderators' attention, and if sufficient evidence is found, then these posts are deleted by the moderators immediately.

However, in this process, the users don't get any immediate feedback, and may tend to continue borrowing other people's content without being aware that it is an incorrect practice, or consciously indulge in plagiarism in an attempt to gain reputation by copying highly-upvoted posts.

To encourage positive behavior and provide immediate feedback to a user, the following changes should be introduced:

  • User loses X* reputation every time one of their posts get deleted by a moderator as a result of a plagiarism flag.

    This reputation loss will be visible to them as

    -X*: Plagiarized content deleted. Please visit help center for more details.

    They should be able to see the link of the post which was deleted, similar to the linked posts we see for every upvote and downvote, and the help center link should lead them to information about plagiarism and guidelines for proper attribution.

    Reputation is a representation of trust, this deduction of reputation will indicate that trust is lost if one indulges in plagiarism.

  • Every post deleted due to plagiarism should count towards post ban.

    The current post ban formula should take the flagged and deleted plagiarized posts of a user into consideration as a parameter, while computing post bans. These deleted plagiarised posts should weigh in even if they have zero or positive score.

    Users who have a high number of plagiarized posts will eventually hit the ban, and work on improving their content.

  • Make posts removed for plagiarism exempt from the >60 day >3 score rule for keeping reputation.

    Users should not retain reputation gained by unfair means. It was never theirs to keep.

These measures will provide immediate feedback for innocent users and restrict those who may, at present, be willing to engage in plagiarism, and will encourage original content.

Thoughts?


* X is a positive integer.

24
  • 16
    Why would it say "duplicate content deleted" instead of "plagiarized content deleted"? Since we have a concept of duplicate questions—and there's absolutely nothing wrong with those—we don't want to confuse people. Otherwise, I think I would support this. We need a no-tolerance policy for plagiarism, but it would also be more effective if it stung a bit.
    – Cody Gray Mod
    Commented Aug 20, 2014 at 14:46
  • 12
    I'd also make posts removed for plagiarism exempt from the >60 day >3 score rule for keeping reputation. This could be done independent of these changes.
    – ChrisF Mod
    Commented Aug 20, 2014 at 14:48
  • 16
    -10 looks like a slap on the wrist to me. Maybe -50 or even -100 would make a better deterrent. Alternately, since often high-quality answers are being plagiarized, subtract from the perpetrator the amount of reputation gained by the original poster for their answer (granted, that can be a bit too much). Commented Aug 20, 2014 at 14:53
  • 17
    What motivated this post?
    – Robert Harvey Mod
    Commented Aug 20, 2014 at 15:25
  • 2
    Are those all your posts that were plagiarized? How do you find the plagiarizations?
    – Robert Harvey Mod
    Commented Aug 20, 2014 at 15:30
  • 1
    Many of those posts are over a year old. It would have been better if we'd caught them earlier. And you do have to catch them. Unless they are somehow flagged or brought to someone's attention, increasing the penalties is all for naught.
    – Robert Harvey Mod
    Commented Aug 20, 2014 at 15:34
  • 1
    @Robert Harvey: Except red flag deletions don't give users a chance to edit their posts to add attribution, etc.
    – BoltClock Mod
    Commented Aug 20, 2014 at 15:38
  • 1
    The existing measures didn't seem effective enough, I checked with Tim in the Tavern, and his answer made me think about proposing a feasible solution Commented Aug 20, 2014 at 15:38
  • 2
    @Robert, wouldn't increased penalties at least curb the number of repeating offenders? In my experience, moderators seldom suspend these users on the first offense (you're nice like that). So at least two cycles of catching > flagging > retaliating are necessary. Commented Aug 20, 2014 at 15:38
  • 20
    I will never not be disturbed by the fact that a significant portion of people out there just don't know that plagiarism is wrong.
    – BoltClock Mod
    Commented Aug 20, 2014 at 15:48
  • 2
    How would the user go about correcting the post and correctly attributing the content after the post was deleted? And would that correction also reverse the 100 rep penalty? It would seem like that would be needed so that the problem can be corrected and the user can learn.
    – Joe W
    Commented Aug 20, 2014 at 16:37
  • 5
    Also one more thing to consider, when looking at two answers on SO where there is a question of plagiarism you don't always know where either user got their answers from. It is possible that user1 could have copied the answer from an external source created by user2. And if user2 later uses work from the external source they manage it might look like user2 copied user1's work when it was originally the other way around.
    – Joe W
    Commented Aug 20, 2014 at 16:43
  • 1
    @Joe W: I imagine those situations will be taken into account if this feature makes it into implementation.
    – BoltClock Mod
    Commented Aug 20, 2014 at 16:44
  • 1
    @Joe, when verifying, I personally always search for post excerpts on Google rather than SO to prevent this. In the eventuality (never happened so far) that both authors are plagiarizing, I would flag both posts. So far, I only found pure-external xor pure-internal occurrences, never a combination of both (but I'm not actively looking for these posts, so YMMV). Commented Aug 20, 2014 at 16:46
  • 4
    This post earned its 1750-rep 'author' a massive 870 dishonest rep that he will never lose. This irritates me. I am hugely in favour of stripping users of rep earned from plagiarism, and further penalties too.
    – Mark Amery
    Commented Oct 29, 2015 at 16:35

1 Answer 1

60

However, in this process, the users don't get any immediate feedback, and may tend to continue borrowing other people's content without being aware that it is an incorrect practice, or consciously indulge in plagiarism in an attempt to gain reputation by copying highly-upvoted posts.

I can tell you that while it isn't obvious to regular users, we send mod messages to almost all people exhibiting patterns of plagiarism. Currently, that message reads like this:

It has come to our attention that several of your answers consisted primarily or entirely of text copied from other answers or websites. We prefer not to simply copy content already available elsewhere in lieu of creating something that adds value to this site specifically.

Whenever possible, we prefer that posts be your own original work, but when a great answer already exists elsewhere, including a small passage of text from another source can be a great way to support your solution. But please note that we require full attribution with a link to the original author, and please be sure you are not copying content without permission.

Thank you, and I look forward to your contributions in the future.

If they continue, we suspend their accounts. Simply being warned about it causes almost all plagiarists to stop, with many apologizing.

I don't think imposing harsher penalties will act as a deterrent, because most plagiarists don't even realize it's a problem, or are the kind who wouldn't keep up with the rules of the site to know that we had such a punishment. Even if all we do is delete their answers and warn them, the message does seem to be received.

Our big problem is early detection of plagiarism, not enforcement once detected. We appreciate the work that some users have been doing in tracking down difficult-to-find instances of this, because it's always a chore to separate really good answers that are new from really good answers that are copied from somewhere else. Proposed solutions for this (matching against all previously left answers on the site to identify duplicates) unfortunately don't scale to a site the size of Stack Overflow, but maybe there are better ways of finding this content earlier.

14
  • 12
    May I gently suggest that, if an offense warrants a mod message, it also warrants a suspension? The first offense is only 7 days. Many users who get mod messages without a suspension simply ignore them, or respond with "f*ck you, I'll do what I want." The suspension adds some consequences.
    – Robert Harvey Mod
    Commented Aug 20, 2014 at 15:42
  • I've also been commenting on posts that I delete for plagiarism, so even if a user isn't exhibiting rampant bad behavior they're getting a note in their inbox.
    – Bill the Lizard Mod
    Commented Aug 20, 2014 at 15:46
  • 25
    @RobertHarvey - For plagiarism, my experience has been that the vast majority read these messages and take them to heart, without the need for account suspension. Many simply don't know that what they've done is wrong, due to different cultural norms. I've even had surprisingly good results from messaging, but not suspending, those who commit a first offense of voting fraud. My goal is behavioral change, more than punishment.
    – Brad Larson Mod
    Commented Aug 20, 2014 at 15:48
  • 1
    I agree with you about behavioral changes. So I replaced 100 with X, even -1 rep(which is less than a downvote on bad content) is fine, if it helps to prevent/discourage the behaviour in future. The old posts will be cleaned sooner or later, but new ones need to be prevented. Commented Aug 20, 2014 at 17:30
  • I guess this is a losing battle if you need to do this manually, just by the sheer numbers of posts you'd need to check. Anyone serious about making this a priority, needs to think about automating the detection. There's tools (mashable.com/2012/08/29/plagiarism-online-services), but I guess there's also budget (time and $). The latter will probably dictate the priority. Commented Aug 21, 2014 at 2:45
  • @RobertHarvey Are you kidding? Do users really respond with "___k you" messages to moderators?
    – 0xdeadbeef
    Commented Aug 21, 2014 at 8:23
  • 2
    @BradLarson To improve the current solution of detection we'd need what's being done at the moment
    – FooBar
    Commented Aug 21, 2014 at 12:11
  • 1
    This post gets my +1. A highly balanced, moderate approach to the problem.
    – code4life
    Commented Aug 21, 2014 at 12:28
  • 2
    @0xdeadbeef About half of them respond with some form of either "it was the other guy's fault" or "you can't tell me what to do." That shouldn't be a surprise, really; pros don't get mod messaged.
    – Robert Harvey Mod
    Commented Aug 21, 2014 at 15:46
  • 4
    @0xdeadbeef: To be fair, Brad puts more effort into reforming people than I do (read: being nice). I personally have had better success with communications that come with some... erm, "corrective action," as my words seem to have no effect on folks without it. I feel that my role as a moderator is to stop the bad behavior first (which the suspension does quite effectively) and then educate (for which I think Meta is better suited).
    – Robert Harvey Mod
    Commented Aug 21, 2014 at 17:28
  • @FooBar - For detection on the SE side, there really isn't any. Moderators deal with it as we or other users come across it, but there's nothing in the system at present to proactively discover it. As I mentioned, the suggestions that have been provided for this do not scale to a site the size of Stack Overflow, so something that could work here would need to be identified first. I don't even know if it's worth the effort to build such a system, given how relatively infrequent plagiarism is. Thousands of plagiarized posts might seem like a huge problem, but that's among 14 million answers.
    – Brad Larson Mod
    Commented Aug 21, 2014 at 17:44
  • @RobertHarvey I wish that some bit of common sense was more common in the world. Needless to say, you guys put in a lot of effort -- in educating users and everything else. Of course, I've seen quite a bit of Brad's posts and those are pretty enlightening. Keep up the good work.
    – 0xdeadbeef
    Commented Aug 21, 2014 at 18:01
  • @RobertHarvey: To be honest I would agree with you if Brad's approach wasn't working. But he says it is, so I feel like it's not necessary to add extra punishment.
    – user541686
    Commented Aug 22, 2014 at 23:15
  • @BradLarson Seems like a case of ignorance to the rules. Perhaps implement plagiarism into the intro/rule page (if it isn't already) or notify newbies before plagiarism is ever committed. A lot of it seems to happen quite a while after the original post so plagiarism is difficult to catch. For verbatim copies [I've had this happen] maybe implement a small "check" when a new post is made. Doesn't seem too difficult to do. How prevalent is plagiarism on SO?
    – www139
    Commented May 25, 2018 at 5:46

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .