We're excited to share that we've launched a new suite of tools to help users and moderators on Stack Overflow handle plagiarized questions, answers, and articles. We've been working on this in collaboration with the community here and moderators, who got a preview of the UI and gave us a lot of helpful feedback in early February. For more background on this, please see the prior discussions on Meta Stack Exchange:
- We need a dedicated plagiarism flag
- Feedback request: Proposed new flagging and moderation workflow for plagiarism
The (long) TL;DR is that we're adding:
- New flag type - "Plagiarized content" - for questions, answers, and articles
- Flag handling UI for moderators and other minor UI improvements for users' flagged posts page
- Automatic removal of reputation for old, high-scoring posts deleted as plagiarism (while deleted)
- Post notices to identify plagiarized content (while deleted) and guide authors on how to fix it
- Post history notices when posts are flagged or deleted as plagiarism
Flagging UI - a new flag type
When a user finds a post that is plagiarized and wants to raise a flag, they've had to use the "In need of moderator intervention" option. This results in slow handling of non-plagiarism moderator intervention flags as mods aren't able to separate out plagiarism flags to focus on. As such, we're adding a new flag reason for plagiarism. It'll be the last standard flag reason.
In this form, both fields are required, but the link does not have to be a URL. That being said, URLs are highly encouraged as it's difficult for a moderator to confirm the content is plagiarized if they can not see the original source.
Moderator Flag handling
Posts flagged for this reason will appear as a separate flag type in the flag dashboard for moderators and give them plagiarism-specific options to handle the flag, which is the same whether the flags are being handled on the mod dashboard or directly on the post.
Per mod feedback, we wanted to keep the behavior as consistent as possible with the current behavior and avoid surprising mods when they're handling these flags.
- They have the new option "Delete as plagiarism" which will delete the post, mark the flag helpful, and remove the reputation earned for the post, even if it would otherwise have been retained.
- Marking a flag as "helpful" will validate the flag but not delete the post, mods may explain their reasons for marking helpful.
- Declining the flag will remove it and the moderator will need to explain their reasoning for declining the flag.
- Using the standard UI deletion buttons will cause the post to be deleted normally.
To avoid removing content that might be particularly useful and worth fixing rather than deleting, we will be showing a notice to mods in the following cases:
- Answers: top-scoring answer with a score of >3
- Questions: score of >3 that is still open
These will look like this:
We did get feedback from some moderators that this might slow down their actions and get in the way. However, we believe that the changes we've made to only show this in specific cases will make it less likely to be shown unless the post is truly valuable and will only appear in cases where the user would lose reputation they wouldn't have otherwise lost.
We'll definitely be considering this carefully to see how frequently it appears and whether it does cause issues for moderators.
Moderators flagging posts for plagiarism
Moderators can also flag the post as plagiarism if they come across it without it having been flagged by a user - which is common in cases of mass plagiarism by one user across many of their posts. Doing so will raise a flag but not immediately handle it, so this will be a two-step process. The mod will first raise the flag to mark the post as plagiarism and then handle it.
This is a place where we got a lot of feedback from the mods about concerns regarding slowing down the process. We understand the concerns and we've decided to ship this as a two-step process primarily because we wanted to avoid surprising mods. While it's true that spam and rude flags immediately handle the flag and delete the post, "moderator attention" flags do not, so there's not one consistent behavior. Because these flags resemble mod attention flags more closely, we're opting to start out with the two-step process and see what the experience is like directly.
Additionally, the process can get somewhat unwieldy when you add together all of the elements into a single step. We have to tack on a bunch of additional checks before the deletion actually goes through - mostly relating to the special casing for removing reputation when posts are deleted as plagiarism and the warnings we're showing in the cases described above.
Post notices and post history
Posts deleted as plagiarism will get a post notice indicating the reason for deletion that is visible to both high-reputation users and the OP, though there are two variations depending on who's seeing the notice.
The OP will see a longer explanation (first one below). This has links to various guidance about why the post was deleted, how to properly cite information, and encourages the OP to edit the post to improve it (opens the editor).
The shorter variation is shown to moderators and anyone else who can see the deleted post.
Unlike most deleted post notices, these do not attribute the deletion to anyone in particular. This is similar to how we're not showing the list of close voters to the asker in the post notice.
We discussed having a link to the original content in these post notices as that was one of the asks for this but decided not to include it in this variation. When we were working on the designs for this, we weren't sure how to display the link, particularly in cases where there isn't one or there are multiple links without opening a can of worms of complexity. If we see this isn't working, we can always consider improving that workflow.
Additionally, we've ensured that post history events for both the deletion and flagging are clear and easy to read for whoever can see them. The flag history event includes the flag type and both the flag fields while the deletion reason says "as plagiarism". As with other post history events, plagiarism deletions are attributed to the moderator who deleted the post.
Launch and feedback
Between community discussion, moderator review, and internal testing, we're confident that you will all find the new plagiarism workflow a significant improvement from the existing system. We will also consider updates as we release and gather feedback. Once live, we hope you will use it when necessary and let us know about your experience - both positive and negative - in the answers below.
If you run into any bugs, please do your best to explain them along with how to reproduce them if possible. If you are struggling with the new workflow, please help us understand your difficulties by talking about the problems you're having rather than focusing too much on solutions. As I've mentioned a couple of times in this post, we expect we may run into some places where this process isn't optimized and we're willing to make improvements where necessary.
Thanks!
A huge amount of gratitude goes out to the moderators here on SO for helping us understand the problems and know how to support these changes. We also appreciate all of the community members who have been giving feedback throughout this process. Thanks so much for your patience while we got this planned and built.
Also, this project couldn't have been done without the support of the awesome Community Enablement pod, who focus on building tools for Mods and CMs. The PM, designers, devs and other team members have done an amazing job digging into and understanding the needs of this project. Thanks and credit for so much of this goes to them! Also to Bella_Blue, my partner in plagiarism on the CM team for working with me to communicate so much of this to you all.