8

https://stackoverflow.com/review/low-quality-posts/5050600

And for those who can't see the original content:

I did get a warning that the system thinks the answer is spam, but I chose "Looks OK" because it answers the question and links to a blog post with additional information.

Then it turned out to be an audit and I failed it.

23
  • 6
    It looks like a clear-cut link-only answer to me Jun 13, 2014 at 8:18
  • 9
    When all a user does is post links to their own blog, it is overt self-promotion -> spam. When I see a 'late answer' or 'first post' that is both a link-only answer, I always wonder what the user affiliation is with that link.
    – Martijn Pieters Mod
    Jun 13, 2014 at 8:19
  • 2
    @JanDvorak It does answer the question, the link is for additional information.
    – user247702
    Jun 13, 2014 at 8:19
  • 2
    Perhaps the user has a broader history of posting similar content, triggering spam flags on all of it.
    – Bart
    Jun 13, 2014 at 8:20
  • @MartijnPieters Linking to own blog is fine if you don't do it in a majority of your answers Jun 13, 2014 at 8:20
  • It's a bit iffy though @Stijn. Removing the link, all you're left with is "In my case I have deleted other virtual machines". I might have held off on the spam flag if it was an isolated instance, but it doesn't provide much of an answer.
    – Bart
    Jun 13, 2014 at 8:22
  • @Bart if that's all what's needed to solve the problem, what else should there be in the answer? It's straight to the point.
    – user247702
    Jun 13, 2014 at 8:23
  • There are 8 steps in the blog post @Stijn ...
    – Bart
    Jun 13, 2014 at 8:24
  • @JanDvorak: nope, I know that, but that's why you check and verify that it isn't all a user does.
    – Martijn Pieters Mod
    Jun 13, 2014 at 8:24
  • @Bart 8 possible solutions, not 8 steps.
    – user247702
    Jun 13, 2014 at 8:25
  • 4
    @MartijnPieters the problem is, once they do get removed, a check of the user's profile reveals no evidence of such misconduct (unless the profile gets deleted or has no answers) Jun 13, 2014 at 8:26
  • @JanDvorak: I agree that in this specific case, the situation isn't cut and dry. Automated audit picking can sometimes pick a bad example. Note that this account has no answers, so you could have detected that this is an audit because you checked the user account.
    – Martijn Pieters Mod
    Jun 13, 2014 at 8:30
  • @MartijnPieters should moderators have a way to exclude posts deleted as spam from audit selection? Jun 13, 2014 at 8:31
  • @JanDvorak: only after the fact, perhaps. They have their work cut out as it is with keeping junk of the site without having to check if something suitable for audits too. The problem is bigger with First Post and Close audit questions that were bad examples, and we can vote those down to take them out of consideration, posts like these are harder to remove from the pool.
    – Martijn Pieters Mod
    Jun 13, 2014 at 8:32
  • 2
    @CatalinDeaconescu: I don't know if it was self promotion here, as we have too little context. I'm more saying that I am very suspicious and jaded; spammers have used every trick in the book, plus invented some more, to avoid detection. Without further context, this doesn't look like spam to me, no, which is why it is a bad audit post.
    – Martijn Pieters Mod
    Jun 13, 2014 at 12:13

1 Answer 1

15

So that's an interesting case. It was flagged as both "not an answer" and spam by different users. It was flagged at a time when there weren't many moderators active on the site, so one of us didn't act on the spam flag.

Instead, it was automatically deleted from review: https://stackoverflow.com/review/low-quality-posts/4952811 after receiving enough delete votes (for being a link-based answer). That deletion immediately validated both the "not an answer" and spam flags.

I would have declined or dismissed the spam flag on that, because this doesn't fit the pattern of traditional spam. It's a user posting a link to an older tutorial, and not an obvious attempt to spam a blog or product. I don't see abusive behavior here.

That said, this still would have become an audit case because of the validated "not an answer" flag on it. We've been instructed to remove "see this tutorial" answers when flagged, and validate the flags on them. While I don't necessarily agree that all such answers should be deleted, the community has spoken and decided these answers are not appropriate here.

I'm a little concerned about audit cases being identified from automatically validated flags in the Low Quality Posts review queue, particularly spam and offensive flags. Perhaps the system should leave those to be acted on by moderators when a post is deleted by a community vote like this. Maybe validation of flags by non-moderator actions shouldn't cause something to be used as an audit case. I don't have the stats to see if this is a real problem, but moderators were instructed to be strict with these flags, and the community doesn't have that kind of guidance.

4
  • I think it's not an interesting case at all, but plain mistake in the algorithm that picks "known bad" audits which apparently should ignore any answer that isn't "verified" by 20K / diamond delete vote. Deletion by review is hardly a reliable indication, given that most of (30,000) reviewers in the VLQ queue aren't really expected to have level of understanding sufficient to produce audits
    – gnat
    Jun 16, 2014 at 17:34
  • 1
    @gnat - Thus the last paragraph. The way that audits are assigned was built at a time when only moderators handled these flags. Now that normal community members are, does this cause a problem? Given that this isn't the first case I've seen of this, maybe, but a dev might be able to show that this is a rare case.
    – Brad Larson Mod
    Jun 16, 2014 at 19:17
  • Having found your answer, I won't post a new question about it, but please do something about it. Here's another example. Jun 18, 2014 at 21:14
  • @LevLevitsky - Yeah, that was spam-flagged and it was accepted when the user themselves deleted their answer. That should not have been approved, since it was a malicious flag from another user to attack that answer. I've cleared the spam flag so this won't be used as an audit again. Sorry about the bad audit, and thanks for pointing this out.
    – Brad Larson Mod
    Jun 18, 2014 at 21:19

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .