26

I recently had a couple NAA flags declined on some link-only answers (they really were, but I don't really want to make this about a few cases unless really necessary) with:

declined - Please don't flag posts based on SEDE queries.

Which is exactly what I was doing (well, from a search, but it's essentially the same. This search, to be exact. I'd hand-validate each post before flagging, and got some gems like (10k): this, this, and this)

I'm curious about this. Is it policy? Should it be? What can I do in the future to avoid this (while having the posts taken care of in some way, if possible)?

2
  • 1
    To answer your final question, "What can I do in the future to avoid this?", the obvious answer is "don't do what you were doing"; the rest, meh. You were possibly correct, but I can see how NAA flags on 3 year old posts might get annoying, however valid.
    – Ben
    Commented Nov 13, 2014 at 23:57
  • 1
    related: Hide “not an answer” and “very low quality” flags in the moderator flag queue (if only LQ reviewers were given a better chance to handle these flags...)
    – gnat
    Commented Nov 16, 2014 at 21:51

3 Answers 3

32

You didn't flag them as 'very low quality', you flagged them as 'not an answer', but that's tangential.

Among the issues with your flags is that you were literally flagging posts that were years old.

You flagged 35 posts in the span of 5 minutes; with most of those flags mere seconds apart. 4 were declined to get your attention to stop; So having a 31/35 accept rate isn't bad.

If you didn't use an SEDE query or a google search to generate these flags, I apologize -- but from the moderator console you were rapidly filling up our queue by posts that all had the same format:

I hope this helps you <link>

The reason we say not to use SEDE to auto-flag posts is three-fold:

  1. Flagging old posts is secondary to fixing the current problems on the site. We get thousands of questions a day, that's where we need your help.

  2. If there are a lot of posts that exhibit certain characteristics, you should raise a meta question and ask for a feature to be implemented so that these posts can be nipped in the bud automatically.

  3. There are a lot of flags in the moderator queue at any given time; you got lucky in that we had just cleared the queue. You were also unlucky in that we had just cleared the queue an it was really apparent you were using some sort of tool to find these problem posts.

We prefer that you flag organically. If you don't want to do that, then make it easier on all of us and ask to have the software improved through a programmatic means where you're not asking Moderators to intervene in years old answers just because 'they should be cleaned up'.

8
  • 5
    In addition to the above, it's also our experience that SEDE queries tend to get abused for flagging items. A few responsible users will run these queries, read each of the items that come up, and flag the ones that really need our attention. Others then use these queries and start blindly flagging everything that comes up, which ends up wasting a lot of time and burying the signal in piles of noise.
    – Brad Larson Mod
    Commented Nov 14, 2014 at 2:33
  • 6
    The recent anti-plagiarism queries were a good example of these done right: people read the posts, identified the material they were copied from, and we were able to process those rapidly. On the flip side, another group started running queries for answers under a certain length and flagged every one of those that came up as "very low quality", no matter if they were good answers or not. That was less helpful.
    – Brad Larson Mod
    Commented Nov 14, 2014 at 2:36
  • 2
    I'm all for you flagging with the help of SEDE queries. But 35 NAA flags within 5 minutes seems to be a little overkill. Not saying you weren't doing this, but always make sure to read the question and answer. Lots of questions ask for a link only, so it's best just to close the question rather than delete an answer that was asked for.
    – CRABOLO
    Commented Nov 14, 2014 at 9:08
  • 1
    Thanks @Brad, and mod team for processing the plagiarism flags so fast despite the volume of flags. Commented Nov 15, 2014 at 14:52
  • @damryfbfnetsi We don't encourage it because with our volume, we seldom have less than hundreds of flags in the queue. We have enough of a backlog and enough daily traffic that it's a full time job just to keep up with what's coming in, let alone the old stuff.
    – George Stocker Mod
    Commented Nov 16, 2014 at 20:25
  • I disagree with #1 as a generalized point. This is a long-term knowledge base. Particularly on high-score/view-count posts, the impact of things that should be flagged is worth multiple-times the impact of the average of each and every new single thing that comes up every day.
    – starball
    Commented Jul 14, 2023 at 1:55
  • Point #2 does not seem to have aged very well. I do not see recent cases of old, fairly simple high-impact, proposals for automatic prevention of flag-worthy things getting dev time or even company attention. Ex. Automatically recognize and remove "thanks". I made one such proposal myself: Make short "saved my <time>" comments single-flag-deletable and went and did the legwork of the SEDE analysis. silence.
    – starball
    Commented Jul 14, 2023 at 2:01
  • I also find it irksome that the things I spend all my 100 post flags on as they pop up every day (I.e. new flagworthy things) are easily toolable, such as new non-answers on old question. Dharman has a bot, and there's also Natty. Why isn't the system doing things about this? These are not new problems, nor are they problems that are difficult to get sizable positive changes on. If the problem is that the flags are too much for the mods alone, then that's a solvable problem too.
    – starball
    Commented Jul 14, 2023 at 2:07
21

Consider two scenarios:

  1. You are walking down the street and see a dead cat in the gutter.
  2. You are blazing a new trail in a remote part of a city park and see a dead cat under an overhang.

Under which scenario are you most likely to call your local Bureau of Sanitation for dead animal collection?

Flagging is a bit like calling your city's waste disposal service. The idea is to clean up eyesores before they cause problems. An answer that you stumble upon while using the site is very likely to be noticed by others. But using some sort of search to turn up non-answers is likely to be looking for problems that might never be noticed.

I can see the argument that trash is trash and we should clean it up even if it never causes problems. But it's not always clear what should be done about link-only answers. For instance, your query turns up answers (such as this one) that seem to be useful. Sure it's a link to another page that might not exist in the future and the OP couldn't make it work, but the answer and comments are breadcrumbs that just might help someone else with the same problem. Maybe it should be converted to a comment. Maybe it should be edited into shape. Maybe the answer is wrong and needs to be downvoted. Maybe it's really spam and should be deleted. By flagging an answer like this, you are asking someone else to make that judgement call for you.

Diamond moderators have been entrusted with a great deal of authority to make difficult decisions. On Stack Overflow, it's not uncommon to see individual moderators handle hundreds of flags in a week. (This past week one broke 1,000 and another 2,500!) Each of those decisions take a little bit of time and a little bit of mental energy to make. So unless you are finding really obvious problems of the discount-handbag-spam variety, flagging old posts probably isn't worth the total effort expended. By using up a finite resource (moderator time) you might be actively harming the site as a whole.

2
  • 8
    Sounds like a convincing argument to channel those flags to a Low Quality Review Queue instead of moderators.
    – user3717023
    Commented Nov 14, 2014 at 1:33
  • discount-handbag-post links can be posted in the tavern too, so that the burden of nuking spam is shared by the community members. Tavern nukes some spam posts once in a while. Commented Nov 15, 2014 at 15:00
1

Can I flag posts from SEDE or a search in bulk if they're low quality?

Answers rarely fit the low quality flag. However, many answers do fit the Not An Answer flag.. which in turn sends most of those flags to the Low Quality Queue.

So, yes, you can use SEDE to search for answers that are Not An Answer. Please read and understand Shog9's official post on when an answer is not an answer, before ever using SEDE to search for Not an Answer posts. The last thing we want is many bad answers which are in fact answers, ending up in that queue and being mistakenly deleted by robo-reviewers.

Use SEDE as a tool to help find the Not An Answer posts. Don't use it as the only means to determine if something is Not An Answer. Make sure to read the question. Make sure to read the answer. If your not sure, either re-read them and then make your decision, or just let it be and don't flag.


Honestly though, there have been so many answers deleted for Not An Answer within the last few months, that I think we already got most of them. So I'd stick with searching for only newer answers, like within the last month or so.


Some/most mods are against using SEDE queries for clean ups like this for reasons already stated in their answers here. I can definitely see their points, but I don't agree that responsible users shouldn't use the SEDE for this. The fact is that Stack Overflow is moderated by the community. Not just mods. Most of these NAA flags don't have to involve a mod and use up their time. Most can be handled without them anyways.

I have noticed that maybe the workload in the SO mod queues is becoming too much too often. So maybe it would be good to have another election sometime soon to lighten the work load for each individual mod?

1
  • I don't agree with the "have elections and get more mods" part. Commented Nov 16, 2014 at 11:02

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .