22

While reviewing I recently came across two answers that were technically correct in themselves but didn't really answer their questions. To avoid the Meta Effect, I'm not linking them here, but I can if it should be necessary.

  • The first question was how a few batch commands could be executed in C#, but the posted answer showed an example using PowerShell instead.

  • The second question asked how to avoid if (someVar == null) to prevent Null Reference Exceptions and the answer was to use if (null == someVar).

Since in some sense they at least tried to answer, I flagged them as Very Low Quality. Both flags were declined, in case of the first

a moderator reviewed your flag, but found no evidence to support it

was given as the reason, for the second question the reason given was

Code only answers are downvote worthy, not flag worthy. Please note that flags should not be used to indicate technical inaccuracies, or an altogether wrong answer

What would have been the right course of action in those cases?

1
  • 3
    Worth noting that on popular questions I occasionally see answers which, while they don't technically answer the question the OP asked, do answer the question all the people reaching the question from Google really came for. These answers often are quite useful IMO, and as a result tend to be highly upvoted (despite not technically answering the OP's question).
    – Ajedi32
    Commented Aug 29, 2017 at 14:12

4 Answers 4

25

If an answer does not answer the question, it is "not useful" as an answer and should be downvoted. You may also leave a comment along the lines "this is a valid suggestion but as an answer it works for some other question", but beware of revenge downvotes.

Flagging as NAA is definitely wrong (as it tries to answer), flagging VLQ may be ok or get declined as you've seen (VLQ is more about link-only/half line of text).

19
  • 9
  • 1
    This is wrong, see @Braiam response, you guys endlessly run around in circles with this question (what to do when some one one answers something that isn't the question), the correct answer is the custom flag this, because this moderator doesn't see/doesn't have enough time to actually see the context of the question, and needs to know it violates not fundamentally answering the question despite the fact it is an answer. The fact that it was declined doesn't mean that moderator isn't wrong, it indicates that it is impractical to verify it wasn't an answer to the question on the flag alone
    – Krupip
    Commented Aug 29, 2017 at 13:26
  • 1
    @Braiam Yes, those answers may be removed via delete votes from 20k+ users. This answer is absolutely correct that they should not be flagged and should instead be downvoted. Yeah a note about delete votes would be nice, but it is unnecessary as I'm sure anyone who had delete votes would cast them in such a case.
    – user4639281
    Commented Aug 29, 2017 at 14:17
  • 1
    Which moves us to the next point: 20k users aren't omnipresent. They need the community to bring these issues to them. The 10ker flag queue was supposed to do exactly that, just that it was used for something else since it appeared at 10k instead of 20k.
    – Braiam
    Commented Aug 29, 2017 at 14:19
  • @Braiaim as I have said countless times before, trying to fix the system by encouraging it's misuses does not actually work. I know that is hard to believe, but it just doesn't. If you want to change the system, make a suggestion and let the community vote on it. Spreading patently false advice is only ever going to make the situation worse, not better.
    – user4639281
    Commented Aug 29, 2017 at 14:25
  • 1
    @TinyGiant In this circumstance, the answers OP are referring to might actually be answers to the question, but no in general, we should not be relying on 20k users to randomly happen uppon these answers. We aren't talking about if the user actually answers the question, but is wrong, we are talking about if the user doesn't actually address the question.
    – Krupip
    Commented Aug 29, 2017 at 14:25
  • 1
    @snb I am aware that is what we're talking about, and that does not change any of my arguments. These answers should not ever be flagged. They should be downvoted, and voted for deletion if applicable.
    – user4639281
    Commented Aug 29, 2017 at 14:27
  • 2
    @TinyGiant Well apparently others disagree with your assertion that they shouldn't, CodyGray says "For example, if I was reviewing a NAA flag on a PowerShell answer to a batch question, there's a fairly good chance I would delete it, on the grounds that the answer isn't even in the same ballpark as the question." So no, I don't think you are correct that we shouldn't be flagging these types of answers, or that it is against the rules. I think not flagging or encouraging others to not flag these answers hurts the site.
    – Krupip
    Commented Aug 29, 2017 at 14:31
  • 1
    This problem of A language resulting in B effective outcome will always persist until the NAA flag dialogue is updated from "does not attempt to answer the question" to something else. Because some people think it means NAA is valid for answers that don't answer the question asked by OP, while the community has decided it is valid only for answers that aren't an answer to any possible question, which are two very different things.
    – TylerH
    Commented Aug 29, 2017 at 15:03
  • @snb Cody didn't say that they should be flagged. He said that if one was flagged and he reviewed the flag, then he might delete it even though it shouldn't have been flagged. See A minor change to the description of the “not an answer” flag: “the question” → “a question” for more discussion on the topic. There are countless posts to reference that all support not flagging these posts.
    – user4639281
    Commented Aug 29, 2017 at 15:08
  • One: (as cody mentions) moderators are not expected to be subject matter experts, so should not be expected to determine whether an answer is a applicable to the question asked. Two: NaA flags are reviewed out of context. Unless a moderator explicitly chooses to view the question, all they see is the answer. Three: Flags are just not the right way to deal with these answers. Downvotes and delete votes are a much better means of dealing with them because 1) a post must get below a given score to be delete voted, and delete votes require more trust from the community to obtain than flags.
    – user4639281
    Commented Aug 29, 2017 at 15:13
  • Ultimately the point is that these answers are answers, and technically correct, so it should require more skin in the game to delete than posts that are not actually answers and should be cleaned up as fast as humanly possible. Answers that "don't answer the question asked" are not actively harmful and as such do not need to be deleted as soon as humanly possible.
    – user4639281
    Commented Aug 29, 2017 at 15:15
  • 1
    @TinyGiant And there are countless references supporting flagging these questions even in your link, heck the accepted answer is a critique of the conclusion that they shouldn't be flagged. Additionally Cody never said that "if it doesn't answer the question it shouldn't be flagged" at best he said that if you want to be on the safe side, you have the option of not handling flagging these edge cases... This debate comes up again and again and again, its never been resolved as you state.
    – Krupip
    Commented Aug 29, 2017 at 15:15
  • 1
    That is a critique, even if you choose not to look at it that way, it displays the absurdity of leaving these piles of trash everywhere, and "your answer is in another castle" debates link only answers, and even then, there is massive contention in that thread (look at the top rated post...), and your "when to flag an answer as not an answer" supports my point, if it doesn't attempt to answer the question you can flag it!
    – Krupip
    Commented Aug 29, 2017 at 15:23
  • 1
    @TinyGiant I'm sorry I have a different point of view than you? No need to use personal attacks here. Just because I don't share your opinion doesn't mean I'm trying to "twist anything to support my point"
    – Krupip
    Commented Aug 29, 2017 at 15:26
16

Opinions vary on this, and it gets complicated because both regular community members and diamond moderators can (and do) process low quality flags (NAA and VLQ).

The way it's supposed to work is that regular members of the community evaluate posts flagged for either of these reasons in the Low Quality Posts (LQP) review queue. However, if they don't handle them fast enough and/or there are too many for the community to handle (because there aren't enough reviewers actively reviewing), then they show up on the moderator dashboard, and we will process them.

Community members looking at flags in the LQP review queue can evaluate the flagged posts as they see fit, and have a bit more leeway than moderators do. For example, while moderators are not supposed to assess the technical veracity of an answer (because moderators are not and cannot be expected to be experts in all technologies that are on-topic for Stack Overflow), expert community members who are reviewing are encouraged to do so. This is why we give users with moderator privileges delete votes, and why three delete votes from such users will remove an answer that they deem to be useless.

Naturally, though, when the post goes through a review queue that is open to a large section of our user base, opinions will vary on how the post should be handled.

Even among diamond moderators, there are some minor variations in how such flags are interpreted and processed.

For example, if I was reviewing a NAA flag on a PowerShell answer to a batch question, there's a fairly good chance I would delete it, on the grounds that the answer isn't even in the same ballpark as the question. I see this as distinct from assessing technical merit (which I do not do as a moderator); it is plainly obvious to any observer that the answer is not an answer because it is answering an entirely different question. (There are exceptions to this. If the answer says, "You cannot do this in a batch file, but there is a solution in PowerShell" or "Using PowerShell would be better because…", then that would obviously be an answer and it should not be deleted. You can tell this by reading the answer in context of the question. Again, opinions differ on whether NAA flags should be processed in that manner, or whether the answer should be considered independently to see if it just looks/reads like an answer to a hypothetical question.)

Obviously the moderator who processed your flag doesn't feel the same way I do. Or maybe it wasn't quite as clear cut as you make it out to be. Or maybe the moderator just didn't look carefully enough at the question. You might be able to head this problem off by raising a custom flag and providing more explanation. Don't rely on "not an answer" to be enough of a clue that the answer is regarding an entirely different language than the question; tell them that explicitly.

There are, of course, general guidelines for interpreting and using NAA and VLQ flags, but that doesn't eliminate the reality of varied opinions and judgment calls. Nor should it, in my opinion. There's a reason we have humans review posts: we want them to use their brains.

If you want to always be on the safe side with flags, then you won't be able to flag "edge cases", and you'll need to stick strictly with obvious cases that fit neatly into the established and universally agreed-upon buckets. If, on the other hand, you're more interested in quality and don't mind a few declined flags here and there due to differences of opinion, then feel free to flag anything that you think is actively harmful to the site and needs to be deleted.


Looking at your examples in a bit more detail…

In the first case, although you sensibly avoided linking to the exact answer, it is very likely the case that the answer was attempting to recommend PowerShell as a preferable alternative to invoking batch commands from C#, and that would (as stated above) constitute a valid answer. In fact, in my technical opinion, it would even constitute a correct answer (even though, again, that's not supposed to be a relevant criterion).

In the second case, the answer to use a Yoda condition was just a regular old wrong answer, and those are supposed to be downvoted, rather than flagged. Perhaps the answerer misunderstood the question, and you could alleviate that confusion (perhaps even prompting them to delete their own answer and earn a Peer Pressure badge) by leaving a comment to that end. If you have sufficient privileges, feel free to cast a delete vote on useless answers (but you don't have these privileges—not yet). You almost certainly should not flag it, though, as >95% of scenarios will end in such a flag being declined.

In the case of a "code-only" answer, to which you allude, these should not be flagged. Now, I very much sympathize with the urge to flag them as "very low quality", because I also consider code-only answers to be "very low quality". However, you have to think about what flags actually do. See this answer for a more detailed explanation of why flags aren't suitable in such cases.

3
  • Some people are taking your answer to mean that these answers should in-fact be flagged. That isn't what I get from your answer, but that may need some clarifying.
    – user4639281
    Commented Aug 29, 2017 at 15:35
  • @Tiny Thanks for the heads-up, I guess. That was why I added the last section. Should I...make the answer longer?
    – Cody Gray Mod
    Commented Aug 29, 2017 at 15:38
  • 1
    Looking at the comments above, I see the context for the confusion. I actually would be fine with a flag on the first answer if it's really as irrelevant as is implied here. I do not agree with changing the wording of the flag from "the question" to "a question". I think that's nonsense. But I will tell you that I am not the only moderator who processes flags, so if you care about having a flag declined and might be upset if that happens, I recommend not flagging these, because other moderators might decline them. (Dunno for sure, haven't taken a poll.)
    – Cody Gray Mod
    Commented Aug 29, 2017 at 15:40
-3

This discussion reappears over time. If answer attempts to answer the question it's a valid answer, even if it fails at it's goal. There is a downvote button to mark answer as not useful, if you find it such.

However, many times answers that touch the bigger picture or add technical details have been very useful to me. The question asked was the top Google result in my search. However, my question was slightly different. If it wasn't for the other answer, I'd be lost.

The question you should ask yourself is whether it's more important to pedantically delete any comment/answer that isn't 100% related to question, or if you want Stack Overflow to be good resource for programmers.

-15

This open ended question invites discussion and opinion. I'll offer mine.

Answering your last question first (What would have been the right course of action...), I would like to see a moderator give us a definitive answer. They can explain why or why they don't agree with the opinions expressed here and tell us what their expectation is.

As for the question in your title (How to deal with answers...), I agree with Alexei that a down vote is appropriate, if you feel that a vote is necessary. If the comment is valid and not worthy of a down vote, may I suggest a neutral vote by way of no vote at all? This would neither increase nor decrease the reputation of the poster. Nothing says you have to vote up or down.

Now the real art of handling an improper answer is in creating an entertaining comment to follow it. You don't want to come across as a jerk who says, "You dumba$$, that doesn't remotely provide any help!" The other readers of the thread will not appreciate a crude or sarcastic comment.

If you can provide a better answer, by all means do so! If you don't know the answer, but want to try to help clarify the direction of the thread, I suggest using humor for two reasons.

  1. It will entertain the readers and make the forum a more enjoyable place.
  2. You can make your point without being insulting.

Both of these will help preserve and enhance your own reputation.

That's my opinion. I enjoy your discussion.

3
  • 4
    You may want to check out meta.stackoverflow.com/questions/308441/… before proposing something that really against SO policy... Also you may be mixing "comment" and "answer" which are two very different concepts on SO - some edit to clarify meaning of "If the comment is valid and not worthy of a down vote" would help (you can't downvote comments on SO). Commented Aug 29, 2017 at 2:05
  • Side note: also check out meta.stackoverflow.com/questions/328379/… to review guidance on "thank you" text in the posts. Commented Aug 29, 2017 at 2:10
  • 3
    We don't really need a diamond moderator to give a definitive answer to this: Very Low Quality flags are handled by community members with sufficient rep (I can't recall the number required for VLQ tags) not just diamond mods and we do have a consensus on when to use this flag.
    – BSMP
    Commented Aug 29, 2017 at 3:17

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .