Skip to main content
added 328 characters in body
Source Link
Travis J
  • 82.2k
  • 25
  • 208
  • 323

In addition, there are a lot of well articulated concerns regarding abuse of the automatic reopening feature here in other answers. I would expect those to be addressed as well prior to this releasing.

Perhaps instead of fully re-opening, the post could simply enter the reopen queue only needing one vote to be reopened.

In addition, there are a lot of well articulated concerns regarding abuse of the automatic reopening feature here in other answers. I would expect those to be addressed as well prior to this releasing.

Perhaps instead of fully re-opening, the post could simply enter the reopen queue only needing one vote to be reopened.

Source Link
Travis J
  • 82.2k
  • 25
  • 208
  • 323

    I have been discussing this topic for nearly 7 years now, so this post is long because of that and because it includes a lot of reference that people seem to always ask for in recent discussions I have taken place in on this subject. Closure is quintessential to the exchange, so I will not be cutting any detail corners here.

RE: Updates to close/off topic dialogue reasons

The closure system here is outdated.

    The first design was implemented and stood for half a decade before only being altered with a change to the reason verbiage. Only recently has there been any sort of progress on updating this system, which I applaud. The change to 3 close votes seems to be going over well.

The current set of close reasons is problematic

    It is clear that Stack Overflow is famous for its collection of high quality content. It is also clear that adding to that content has become problematic. A facet of that is that we have become so hyper focused on only allowing perfection that the availability of new content is vastly diminished. We need to unleash the creative effort of answerers.

In curtailing questions with a set of close reasons that focuses on as narrow a question as possible with only a single distinct answer that is easily and demonstrably correct we have closed the door to everything else that should be on topic. There is absolutely no reason for questions to be pigeonholed into those which only have 1 answer, and the drive towards ensuring that "on topic" means "questions with 1 answer" has led to a steep decline in not only question to answer ratios but also to questions without answers or without accepted answers.

For a while now there has been more focus on curating a library more than building the library. Instead of building a tall, all encompassing sky scraper of content, we are building a pyramid. Each piece added makes the remaining pieces available smaller until there are no longer any pieces that can be added, and only a thin golden lining is allowed to cover the topmost portion. Meanwhile, there is a still the production of perfect bricks forming an unending multi-million brick line approaching the pyramid.

This is what we have all been observing, in slow motion. Piece by piece the pyramid builds, and the remaining potential dwindles. This is something that should change. We change it by removing the barriers that limit the potential of content. These barriers are the currently narrow topic defined by the set of close reasons.

These barriers were put in place with good intentions, however, they have not had their intended effect. The reason we need a sky scraper instead of a pyramid is because of external search engines. The pyramid makes sense when you have to take a long stairway, but we don't have to traverse each brick to get to where we need to be - there is an elevator. The library we are building has the advantage of external search providing access to the most relevant content. This means that posts with low views are not in the way, as they are dismissed by the search engine themselves; as evidenced by the low views themselves. We need to stop preventing content solely in order to prevent low view content.


Improving the closure experience, a timeline

    The last time we changed close reasons was 2013, during one of the original welcoming initiatives. The mindset was that explaining in more detail to users why their question was closed would make the process less jarring. So, for the sake of clarity, the reasons were changed...

There was an internal dialog that was discussing how to improve the closure experience for users.

duplicates

"we're taking a look at closing behavior and trying to figure out how to make it less jarring for new users. Our goals are (1) to make it clear to people why their question got closed and (2) to make it obvious what they can do to fix it or get better (3) in order to reduce the likelihood of getting into an argument about whether this should have been closed. We started with dupes." states David Fullerton♦

This was in early (February) 2013. They started with duplicate closures, and made some small progress.

"off topic"

    By March (still '13), the team had moved on to addressing "off topic" concerns. Their main goals for improving "off topic" were

  • clarity - we want to make it as clear as possible to the OP exactly what makes their post off-topic to minimize frustration and reduce the misperception that they’re just being “picked on for being a noob”
  • improvement - we want the language and workflow to encourage editing wherever possible (and in particular, to make improving a post seem more logical than arguing that it shouldn’t have been closed.)
  • accessibility - we need to convey that information with as little dependence on other sources (FAQ, etc.) as possible

Help us make “Off-Topic” close reasons clearer to the OP

    It was decided that "Each site needs their own reasons for closing questions as "off topic". Once a number of predefined "off topic" close reasons has been chosen, anyone voting to close as off topic may now use these reasons for clarifying their vote."

Unfortunately this effort turned out to be a large contributor to the problem over time that we now face. While the "improvement" section was accomplished by making an easier workflow for use, accessibility became worse and clarity suffered in certain situations.

By June, during the implementation of some of these updates, the goal for accessibility was dropped. "The idea is that the new help center (formerly the FAQ) will cover all these "sound like our topic, but not allowed for this site" things, and then the top ones will also be reflected in the About page ("do" and "don't" section) and in the custom OT reasons."

"Not a Real Question" and "Not Constructive"

    As a result of the discussion for "off topic", the team also decided to address NARQ and NC in March ('13). At each step of this process, it was clearly acknowledged that the existing set of close reasons worked, so the new ones would need to accomplish the same coverage.

Well, we want to continue to close the questions these currently are used for, but we need to make the feedback clearer, and incentivize improvement (or at least learning). Here's what we came up with:

Eliminate "Not Constructive" and "Not a Real Question", and replace them with more specific reasons:

unclear what you’re asking — Please clarify your specific problem or add additional details to highlight exactly what you need. As it's currently written, it’s hard to tell exactly what you're asking.

too broad — There are either too many possible answers, or good answers would be too long for this format. Please add details to narrow the answer set or to isolate an issue that can be answered in a few paragraphs.

primarily opinion-based — Many good questions generate some degree of opinion based on expert experience, but answers to this question will tend to be almost entirely based on opinions, rather than facts, references, or specific expertise.

While the reasons themselves were clear, the coverage expanded to more posts further limiting "on topic", especially with the inclusion of Too Broad and Opinion-Based. The strict interpretation of too broad and opinion-based flies directly in the face of the intent of the site. Subjective questions are perhaps some of the most important material on the site, and they are being actively prevented - we literally have subject matter experts twiddling their thumbs now, just look at the decrease in answering rates from the top users.

Too Localized

    If you read this far, you probably remember too localized. If not, I wont make you read these 1000+ posts on the subject, and will just give a brief overview because this was also an important tool that the community used.

Too localized had problems, and it was improperly used all the time. That aside, the times it was used properly was important to the health of the site and removing that part of the tool is still causing problems today.

too localized — This question is unlikely to ever help any future visitors; it is only relevant to a small geographic area, a specific moment in time, or an extraordinarily narrow situation that is not generally applicable to the worldwide audience of the internet.

The community needed, and actively needs now, part of this close reason. The part which applies to closing a question which is simply requesting how to make part of the code work. In other words, a fix or implementation which is extremely specific, only applies to the asker's circumstance, and is highly unlikely it could be reused elsewhere.

Right now, users have to simply stare at these posts, perhaps downvote, and wait for roomba to get them. Roomba does get these. All the time.


Improving the closure system

    There needs to be a change in direction here. The barriers put in place to stem low quality questions has not been effective, and worse, has prevented or limited the creation of higher quality content.

In addition, we need to use distinct close reasons, as opposed to wide sweeping ones. If the close reason cannot be summed up in a single sentence that a 5 year old understands, then it needs to be refactored. Each close reason also needs to come with a single sentence that a 5 year old understand with how to fix it if it can be fixed.

Subject matter experts need to be able to partake in questions in which the answer is based on facts, references, or specific expertise. This was the top request for an appropriate question Stack Overflow should support when it started in 2008.

Questions intended to resolve a specific programming problem that have multiple possible answers. As with this answer, but the “correct” response is subjective.

So to, the original guidance was to abide by 3 main checkpoints

  1. detailed and specific
  2. written clearly and simply
  3. of interest to at least one other programmer somewhere

We need to go in the direction of allowing the types of questions that will garner the attention of experts, while still of course stemming the tide of posts simply requesting the community to do all the work or those which clearly misunderstand the platform.

While education can help with the understanding issue, only close reasons can help both stem the tide and encourage subject experts.

Aligning our current set of close reasons with the original guidance will allow us to accomplish these goals.

The goal of this project is to update existing close workflows with a streamlined system which is easier to understand and follow for all users and results in fewer negative interactions between them.

I believe that the stated goal here aligns with the outlook of encouraging subject experts and discouraging misguided or advantageous users.

Loosen the restrictions on what is defined as broad and opinion based

  • Remove Needs More Focus: While Too Broad was redefined as "Needs More Focus", its text still reflects the issue of requiring a one answer question. "Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer". We need to be encouraging answers, and while Focus is important, all that this really needed was detail. This close reason should be removed.

While the details reason can cover the issue of lacking detail here, the secondary part of the close reason "Avoid asking multiple distinct questions at once" is now lacking. This is easy to fix though, because it can just be its own reason. We need more close reasons, not less.

  • Add "Asks too many disparate questions": Avoid asking multiple distinct questions at once. Edit this to remove questions which can be asked in their own post.

  • Remove "Needs details or clarity": The issue with the details close reason is that it still doesn't provide a path for fixing the issue aside from only showing the negative issues present, and it covers two situations. This close reason should be removed in order for two distinct close reasons to take its place.

  • Add "Needs details": There are not enough details provided to answer this question. Please edit this question with additional details to highlight exactly what you need.

  • Add "Needs clarity": As it's currently written, it's hard to tell exactly what you're asking. Edit the question to clarify your specific problem.

There is a clear trend that is forming here, which is the intent. The user must edit their post as the result of the closure. To note, regardless of what the interim is called, these are still "close" votes.

Opinionated needs to be fully remodeled. We want material which is based on specific expertise, however, often posts are closed which include any level of opinion. This unfortunate situation has grown to the point where good subjective questions no longer even show up due to the knee jerk reaction of the "jackbooted heel of justice".

  • Edit "Opinion-based": This question is asking for general opinions. Edit the question to address facts, references, or specific expertise.

"Off topic"

    Off topic is a misnomer in its current use. Debugging issues, non reproducible issues, example issues... these are all on topic, but there is some sort of problem with the question in that it needs additional refinement in order to be answerable. Debugging and typos need to be removed from this category altogether.

  • Move "It's seeking debugging help but needs more information. The question should be updated to include desired behavior, a specific problem or error, and the shortest code necessary to reproduce the problem." from off topic and place it in the global category.

Alternatively, introduce a new category called "Site Specific Concerns" or similarly named category, which can be used by individual exchanges to specifically outline cases such as these. There should also be a way for the community moderators to manage these.

The typo / non reproducible reason needs to be split as well. It also needs to go in either the broad category, or the Site Specific Concerns category.

  • Remove It's caused by a typo or problem that can no longer be reproduced.

  • Add "Caused by a typo."

  • Add "This problem can no longer be reproduced. Edit the question to show to reproduce the issue."

This new category area should also be open to new reasons.

For example, when someone just shows a list of 1.2.3.4 of an assignment or a todo note that they are supposed to accomplish.

  • Add "Only a list of requirements. Edit the question to show what issue was encountered with the specific requirements shown."

RE: 1. Close UX improvements

"We'd like to reconceive "closed" as "hidden"" is a fine agenda as far as wanting it to be gentler on people to have it happen to them. However, the label isn't he issue. The process is. Many people feel pushed out the door when they have a large amount of downvotes on a post and it then gets "closed". Or even when it is "on hold".

The verbiage is a problem here in the meantime prior to the question closure. These are close votes, so calling it closure is appropriate, and so is [closed]. That is a finality that is only reached when the OP stops responding.

Prior to that though, and as noted with the theme of requiring edits above, the process before [closed] should really be called [requires editing], because that is the honest truth. Those questions, for the most part, require editing in order to reopen. Pushing these users towards editing, and attentiveness, will only help them not feel like they are being pushed out the door.

I like the email idea, and the focus on editing here in general, so just go all the way and label it what it really is: requiring edits from the OP.

RE: 2. Edit UX Improvements

Yes.

RE: 3. Automatic Reopening

So long as the automatic reopening is only in response to the asker editing. Sometimes there are significant efforts by community members to clean up questions, and those should not trigger questions to be automatically reopened.