Skip to main content
2 of 5
added 1219 characters in body
starball
  • 47.9k
  • 5
  • 58
  • 141

Are titles written with assistance edited more or less often by community members?

I'm glad this is going to be looked at.

But be careful about how much you try to infer from title edits happening when evaluating "success" (know the limitations)

  • No community-made title edit does not necessarily mean the title is as good as it gets (it can just mean nobody cared enough to improve it (yet)).

  • A community-made title edit

    • Does not mean the question asker could have known how to do better given their knowledge and best effort.

      There's always a knowledge gap when you need to ask a question. And that knowledge gap can lead to overly specific / generalizable (to no fault of the asker's) or overly general questions (and their titles).

    • Does not mean whatever technology you're using to suggest titles could have done better.

      I think this follows from the above point. Assuming you generate titles primarily based on the post body, and overly general post body (needing details/clarity) will usually correlate with an overly general title, and so with generalizable post body. Unless you plan on solving that problem with this same technology (how?), "garbage in, garbage out".

      There is one scenario (that is actually somewhat common) where I'd be happy to see if this is helpful: Questions where the title is too general/ambiguous, but the body contains information that can be used to disambiguate the title.

Just to make this a little more concrete, here's are some examples:

  • Question asks about a problem with using library X, Y, and Z and TypeScript. Turns out the problem doesn't have anything to do with specifics of library X, Y, or Z, and is really just to do with TypeScript and perhaps dependency-related things with TypeScript in general. (Question can be further generalized -> edit to generalize)

  • Question title asks about a problem with using CMake. Question body elaborates on the problem being related to an attempt to do something with a specific library dependency. Problem turns out to have to do with specifics of that library. (Question title is ambiguous -> disambiguate title)

Why does this matter? Ambiguous titles are annoying to future readers looking through search results. "Oh this looks related. Wait- after reading the full Q&A, it's really not. Darn (wasted time)". Questions with room for generalization will show up for fewer readers looking through search results (they'll never find something that could have helped them).

This is also why I made a related suggestion in my MSE answer- to incorporate community-made title edits into the model's training. Take information about community-made title edits as an opportunity to train something that could possibly have some usefulness with respect to generality problems.

Going deeper into my thoughts here but kind of sidetracking now: My general preference would be that when a question asker doesn't know whether their question/problem can generalize in a certain way, they try to err on the side of being too specific and giving too much contextual info. It's easier for the community of subject-matter-experts to generalize questions (remove unnecessary information) than go through the process of soliciting missing information.

Okay, maybe I should qualify the above statement a bit better. Providing too much context is something I want askers to do after trying to narrow down the cause of their problem as much as possible. And that's a related problem here. I avoid popular programming language tags because there's such a high concentration of highly-application-specific my-code-isn't-working questions that are like geodes: Inside all the application-specific context is probably hiding a generalized question that is more applicable (and therefore valuable) to the masses. We want the gems inside the geodes (unless we already found them before (duplicates)), and in this analogy, the "gems" are actually quite easy to title in a way that is clear and not ambiguous, whereas that's difficult to do with the "geodes" (application-specific questions lacking effort to narrow down the problem). To make this more concrete, I'm talking about questions like "why isn't my sudoku program working? <code dump>". How do you title that in a way that isn't ambiguous (name-clashing with all other peoples' problems that have to do with broken sudoku programs?) TL;DR the limitations and "garbage in, garbage out" problems go even deeper.

And that just brings me back to something I've been thinking for a while and over and over: I think we should do more to promote reading the Help Center pages- the same pages that show good and bad examples of titles and give guidance on how to write good titles, and the same pages that say "Eliminate any issues that aren't relevant to the problem.", and "The more code there is to go through, the less likely people can find your problem. Streamline your example in one of two ways: Restart from scratch. [...], Divide and conquer. [...]."

starball
  • 47.9k
  • 5
  • 58
  • 141