Skip to main content
1 of 5
starball
  • 47.9k
  • 5
  • 58
  • 141

Are titles written with assistance edited more or less often by community members?

I'm glad this is going to be looked at.

But be careful about how much you try to infer from title edits happening when evaluating "success" (know the limitations)

  • No community-made title edit does not necessarily mean the title is as good as it gets (it can just mean nobody cared enough to improve it (yet)).

  • A community-made title edit

    • Does not mean the question asker could have known how to do better given their knowledge and best effort.

      There's always a knowledge gap when you need to ask a question. And that knowledge gap can lead to overly specific / generalizable (to no fault of the asker's) or overly general questions (and their titles).

    • Does not mean whatever technology you're using to suggest titles could have done better.

      I think this follows from the above point. Assuming you generate titles primarily based on the post body, and overly general post body (needing details/clarity) will usually correlate with an overly general title, and so with generalizable post body. Unless you plan on solving that problem with this same technology (how?), "garbage in, garbage out".

      There is one scenario (that is actually somewhat common) where I'd be happy to see if this is helpful: Questions where the title is too general/ambiguous, but the body contains information that can be used to disambiguate the title.

Just to make this a little more concrete, here's are some examples:

  • Question asks about a problem with using library X, Y, and Z and TypeScript. Turns out the problem doesn't have anything to do with specifics of library X, Y, or Z, and is really just to do with TypeScript and perhaps dependency-related things with TypeScript in general. (Question can be further generalized -> edit to generalize)

  • Question title asks about a problem with using CMake. Question body elaborates on the problem being related to an attempt to do something with a specific library dependency. Problem turns out to have to do with specifics of that library. (Question title is ambiguous -> disambiguate title)

Why does this matter? Ambiguous titles are annoying to future readers looking through search results. "Oh this looks related. Wait- after reading the full Q&A, it's really not. Darn (wasted time)". Questions with room for generalization will show up for fewer readers looking through search results (they'll never find something that could have helped them).

This is also why I made a related suggestion in my MSE answer- to incorporate community-made title edits into the model's training. Take information about community-made title edits as an opportunity to train something that could possibly have some usefulness with respect to generality problems.

Going deeper into my thoughts here but kind of sidetracking now: My general preference would be that when a question asker doesn't know whether their question/problem can generalize in a certain way, they try to err on the side of being too specific and giving too much contextual info. It's easier for the community of subject-matter-experts to generalize questions (remove unnecessary information) than go through the process of soliciting missing information.

starball
  • 47.9k
  • 5
  • 58
  • 141