26

On Meta, has been synonymized with , but when I go to its tag page, there are only 7 questions listed when I know that there were way more questions with the chatgpt tag alone.

Sure enough, there are some questions that are tagged but cannot be found by either [chatgpt] or [ai-generated-content]. Here are two examples:

  1. How can we determine whether an answer used ChatGPT?
  2. Does the policy change for AI-generated content affect users who (want to) flag such content?

Both of these questions have the tag but when you click that tag, it redirects to a page titled "Questions tagged [ai-generated-content]" which doesn't list these questions.

Moreover, trying to search for these questions using the following search terms does not return them (even after the "fix" by @kristinalustig):


Also using a userID to filter posts do not work here either. Note that the userID of the author of the first question above is user:6619250. So a search using this userID along with [chatgpt] or [ai-generated-content] should return that question. However, the following searches return no results:

I first noticed it on the main site which severely limits finding posts that have tags that are synonymized with others.


How do we search for questions once their tags are synonymized with other tags?

10
  • I see 65 questions under meta.stackoverflow.com/questions/tagged/ai-generated-content so that might be a caching issue on your end. Commented Oct 31, 2023 at 17:51
  • 4
    I do only see 7, not 65, so it's certainly not client caching (today being the first time i've visited that page)
    – Kevin B
    Commented Oct 31, 2023 at 17:53
  • 9
    Both comments are correct. Depends on which tab/ordering you're looking at - on Newest, it shows 7, while on Active and Score, it shows 65. It doesn't seem to matter whether you visit through the synonym tag or its target.
    – VLAZ
    Commented Oct 31, 2023 at 18:19
  • 4
    We had meant to put together a bug report when this came up. But it got lost in the shuffle. Synonyms and search are broken and there is no way to use search to discover these questions.
    – Henry Ecker Mod
    Commented Oct 31, 2023 at 18:23
  • 1
  • @HenryEcker It is interesting that your query returns 917 tags while the query based on Tags.Count returns 951 tags. For example, adaptive-dialogs, agile-central, base-r are not shown in your query. And the tag synonyms where the target tag does not exist are a completely separate case.
    – Martin
    Commented Jun 30 at 14:41
  • @HenryEcker If you think it a bug, then please edit to using the bug tag prior to adding a status-review tag to the question. Adding the status-review tag while it's tagged support asks an employee to answer the support question, rather than process the ticket as a bug and route it to development for, maybe, fixing the issue.
    – Makyen Mod
    Commented Jul 11 at 23:51
  • 1
    In most cases, it's a good thing for the tag synonym to redirect to the canonical tag reference, so that piece is essentially by design. For advanced use cases, you could use Henry's query in SEDE to search for questions directly by any tag. If you search for a synonymized tag (i.e [chatgpt]), what do we imagine the search syntax would be to override the default redirect behavior?
    – KyleMit StaffMod
    Commented Aug 27 at 16:50
  • 2
    For the record, I don't believe this question is status-completed because there's still no way to find the two questions above using tag. Try [chatgpt] is:q score:100 or [ai-generated-content] is:q score:100. Neither question show up among the results even though both satisfy these search terms.
    – cottontail
    Commented Oct 7 at 5:16
  • @cottontail I agree. The OR search should be done internally. Currently it's done when you only search for the synonimised tag alone. It doesn't cover the case already mentioned in the FR - searching for a user + tag. This search from the question still doesn't return this post.
    – VLAZ
    Commented Oct 7 at 5:59

1 Answer 1

6

I've fixed this issue. We discussed possible solutions and determined that the most straightforward way to resolve was this workflow:

If you search for a single tag with no other terms, and that tag is not the canonical synonym (for example, [chat-gpt]), the search will return results for both [chat-gpt] as well as [openai-api].

It does not work in reverse, so searching for [openai-api] does not return [chat-gpt] results.

This also works if you navigate directly to a URL like https://stackoverflow.com/questions/tagged/chat-gpt.

The changes are live, so give it a whirl! And let me know if you experience any issues. Thank you for the feedback, as always!

16
  • 2
    Synonyms seem to behave differently when searching for them - so it's a feature, not a bug. But doesn't really seem complete. One issue is that searching for [chat-gpt] or [any-other-tag] that doesn't expand to [chat-gpt] or [openai-api] or [any-other-tag], you instead get [openai-api] or [any-other-tag]. But even if you just go to the tag page for [chat-gpt] you don't get to a tag page (but the OR search). So, any user who navigated there won't see the tag description.
    – VLAZ
    Commented Oct 2 at 15:12
  • 2
    Overall, my impression is that right now tag searching and/or plain visiting doesn't work at all intuitively. Previously it was also surprising when you went to [a] but got [b] but the new behaviour seems more surprising. Since it's not very consistent and sometimes (compound searches) you get the old behaviour.
    – VLAZ
    Commented Oct 2 at 15:13
  • 2
    This solution really doesn't seem to fix the problem. Searching for the parent tag alone ai-generated-content only returns 31 questions while searching for the child tag chatgpt returns 87 between the that child and the parent. The parent tag should be the more important of the two. Searching for the parent should certainly surface posts with any of the child tags which it currently does not. I'm not sure if re status reviewing this is beneficial at this point or if it'd be better to just create a new bug report with the new behaviour and go from there.
    – Henry Ecker Mod
    Commented Oct 13 at 23:50
  • If you select the field and press enter again it becomes [openai-api] or [openai-api], which I find quite unintuitive
    – S.S. Anne
    Commented Oct 18 at 22:20
  • @HenryEcker I don't agree that a parent should always surface all possible child tags; in terms of specificity, if you're looking for a parent tag, you're not necessarily looking for possibly not-quite-related child tags, but the inverse is (almost?) always true. Also FWIW, before I made this change, you could still get into the [openai-api] or [openai-api] state. I know this solution is not ideal - we were going for a stopgap to at least make previously inaccessible questions searchable. In any case, I'll talk to the team about how else we might want to change it. I hear your feedback.
    – kristinalustig StaffMod
    Commented Oct 29 at 13:31
  • 2
    @kristinalustig I don't understand what you mean at all about "not-quite-related child tags" this differs extremely from my understanding of the synonym system and the way it functions. We synonymise tags [a] -> [b]. From that point forward every time someone uses the [a] tag it's automatically rewritten as [b]. [b] is the only tag that can be used anywhere on the site from that point forward. So when we're looking for [b] we would 100% expect to also see posted tagged [a] since [a] has been entirely suppressed from being able to exist in the system.
    – Henry Ecker Mod
    Commented Oct 29 at 21:57
  • 2
    If there are not-quite related tags then they should not be synonyms. When we synonymise tags we expect them to behave as identical. That's my understanding of the feature. If two tags are synonymous we want them to behave as if they are the same so that we can find everything on the topic we're looking for. I appreciate the stopgap measure, but I just want to make sure that we have similar understanding. Tag synonyms are billed as an automatic editing mechanism. I think the general expectation is that they would behave as equivalent in search.
    – Henry Ecker Mod
    Commented Oct 29 at 21:59
  • It's been brought to my attention that I somewhat abused terminology here and could have implied something overly hierarchical when that's not the way that tag synonyms function. By 'parent' in my comment here I meant 'target tag' and by 'child' I meant 'source tag'. It would be more correct for my statement to have read: "The target tag should be the more important of the two. Searching for the target tag should certainly surface posts with any of the source tags which it currently does not." Tag synonyms only have an overwriting one-way relationship not a hierarchy
    – Henry Ecker Mod
    Commented Oct 30 at 11:23
  • @HenryEcker Okay, I understand you. The original problem then is that they were not behaving identically because posts that had the non-canonical tag were not searchable. The desired behavior, then, is to return results for all tags that are synonymized with a given tag. As an example, if a user searches for [openai-api] they should get all results for that, [chat-gpt], and any other synonyms that might exist, like (I'm making this up) [openai] or [chatgpt-api]. Is that correct? Sorry for the delay in response, things have been incredibly hectic over here!
    – kristinalustig StaffMod
    Commented Nov 19 at 16:38
  • @kristinalustig the purpose of searching is to surface specific things from the site. It is extremely rare that as a user I'd want to search for a tag (or click on it - same thing) and go through every single post. Especially not if there are very many posts (say, 100-200+). There is no shortage of synonyms where the total results is in the thousands or in multiple tens of thousands. If I want to search for something like [tag] created:..1y (anything created more than a year ago), then that will not return posts tagged [synonym]. And even if I try [synonym] created:..1y,
    – VLAZ
    Commented Nov 19 at 17:28
  • I get the previous query. Overall, technically an improvement from before. However, being able to see 50k+ (up from 40k+) results with a mix of synonymised and main tag is hardly useful. That still requires me to know the synonym I want to search. And doesn't even work if there were more than one synonymised tags: if [a] and [b] are both synonyms of [c] then I can't really see all the questions. I can see [a]+[c] or [b]+[c] but with no useful mechanism to separate them or weed out the overlaps. Nor a way to get [a]+[b]+[c].
    – VLAZ
    Commented Nov 19 at 17:28
  • 1
    Trying to search [a] or [b] or [c] rewrites the query to [c] or [c] or [c]. For example html has synonyms div and span. And here is the search for all of them . This does have amusement value but not much more. Overall, we synonymise tags to treat them as equals. But searching doesn't treat them equally. Search in most circumstances converges to the synonym target and barely manages to surface synonyms themselves. Only one at a time. Even then only by mixing the results with the synonym target itself.
    – VLAZ
    Commented Nov 19 at 17:28
  • Trying to walk through the entire synonym family is basically impossible. Except in the edge cases where tags very few questions (which I'd very generously define as "three digit number") and very few synonyms (probably 1-3). The HTML tag has 1.1 million questions by itself, and 14 synonyms. It's probably one of the bigger tags but even if the numbers were 40k results and 5 synonyms the result is unworkable. If I am, for whatever reason compelled to use these results, I'd have to do some sort of programmatic parsing. At which point the fix done here is of no help to me -
    – VLAZ
    Commented Nov 19 at 17:28
  • I may as well use SEDE or the data dump and do my own search over those for all synonyms. Yet, as it stands, I am very reluctant to even do that because it's a huge amount of work for not a lot of benefit. I use site search to not invest time into making my own filtering system over the site content.
    – VLAZ
    Commented Nov 19 at 17:28
  • I don't think I can say it any better than VLAZ. Tag synonyms automatically rewrite tags. If I post a new question here on MSO and try to tag it [chatgpt] it'll be posted under [ai-generated-content]. If I'm trying to search for more related posts and I click on the tag under my question, ai-generated-content, I won't find the majority of questions about [chatgpt] because they're not tagged [ai-generated-content]. I'd have to go find if a different tag existed. And before this change I'd find the chatgpt tag only for it to be automatically rewritten and still not give me my results.
    – Henry Ecker Mod
    Commented Nov 19 at 21:28

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .