Update August 16th, 2024
We appreciate all of the feedback and perspectives that have been shared. Some of the feedback we received around RSS feeds and curation activities was not anticipated. We would like to hear a bit more from you about those things.To keep the conversations a bit more streamlined, we have created a separate post here to collect that feedback.
Back in June, we announced some upcoming experiments surrounding tags. I’m here to tell you how those experiments — the tag hover experiment, listed as “experiment 2” on the original post — fared and the next steps based on the experiment results. In addition to that experiment’s results, I also want to share some of the feedback we collected from “experiment 1,” where we prompted anonymous users who clicked the “ignore” button in the tag hover pop-up for what they thought the button did.
Of the three variants used during the experiment on Stack Overflow, variant B outperformed the others. Additionally, most of the feedback collected from “experiment 1” revealed that most users click “ignore” because they want the tag hover modal to go away. Together, these reasons led us to graduate variant B and consider two additional areas that require attention. We anticipate variant B will be released in the coming weeks. For now, this is only coming to Stack Overflow, and we will consider expanding this to the rest of the network later.
Ignoring tags
Current stats show us that the “watch tag” button gets a lot more clicks than the “ignore tag” button. We found around 15,000 anonymous users selected 'ignore' compared to 7,000 who chose 'watch.' Among registered users, the ratio of watching to ignoring is 7,755 to 3,663. That seems to indicate that some users might find the message box distracting, leading to a preference for dismissing it rather than using it to filter content.
Additionally, we’re trying to reduce the number of options available on some of these places to favor the most used actions or the actions we want to drive users towards in order to have them engage with the product earlier on before they move on to deeper engagement with other areas of the product.
We recognize that graduating this variant means one place fewer from which users can ignore tags. Some of the feedback from the original announcement post, as well as the feedback-gathering post about a future homepage, touched on how y’all use (or don’t use) the ignore feature, and it’s given some ideas on how questions can be filtered, etc.
Up Next
For “Experiment 3,”we’ll keep the “watch tag”as the call-to-action and will consider how to address where users ignore tags. In addition, we will be pushing the anonymous user experience on the tagged questions page in the coming weeks, with the registered user experience coming shortly after that. We will make updates to this post as each is rolled out.
Tag hover descriptions
As mentioned in the original announcement
Variants B and C show slightly shorter tag descriptions. For the purposes of this experiment, we’ll be grabbing the first line from the full tag wiki and using it in this context, but should the experiment prove successful, we’ll need to think of a better long-term solution. In the context of tagging questions (either when asking a question or editing it), the current excerpt, along with the usage guidance present in it, will still be used even during the experiment.
Graduating variant B means it’s time to think about a long-term solution for those hover descriptions. The current behavior is that the usage guidance is shown on all instances of tag hover, regardless of context. However, most wiki excerpts have tag usage guidance, which is not necessarily what users look for when they hover over a tag on a question they’re browsing. With that in mind, we’re proposing creating a new third field for tags, which should be an abridged version of the full tag wiki, but that is not meant to convey tag usage guidance — this new field would be shown when hovering over tags in contexts that are not asking or editing questions; in those instances, the usage guidance would still be used. See a mockup of what this looks like below note we also will be cleaning up the field names so it's a bit clearer what they are for. They will be as follows:
- Tag Description(new field)
- Usage Guidance -> Question Usage Guidance
- Full tag wiki -> Tag Wiki
As with the currently existing fields for tags, these would be community-curated. To start we will create the tag description from the first sentence of the existing tag wiki. Then curators in the community can edit and improve these as they see fit.
We believe this change will effectively address most of the use cases in terms of tag information throughout the product. However, if you have thoughts on any additional use cases that aren’t covered by the existing two fields and the additional proposed one, please let us know, and we’ll consider whether to include it while we’re working on what has been described in this post.
We will be monitoring this post for feedback til August 21, 2024