I propose to add the transformers tag to link to questions related to the excellent transformers library. I could not add it myself since it is too closely related to the existing transformer tag, yet very different in what it entails.
transformer involves an architecture, whereas transformers is a library. Alternative tagnames are suggested below.
Answered questions per #252945:
Existing questions where the tag would be appropriate
- Get probability of multi-token word in MASK position
- How to do multiclass classification with Hugging Face transformers using BERT
- BertTokenizer - when encoding and decoding sequences extra spaces appear
- Code example in Hugging Face Pytorch-Transformers quickstart documentation
- Distill bert and svm for text classification
- https://stackoverflow.com/questions/55151118/problems-with-pytorch-bert-on-google-cloud-ml-engine
- Text generation using huggingface's distilbert models
- BERT performing worse than word2vec
There are many more. Searching for "Hugging Face" or simply going through the posts that are tagged as transformer often mention or use the "transformers" library.
Explain why the tag and such questions are on-topic for Stack Overflow
The field of natural language processing is evolving quickly. Since the end of 2017, but especially in late 2018 and 2019, many new transformer models came out. These models are created by different companies and research groups, making it hard for users to get their hands on specific models and implementations. That's where the "transformers" library comes in: it unifies many transformer models in one easy-to-use library. The library concerns natural language processing, the transformer architecture, PyTorch, TensorFlow, and Python, making it perfectly suited for Stack Overflow.
Explain how the tag helps in categorizing and finding those questions
Because "transformers" is not the only library out there that provides transformer models, it is a good idea to create this tag to distinguish itself from others like flair (has a SO tag) and fairseq. That way, users of the library can specifically tag the library that they are using for their experiments.
Provide an initial tag excerpt and wiki for the new tag.
Short excerpt:
Transformers is a Python library that implements transformer NLP models in PyTorch and TensorFlow.
Wiki:
transformers
is a natural language processing (NLP) library that implements many state-of-the-art transformer models in Python using PyTorch and TensorFlow. It is created and maintained by HuggingFace. The library is available through package managers, and it is open-sourced on GitHub. The library was formerly known as pytorch-transformers and before that as pytorch-pretrained-bert.
Propose a good fitting name for the tag as they are always lowercase, don't take spaces and have a maximum length of 35 characters.
transformers or, alternatively, 🤗 transformers
(which the developers often use themselves - the emoji is the "Hugging Face" emoji, which is their company name).
The latter might be a better fit to better distinguish between the existing transformer tag.
Alternatively, from a discussion in the comments, huggingface-transformers is suitable as well and is easier to distinguish from transformer for users.
I created the tag huggingface-transformers and added the excerpt and wiki as posted above. Even though the review process is still not complete, one reviewer (David Maze) rejected the tag with the comment "This edit copies a significant amount of content from an external source." I'm not sure how this is possible other than that it is a copy from this here Meta post. It feels like the reject is a mistake because I wrote that content myself and it seems quite specific and correct.
huggingface-transformers
?