27

Tag info for :

A token is a string of characters, categorized according to the rules as a symbol (e.g., IDENTIFIER, NUMBER, COMMA). The process of forming tokens from an input stream of characters is called tokenization, and the lexer categorizes them according to a symbol type. A token can look like anything that is useful for processing an input text stream or text file.

There are ~4,600 questions. Of the first 50, about 8 have to do with tokens in the sense of tokenization. The others have to do with authentication tokens.

The questions related to tokenization should be retagged to . For the other usage, exists, but I don't have enough experience in that domain to say if it's a good target. Perhaps ought to be renamed to something more specific.

1

2 Answers 2

4

is certainly not a good target, since it's about a specific token you get during the OAuth process (additionally to ). Many of these questions are related to some form of HTTP based authentication, so perhaps could be a good target for many of them, or a new tag (, , ...) should be created.

Here are some "types" of questions I noticed within :

From the remaining questions, many are about custom tokens, or specific tokens generated by some frameworks.

1

Can you be an expert in tokens? It's not likely; the term is far too broad. An access token is not comparable to a token in a lexical parser, which is not comparable to a CSRF token. I don't think there's value in this meta-tag.

It seems more plausible to be an expert at tokenization, since the algorithms once might apply are language-independent; I know a few people that love writing parsers.

However, the vast majority of the questions tagged with token are about access tokens, particularly the jwt variety. In most cases, we could just remove the token tag and nothing of value would be lost.

You must log in to answer this question.