Token（词元）

The smallest unit of text a model processes; it can be a word, subword or character.

Tokens are the basis for billing and context measurement: input and output are billed per token, and context windows are measured in tokens. As a rough guide, one Chinese character is about 1-2 tokens and one English word about 1-2, depending on the tokenizer.