Token

A token is the basic unit an LLM reads and writes — roughly three-quarters of a word in English, though the exact split varies by model and tokenizer. Usage-based pricing, context window limits, and latency are all denominated in tokens, so token counts are the unit every cost or capacity conversation in this space eventually collapses to.

← Back to the full glossary