LiveSPX7,620-1.28%NDX29,127-1.41%US10Y4.961%+3.23%BTC76,833-1.21%ETH2,469-2.04%GOLD4,319-1.04%NVDA210.96-8.42%MSFT505.41+1.14%GOOGL349.39+3.23%
Advertisement
AI glossary

Token

The chunk of text a model actually reads and bills for.

Models do not see words, they see tokens: fragments of roughly four characters in English. "Leverage" might be one token; an unusual name might be three.

Everything is denominated in tokens — context limits, throughput, and price. A rough conversion is 750 words per 1,000 tokens.

Input and output tokens are usually priced differently, with output several times more expensive because it is generated one step at a time.

Calculators
Related terms