LiveSPX7,620-1.28%NDX29,127-1.41%US10Y4.961%+3.23%BTC76,833-1.21%ETH2,469-2.04%GOLD4,319-1.04%NVDA210.96-8.42%MSFT505.41+1.14%GOOGL349.39+3.23%
Advertisement
AI glossary

Context window

How much the model can hold in mind at once.

The context window is the maximum number of tokens a model can consider in a single request — the prompt, any attached documents, the conversation so far and the answer being written, all counted together.

Windows have grown from a few thousand tokens to a million and more, which is what makes whole-codebase and whole-contract analysis possible.

Long context is not free: attention cost grows faster than linearly with length, so a huge prompt is slower and dearer, and models often attend less reliably to the middle of very long inputs.

Calculators
Related terms