Skip to content

🌐 日本語

Token, Context, and Context Window — Relationships ​

NOTE

Token, Context, and Context Window are each defined on their own page.
This page only shows how the three relate. Read the dedicated pages for full definitions.

ConceptPageIn One Line
TokenTokenThe LLM's processing unit
ContextContextEverything passed in one inference
Context WindowContext WindowThe ceiling—and the smaller safe range

How the Three Relate ​

ConceptIn One WordDeveloper Analogy
TokenLLM processing unitMemory byte
ContextFull input to the LLMHTTP request body
Context WindowInput size limitProcess memory space

Token is the unit. Context is the full input for one inference, measured in that unit. Context Window is the upper bound on that Context.

Design mainly controls the content and length of Context. Using the right unit and not trusting the full ceiling are prerequisites for everything that follows in later Parts.


Next: Token — The LLM's Processing Unit

Released under the CC BY 4.0 License.