o10

Prompt Tokens

Prompt tokens are the tokens in the input supplied to a language model, including applicable instructions, conversation history, retrieved material, and tool results.

01Deep dive

Meaning and practical implications

An application can send much more than the user’s visible question. Inspect the assembled request to find repeated instructions, redundant documents, or growing conversation history.

FAQFrequently asked questions

Common questions

o10Set the envelope. o10 holds it.

See what you're overpaying.

Paste a week of traffic. Get the number that books the audit.

See what you're overpaying
verified savings methodology · State of Inference Spend 2026