01Deep dive
Meaning and practical implications
A maximum output limit bounds generation length; it does not guarantee that the model will finish the task within that limit. Monitor truncated outputs and any retries they cause.
Completion tokens are generated output tokens. Endpoint usage records may distinguish visible output from other billed generation categories.
A maximum output limit bounds generation length; it does not guarantee that the model will finish the task within that limit. Monitor truncated outputs and any retries they cause.
Paste a week of traffic. Get the number that books the audit.
See what you're overpaying →