What is o10 insights?
Short-form analysis on AI inference spend, routing, and governance. Complementing hubs, guides, and primary research.
Read the methodology and limitations alongside any cost example.
o10
Inference insights
Timely analysis on routing, pricing changes, shadow mode, and KYI governance.
Explore inference economics, model routing, and AI governance, with practical explanations and worked examples.
Inference spend trends in 2026
Enterprise inference spend is shifting from frontier defaults to eval-gated routing across gateways,…
When OpenAI prices change, routing matters
Per-token list price changes are only half the story. Venue mix and model tier selection drive fully…
Why shadow mode is non-negotiable
CFOs will not flip enforce mode without a verified baseline. Shadow mirrors traffic without changing…
Drawing down Bedrock commitments
Reserved AWS AI capacity lowers marginal cost. Route compliant steady workloads through committed ti…
RAG token explosion and what to do
Retrieval plus generation multiplies tokens; eval-gated mini-class routing is often the largest abso…
Agent inference cost compounding
Multi-step agents multiply spend; per-step routing prevents frontier defaults on every hop.…
KYI for board reporting
Boards need recommendation and risk, not token totals. KYI composite scores five pillars continuousl…
Eval drift in production
Models drift; weekly eval replay on production samples keeps quality floors honest.…
Gateway sprawl and the control plane
Multiple gateways without unified policy fragment spend. One control plane above all venues.…
Open-weight in production 2026
8B-class open-weight on committed infra clears many workloads at $0.05/1M when evals permit.…
Four CFO questions that stick
Fully loaded cost, cost per outcome, failing unit economics, forecast drivers. Each with a lever.…
UK inference residency in practice
Policy PDFs do not route traffic, but o10 does not enforce UK jurisdiction routing today. Region con…
One ledger across multi-cloud inference
Immutable per-call records across AWS, gateways, and self-hosted. Finance-grade attribution.…
Quality floors without evals are hopes
Define the floor from replayed production samples, not vendor marketing tiers.…
Why a price ratio is not a savings benchmark
Compare endpoint prices, accepted task quality, and total operating cost separately. A large differe…
FinOps reporting vs enforcement
Reporting last month versus changing next request. Different layers, both needed, only one controls …
Support bot routing economics
High volume + strict QA floor still clears on mini tiers for many enterprises.…
Code copilot eval gates
Correctness suites often clear below frontier. Prove on your repos before paying frontier prices.…
Forecast inference from business drivers
Users, tickets, documents, not straight-line token growth.…
Using o10’s plain-text guides and model data
Find copyable guides, a structured model catalog, and links back to the complete source pages.…
Start hereQuick overview
How to use this index
FAQFrequently asked questions
Common questions
How often is the blog updated?
We publish articles on inference costs, model routing, and AI governance. Check each article for the scope and date of the information it discusses.
Who writes o10 insights?
Analysis from the o10 team, with methodology tied to primary research and the Know Your Inference framework.
o10Set the envelope. o10 holds it.
See what you're overpaying.
Paste a week of traffic. Get the number that books the audit.
See what you're overpaying →