The control plane for inference spend

QUALITY HELD. COST CONTROLLED.

AI inference.
On your terms.Quality first.
Cost controlled.

o10 holds your quality floor in the request path, and routes each call to the cheapest model that clears it.

No card required · BYOK welcome

ONE REQUEST. THE RIGHT ROUTE.
Quality held. Lowest compliant cost. A request passes through o10. Of three possible model routes, one is selected in green: the lowest-cost option that meets the quality floor. This is a conceptual illustration. Request o10 Quality floor $$$ $$ $ Selected
Quality held.Lowest compliant cost.
01 / Set the quality floor02 / Prove the saving in shadow03 / Enforce. Every call.
THE ROUTING PLANEInteractive demo · illustrative data
o10/auto

Cheapest model that clears the quality floor.

Your app live traffic
o10 quality floor 0.86
Routed to
Why
Calls0
Select a mode. Watch the route change.

Built for the request path

Every call.
Accounted for.

Route, prove, enforce. The tools to keep quality and spend in the same conversation.

Routing

One base URL. Same OpenAI-compatible API.

Point at https://app.o10.io/v1. Set o10/auto, or frontier, squad, pinned.

How to use →
Envelope

Set the budget. o10 holds it in the path.

Shadow proves savings on your traffic. Enforce holds the envelope. Ledger per use case.

See the spread →
Shadow

Prove the save before you flip enforce.

o10 mirrors live traffic and shows what would route. Nothing changes until you say so.

See routing →
DeepShell

An agent on your computer, on your budget.

Approval-gated desktop agent with a tamper-evident audit log. Powered by o10 routing. Beta.

DeepShell →
Tune

Same quality. Cheaper position.

Free prompt optimization with a before/after receipt. Then route the cheaper version.

o10 Tune →
KYI

Govern the chain above the bill.

Know Your Inference scores performance, economics, integration, strategy, and risk.

Explore KYI →
Works with OpenAI-compatible API · OpenRouter · Amazon Bedrock · BYOK

How it works

One plane, every venue.

The same model is often priced differently across venues. o10 routes every call to the cheapest compliant supply, and starts in shadow before it ever changes a route. Frontier models for frontier problems — everything else to the cheapest model that clears your quality floor, in the path.

routing live
enforce · in the path
YOUR APP live traffic o10 CONTROL PLANE quality floor · evals eval & budget route → cheapest IN THE PATH CHEAPEST COMPLIANT SUPPLY Gateway PER-TOKEN API $9.40 /1M TOKENS Aggregator MULTI-PROVIDER $8.10 /1M TOKENS Your commitment YOUR BEDROCK / BYOK $1.85 /1M TOKENS ← o10 would route here venues: per-token APIs · aggregators · your Bedrock commitment · BYOK / open-weight
in the path · routing live
calls routed: 0
saving · illustrative$312K/mo

Understand the system

Inference powers the call.
Agents complete the task.

Learn how models serve requests, how agent loops use tools, and how to measure the cost of an accepted outcome.

Start free

Free route key. One base URL.

No card. Signup at app.o10.io/signup issues a free o10 route key (o10_sk_…), shown once. Free is $0 BYOK: bring your own provider keys; o10 can run shadow receipts. Paid plans add routed credits.

01
Start free

Sign up. Get your free route key. No card.

02
Point the base URL

OpenAI-compatible client → https://app.o10.io/v1.

03
Set the model

Use o10/auto. Paste the free route key as the API key.

curl https://app.o10.io/v1/chat/completions \
  -H "Authorization: Bearer $O10_ROUTE_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "o10/auto",
    "messages": [{"role": "user", "content": "Hello"}]
  }'
# Copy your free key after signup. Do not use a shared demo key.

Modes

Four modes. One control plane.

Set model to a virtual alias. Base URL https://app.o10.io/v1. Pin a concrete slug with ! to skip routing.

o10/autoDefault: cheapest model that still clears the quality bar
o10/frontierValue-first across frontier-class models. Open-weight and proprietary
o10/squadMulti-agent: planner → workers → judge. Typically 1–4 minutes
o10/pinnedOrg-saved model override. Skips auto-downgrade

o10 Tune: free prompt optimization. Same quality, cheaper position, with a before/after receipt. Tune a prompt →

The spread

Different routes. Different costs.

Pick a workload and a quality floor. o10 estimates what you'd have saved by routing to the cheapest compliant model. Same quality floor. Different token tier.

Workload
Quality floor
Estimate only · paste a week of real
traffic in the audit for your number.
Estimated monthly saving
$0
0% of current spend, same quality floor
Current spend
$0
o10 routed
$0
Price spread
Cuts to spend
-

Set the envelope. o10 holds it.

See what you're overpaying.

Paste a week of traffic. Get the number that books the audit.

Illustrative estimates, not guaranteed savings. Compare routes on your own tasks and include evaluation, retry, and tool costs.
FAQFrequently asked questions

Common questions

What is o10?

o10 is the control plane for inference spend. It routes every AI inference call to the cheapest model that clears your quality floor, across unified inference gateway, OpenRouter, Amazon Bedrock, and owned capacity. Shadow mode proves savings without changing production; enforce mode holds budget envelopes in the path. Evals define per-use-case quality floors; KYI governs the supply chain for board reporting; an immutable ledger records model, venue, and fully loaded cost on every call.

What is the difference between shadow and enforce mode?

Shadow mode mirrors live traffic and shows what would have routed and saved, without changing production responses. Enforce mode places o10 in the request path and actively routes each call to the cheapest eval-passing model within your budget envelope. Teams always start in shadow to build a verified per-use-case baseline; finance signs off before enforce flips. Both modes write to the immutable ledger; only enforce changes spend.

How much can inference routing save?

Savings depend on the current route, task distribution, acceptance criteria, and candidate endpoint costs. The website calculator is illustrative. Compare your baseline with evaluated alternatives and include shadow evaluation, routing, retries, and tool charges before reporting a saving.

What is Know Your Inference (KYI)?

Know Your Inference (KYI) is a governance framework by o10 that scores inference systems across five weighted pillars: Performance (25%), Economics (25%), Integration (20%), Strategy (20%), and Risk (10%). Each pillar scores 0–100; the composite rolls into a confidence level and board-signable recommendation. KYI runs continuously in the o10 control plane, not as a one-off audit. So every routed call and eval updates the score. A composite floor of 65 triggers enforcement levers: cap, rightsizing, or sunset per policy.

What is a quality floor?

A quality floor is the minimum eval score a model must achieve for a specific use case before o10 routes production traffic to it. Floors are per workload. Support, RAG, code, and batch clear at different bars, and measured by replaying representative traffic through eval suites, not assumed from vendor benchmarks. Once a cheaper candidate passes the floor, o10 can route to it in shadow (proof) or enforce (live). Floors without evals are hopes; evals without floors are expensive defaults.

Which providers does o10 support?

o10 unifies routing across per-token API gateways (unified inference gateway), OpenRouter (multi-provider aggregator), Amazon Bedrock (per-token and committed capacity), and owned or open-weight infrastructure. A single control plane sits above all venues. You do not need separate dashboards per provider. o10 selects the cheapest eval-passing route per call and holds budget envelopes. Committed Bedrock drawdown and open-weight routing are first-class venues, not afterthoughts.

How are savings verified?

Savings are verified against your own shadow baseline per use case, not industry averages or vendor marketing claims. o10 mirrors a week or more of production traffic, segments by workload, and compares what you actually spent versus what you would have spent on the cheapest eval-passing route at the same quality floor. Finance signs off on the delta before enforce mode flips. Gainshare pricing ties o10 fees to this verified number, so savings must be real and auditable.

How do I integrate with a free route key?

Start free at https://app.o10.io/signup. No card. Signup creates an org and issues a free o10 route key (o10_sk_…), shown once. Point your OpenAI-compatible client at https://app.o10.io/v1, set model to o10/auto (or another mode), and paste the free route key as the API key. Use a placeholder like $O10_ROUTE_KEY in docs. Copy your own key after signup; do not use a shared demo key. Shadow mode shows what you'd save before enforce.

What is Free / BYOK?

Free is $0 with no card required. Free is bring-your-own provider keys (BYOK): you route on your own provider keys; o10 can run shadow receipts on live traffic. Paid plans add routed credits. Free does not include prepaid o10-hosted frontier credits.

What are the o10/* modes?

Four modes. o10/auto. Default: cheapest model that clears the quality bar. o10/frontier. Value-first across frontier-class models (open-weight and proprietary); orgs can set a preferred frontier model. o10/squad. Multi-agent planner → workers → judge for hard multi-step work (typically 1–4 minutes). o10/pinned. Org-saved model override; if unavailable, falls back to auto with a visible notice. Base URL https://app.o10.io/v1. Concrete slugs and ! pin syntax also work per-request.

What are Frontier Tokens?

Frontier Tokens (model o10/frontier): value-first across frontier-class models, including open-weight (e.g. DeepSeek R1, GLM, Kimi) and proprietary (e.g. GPT-5.5, Claude Opus/Sonnet). Orgs can set a preferred frontier model. Status: beta / live for entitled accounts. Open https://app.o10.io/frontier after signup.

What is Squad and how long does it take?

Squad (model o10/squad): multi-agent planner → workers → judge. For hard multi-step work. Latency is typically 1–4 minutes, not chat-speed. Status: beta / live. Open https://app.o10.io/squad.

What is o10 Tag for Slack?

Mention @o10 in Slack; answers are routed through o10 with receipts. Email path: ask@o10.io. Set up in the console under Settings → Integrations → Tag. Tag is available to connect or pilot. Marketplace listing may still lag; do not assume it is already on the Slack Marketplace.