/ product

A single endpoint. A network beneath it.

ORVEX is the layer between your app and the model. It picks the worker, streams the tokens, retries the failure, settles the payment and disappears.

/ system
REQUESTAPIROUTERWORKER · AWORKER · BBUSYWORKER · CSTREAMRESPONSE
/ capabilities

What the runtime handles for you.

Everything below is on by default. Nothing is a plan tier. Nothing is a phone call.

/ 01

Adaptive routing

Every call is scored against latency, price, load and locality. The best worker wins in under a millisecond.

/ 02

Streaming natively

Token-level streams from the first byte. No polling. No queues you can see.

/ 03

Model-agnostic

Open models, closed models, private fine-tunes. Same endpoint. Same billing.

/ 04

Deterministic quotas

Credits, not surprises. Set a ceiling, get exact behavior at the ceiling.

/ 05

Verifiable receipts

Every request produces a signed receipt: worker, region, tokens, cost. Auditable, ignorable.

/ 06

Zero cold start

Warm pools per region keep TTFT under 50ms on production workloads.

/ observability

See the runtime, always.

The dashboard is a live view of your traffic, not a weekly digest.

Latency

p50 · p95 · p99

p5041ms
p95140ms
p99210ms
Throughput

Tokens per second

now12400
peak · 24h41800
Cost

Credits consumed

hour82cr
day1904cr
month38210cr