https://xitter.cf/t.co/g5qr7plvwY Inference Delivery Network
San Fransisco
Joined June 2026
- Tweets20
- Following55
- Followers78
- Likes40
OpenRelay is a delivery network for AI inference.
We pool GPUs across providers and locations and route every request to the best silicon. Provider down? We reroute.
We bill flat rate, not per token. Just create an API key and change one line.
openrelay.inc/inference-deli…
Reserved GPUs sit idle most of the month.
Bring Your Own Capacity: onboard your fleet with one command, no open ports. We serve inference on the idle hours and pay you for them. You want a node back, it's yours again.
And we run it for free.
openrelay.inc/bring-your-own…
RT @prashant8124: Deepseek v4.1 Abliterated and GLM 5.3 Abliterated is live on @OpenRelayInc
Dm me for access; we already have many organi…
Your agent can manage its own compute on OpenRelay.
Ask for an H100 and it deploys the VM. Ask for a batch and it runs it overnight. It watches what it spends, live, and stops at the budget you set.
Give your agent an OpenRelay key, then let it cook.
docs.openrelay.inc/docs/cli/…
Decision models are a new category: Jev from TypeSafe launched last week, typed answers with probabilities instead of text.
Laya is the open-source one. It is live on OpenRelay: POST /v1/decisions, $0.02 per 1M input tokens, nothing else billed.
Same three primitives: choice, score, yes/no. Up to 64 questions per request, one forward pass, a probability distribution and a confidence on every answer.
A four-question ticket triage is 345 tokens, or $0.000007.
Laya makes decisions instead of writing text. Use a few hundred labeled examples to set thresholds before relying on it. The playground has four presets.
Docs: docs.openrelay.inc/docs/infe…
Model by Convai Innovations: huggingface.co/convaiinnovat…
OpenRelayInc retweeted
we've partnered with @OpenRelayInc as a compute partner to provide private AI inference
hmu if you need provably end-to-end encrypted tokens
register for capacity here: openrelay.inc/inference-cata…
OpenRelayInc retweeted
The essays that shaped how I think were written by someone I assumed I would never meet. Today he spent an afternoon helping two founders (@jadenswang ) get better. Thank you @paulg and @jesslivingston for having us! This was the most memorable afternoon of my career
Launching @OpenRelayInc : One Endpoint to Rule Them All
- 100B tokens/week across 22 locations on 4 continents
- 8 accelerator SKUs: NVIDIA, TPU, Trainium, AMD
- Up to 20% cheaper than renting the hardware yourself
Every chip on earth. None of them your problem.
Run inference on the world’s compute
youtu.be/7uNhqcjBXJg?si=rsBj…