https://xitter.cf/t.co/g5qr7plvwY Inference Delivery Network
San Fransisco
Joined June 2026
- Tweets18
- Following54
- Followers71
- Likes40
RT @prashant8124: Deepseek v4.1 Abliterated and GLM 5.3 Abliterated is live on @OpenRelayInc
Dm me for access; we already have many organi…
Your agent can manage its own compute on OpenRelay.
Ask for an H100 and it deploys the VM. Ask for a batch and it runs it overnight. It watches what it spends, live, and stops at the budget you set.
Give your agent an OpenRelay key, then let it cook.
docs.openrelay.inc/docs/cli/…
Decision models are a new category: Jev from TypeSafe launched last week, typed answers with probabilities instead of text.
Laya is the open-source one. It is live on OpenRelay: POST /v1/decisions, $0.02 per 1M input tokens, nothing else billed.
Same three primitives: choice, score, yes/no. Up to 64 questions per request, one forward pass, a probability distribution and a confidence on every answer.
A four-question ticket triage is 345 tokens, or $0.000007.
Laya makes decisions instead of writing text. Use a few hundred labeled examples to set thresholds before relying on it. The playground has four presets.
Docs: docs.openrelay.inc/docs/infe…
Model by Convai Innovations: huggingface.co/convaiinnovat…
OpenRelayInc retweeted
we've partnered with @OpenRelayInc as a compute partner to provide private AI inference
hmu if you need provably end-to-end encrypted tokens
register for capacity here: openrelay.inc/inference-cata…
OpenRelayInc retweeted
The essays that shaped how I think were written by someone I assumed I would never meet. Today he spent an afternoon helping two founders (@jadenswang ) get better. Thank you @paulg and @jesslivingston for having us! This was the most memorable afternoon of my career
Launching @OpenRelayInc : One Endpoint to Rule Them All
- 100B tokens/week across 22 locations on 4 continents
- 8 accelerator SKUs: NVIDIA, TPU, Trainium, AMD
- Up to 20% cheaper than renting the hardware yourself
Every chip on earth. None of them your problem.
Run inference on the world’s compute
youtu.be/7uNhqcjBXJg?si=rsBj…