@DeepInfra

Fast ML inference. Run top AI models using a simple API.

Palo Alto
Joined February 2023
Today at #NVIDIAGTC Berlin, our CEO @nikolaborisof joined @nvidia panel, “From Capacity to Customers: Building the AI Factory Business.” The panel brought together leaders across energy, infrastructure, models, and capital. Nikola spoke for inference providers: what customers need, and how providers turn capacity into a sustainable business. A few takeaways from the discussion: 💡 Open models give customers control. Open-weight models let teams decide how their stack runs, where their data lives, and who they depend on. That’s becoming central to sovereignty conversations. 💡 Inference at scale has to be stable and compliant. Customers moving AI into production need it to be reliable, predictable, and built to meet regulatory requirements. 💡 The AI factory is a supply chain. Financing, power, and infrastructure all have to line up before capacity turns into tokens that customers can use. From there, the business is about yield: getting the most useful output from every GPU. Thanks to NVIDIA for hosting, and to fellow panelists @hitachienergy , @Macquarie , @MistralAI, and @nscale for a great conversation. #AIInference #OpenSource #AIFactory
1
7
205
The hard part of an AI in a group chat isn't answering. It's knowing when to stay quiet. Boba reads the room, speaks up when it can help, and sticks with a goal for weeks. Ampersand, then Boba, in one week. @humansand keeps shipping. Would you add an AI to your group chat? 🚀🚀🚀
Introducing Boba - the social intelligence that understands your goals and your community. Text Boba today or message it online at boba.app
2
7
432
Huge congrats to @humansand on launching Ampersand. A model trained to collaborate, and measured on what people actually get done together over months, not single-turn benchmarks. That's the right thing to optimize for.
No one changes the world alone Introducing Ampersand - the first model built for us. Ampersand is a collaborator trained to help people achieve their individual and collective goals. In multi-month simulations, users collaborating with Ampersand accomplished more than with Fable and other frontier models Available to everyone through our API
1
5
2
13
1,778
Your agent can only reason over the evidence it retrieves. NVIDIA Nemotron 3.5 Embed 1B/8B and Rerank 8B are live on DeepInfra! Retrieve across text and visual documents, then rerank results to surface the most relevant evidence . From $0.015 per 1M tokens. @NVIDIAAI
1
9
459
Explore the models → Nemotron 3.5 Embed 1B: deepinfra.com/nvidia/Nemotro… Nemotron 3.5 Embed 8B: deepinfra.com/nvidia/Nemotro… Nemotron 3.5 Rerank 8B: deepinfra.com/nvidia/Nemotro…
156
Open-weights image editing has a new #1, and it’s live on DeepInfra right now 🎨 Open weights. Trained only on licensed data. Ready to fine-tune and ship for $0.04 per API call. Congrats @Bria_AI_ 🚀 Go make something wild ↓
2
1
12
1,314
Demand for DeepSeek V4.1 Flash has been nuts. People have agents grinding on it all weekend, nonstop. So screw it, we're cutting the price 51% 🚀🚀. keep them running.
DeepSeek keeps shipping while the rest of the timezone sleeps, so we stopped sleeping too 😈. V4.1-Flash-1017 is live on DeepInfra: hosted in the US, zero data retention, same price as V4.1-Flash with 30% off. Link in the comment ⬇️
11
10
2
115
6,837
DeepSeek keeps shipping while the rest of the timezone sleeps, so we stopped sleeping too 😈. V4.1-Flash-1017 is live on DeepInfra: hosted in the US, zero data retention, same price as V4.1-Flash with 30% off. Link in the comment ⬇️
🚀 DeepSeek-V4.1-Flash-1017 is here! Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API. 🛠️ Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model. 1/4
5
3
1
62
8,889
Proud to sponsor SGLang Summit. We'll see you there!
Proud to welcome our newest sponsors to SGLang Summit. In just one week since our public announcement, our sponsor lineup has grown from 11 to 36. Thank you to every sponsor helping bring this community together. Join 2,000+ engineers, researchers, and builders from across the AI ecosystem for technical sessions, hands-on workshops, and the GPU Expo. Hear from Lip-Bu Tan, Lilian Weng, Soumith Chintala, Aravind Srinivas, and more. Meet the teams building across AI hardware, infrastructure, models, and applications. 🗓️ November 12–13, 2026 🌉 Fort Mason, San Francisco 🎟️ Get your tickets: sglang.io/summit
1
2
15
1,104
DeepInfra retweeted
Glimpse is our first model, built for visual thinking Try it for yourself platform.elorian.ai/
Spent years watching models ace a single image and completely whiff on anything that moves or changes angle. Today we’re fixing that. Try Glimpse now, our first visual thinking model with competitive frontier performance compared to Astra on key public visual reasoning benchmarks.
16
21
9
155
26,841
Big congrats to @ElorianAI on the launch of Glimpse. Visual reasoning is one of the most exciting frontiers in AI, great to see the team pushing it forward. Check it out 👇
Spent years watching models ace a single image and completely whiff on anything that moves or changes angle. Today we’re fixing that. Try Glimpse now, our first visual thinking model with competitive frontier performance compared to Astra on key public visual reasoning benchmarks.
1
10
709
DeepInfra retweeted
Today we're thrilled to announce the release of our first frontier visual reasoning model
56
121
58
1,775
120,218
Step 5 Preview from @StepFun_ai is live on DeepInfra, day zero. 600B open-weight MoE, 27B active. 1M context, text + vision. FP8. $1.00 in / $2.70 out / $0.05 cached per 1M tokens. Built for long-horizon agents: coding, frontend, finance. What would you load into 1M tokens first?
2
2
13
3,917