Fast ML inference. Run top AI models using a simple API.
Palo Alto
Joined February 2023
- Tweets786
- Following78
- Followers6.2K
- Likes259
Pinned Tweet
Today at #NVIDIAGTC Berlin, our CEO @nikolaborisof joined @nvidia panel, “From Capacity to Customers: Building the AI Factory Business.”
The panel brought together leaders across energy, infrastructure, models, and capital. Nikola spoke for inference providers: what customers need, and how providers turn capacity into a sustainable business.
A few takeaways from the discussion:
💡 Open models give customers control. Open-weight models let teams decide how their stack runs, where their data lives, and who they depend on. That’s becoming central to sovereignty conversations.
💡 Inference at scale has to be stable and compliant. Customers moving AI into production need it to be reliable, predictable, and built to meet regulatory requirements.
💡 The AI factory is a supply chain. Financing, power, and infrastructure all have to line up before capacity turns into tokens that customers can use. From there, the business is about yield: getting the most useful output from every GPU.
Thanks to NVIDIA for hosting, and to fellow panelists @hitachienergy , @Macquarie , @MistralAI, and @nscale for a great conversation.
#AIInference #OpenSource #AIFactory
The hard part of an AI in a group chat isn't answering. It's knowing when to stay quiet.
Boba reads the room, speaks up when it can help, and sticks with a goal for weeks.
Ampersand, then Boba, in one week. @humansand keeps shipping. Would you add an AI to your group chat? 🚀🚀🚀
Introducing Boba - the social intelligence that understands your goals and your community. Text Boba today or message it online at boba.app
Huge congrats to @humansand on launching Ampersand.
A model trained to collaborate, and measured on what people actually get done together over months, not single-turn benchmarks. That's the right thing to optimize for.
No one changes the world alone
Introducing Ampersand - the first model built for us. Ampersand is a collaborator trained to help people achieve their individual and collective goals. In multi-month simulations, users collaborating with Ampersand accomplished more than with Fable and other frontier models
Available to everyone through our API
Explore the models →
Nemotron 3.5 Embed 1B:
deepinfra.com/nvidia/Nemotro…
Nemotron 3.5 Embed 8B:
deepinfra.com/nvidia/Nemotro…
Nemotron 3.5 Rerank 8B:
deepinfra.com/nvidia/Nemotro…
Demand for DeepSeek V4.1 Flash has been nuts. People have agents grinding on it all weekend, nonstop.
So screw it, we're cutting the price 51% 🚀🚀. keep them running.
DeepSeek keeps shipping while the rest of the timezone sleeps, so we stopped sleeping too 😈.
V4.1-Flash-1017 is live on DeepInfra: hosted in the US, zero data retention, same price as V4.1-Flash with 30% off.
Link in the comment ⬇️
🚀 DeepSeek-V4.1-Flash-1017 is here!
Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API.
🛠️ Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model.
1/4
Proud to sponsor SGLang Summit. We'll see you there!
Proud to welcome our newest sponsors to SGLang Summit.
In just one week since our public announcement, our sponsor lineup has grown from 11 to 36. Thank you to every sponsor helping bring this community together.
Join 2,000+ engineers, researchers, and builders from across the AI ecosystem for technical sessions, hands-on workshops, and the GPU Expo.
Hear from Lip-Bu Tan, Lilian Weng, Soumith Chintala, Aravind Srinivas, and more. Meet the teams building across AI hardware, infrastructure, models, and applications.
🗓️ November 12–13, 2026
🌉 Fort Mason, San Francisco
🎟️ Get your tickets: sglang.io/summit
DeepInfra retweeted
Glimpse is our first model, built for visual thinking
Try it for yourself platform.elorian.ai/
Big congrats to @ElorianAI on the launch of Glimpse. Visual reasoning is one of the most exciting frontiers in AI, great to see the team pushing it forward. Check it out 👇
DeepInfra retweeted
Today we're thrilled to announce the release of our first frontier visual reasoning model
Try it on DeepInfra 👉 deepinfra.com/stepfun-ai/Ste…
Tech blog from the StepFun team: platform.stepfun.ai/blog/ins…
Step 5 Preview from @StepFun_ai is live on DeepInfra, day zero.
600B open-weight MoE, 27B active. 1M context, text + vision. FP8.
$1.00 in / $2.70 out / $0.05 cached per 1M tokens.
Built for long-horizon agents: coding, frontend, finance.
What would you load into 1M tokens first?
