Fast ML inference. Run top AI models using a simple API.

Palo Alto
Joined February 2023
Huge congrats to @humansand on launching Ampersand. A model trained to collaborate, and measured on what people actually get done together over months, not single-turn benchmarks. That's the right thing to optimize for.
No one changes the world alone Introducing Ampersand - the first model built for us. Ampersand is a collaborator trained to help people achieve their individual and collective goals. In multi-month simulations, users collaborating with Ampersand accomplished more than with Fable and other frontier models Available to everyone through our API
1
9
630
Your agent can only reason over the evidence it retrieves. NVIDIA Nemotron 3.5 Embed 1B/8B and Rerank 8B are live on DeepInfra! Retrieve across text and visual documents, then rerank results to surface the most relevant evidence . From $0.015 per 1M tokens. @NVIDIAAI
1
7
409
Explore the models → Nemotron 3.5 Embed 1B: deepinfra.com/nvidia/Nemotro… Nemotron 3.5 Embed 8B: deepinfra.com/nvidia/Nemotro… Nemotron 3.5 Rerank 8B: deepinfra.com/nvidia/Nemotro…
127
Open-weights image editing has a new #1, and it’s live on DeepInfra right now 🎨 Open weights. Trained only on licensed data. Ready to fine-tune and ship for $0.04 per API call. Congrats @Bria_AI_ 🚀 Go make something wild ↓
2
1
12
1,220
Demand for DeepSeek V4.1 Flash has been nuts. People have agents grinding on it all weekend, nonstop. So screw it, we're cutting the price 51% 🚀🚀. keep them running.
DeepSeek keeps shipping while the rest of the timezone sleeps, so we stopped sleeping too 😈. V4.1-Flash-1017 is live on DeepInfra: hosted in the US, zero data retention, same price as V4.1-Flash with 30% off. Link in the comment ⬇️
11
10
2
115
6,801
DeepSeek keeps shipping while the rest of the timezone sleeps, so we stopped sleeping too 😈. V4.1-Flash-1017 is live on DeepInfra: hosted in the US, zero data retention, same price as V4.1-Flash with 30% off. Link in the comment ⬇️
🚀 DeepSeek-V4.1-Flash-1017 is here! Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API. 🛠️ Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model. 1/4
5
3
1
62
8,842
Proud to sponsor SGLang Summit. We'll see you there!
Proud to welcome our newest sponsors to SGLang Summit. In just one week since our public announcement, our sponsor lineup has grown from 11 to 36. Thank you to every sponsor helping bring this community together. Join 2,000+ engineers, researchers, and builders from across the AI ecosystem for technical sessions, hands-on workshops, and the GPU Expo. Hear from Lip-Bu Tan, Lilian Weng, Soumith Chintala, Aravind Srinivas, and more. Meet the teams building across AI hardware, infrastructure, models, and applications. 🗓️ November 12–13, 2026 🌉 Fort Mason, San Francisco 🎟️ Get your tickets: sglang.io/summit
1
2
15
1,102
DeepInfra retweeted
Glimpse is our first model, built for visual thinking Try it for yourself platform.elorian.ai/
Spent years watching models ace a single image and completely whiff on anything that moves or changes angle. Today we’re fixing that. Try Glimpse now, our first visual thinking model with competitive frontier performance compared to Astra on key public visual reasoning benchmarks.
16
21
9
154
26,730
Big congrats to @ElorianAI on the launch of Glimpse. Visual reasoning is one of the most exciting frontiers in AI, great to see the team pushing it forward. Check it out 👇
Spent years watching models ace a single image and completely whiff on anything that moves or changes angle. Today we’re fixing that. Try Glimpse now, our first visual thinking model with competitive frontier performance compared to Astra on key public visual reasoning benchmarks.
1
10
706
DeepInfra retweeted
Today we're thrilled to announce the release of our first frontier visual reasoning model
56
121
58
1,774
119,962
Step 5 Preview from @StepFun_ai is live on DeepInfra, day zero. 600B open-weight MoE, 27B active. 1M context, text + vision. FP8. $1.00 in / $2.70 out / $0.05 cached per 1M tokens. Built for long-horizon agents: coding, frontend, finance. What would you load into 1M tokens first?
2
2
13
3,872
Up to 626 output tokens/s at 100K input, measured by @ArtificialAnlys on DeepInfra. NVIDIA Nemotron 3.5 Super VL from @nvidia is live! Build agents that read documents, screenshots and video, reason about what they see, and generate tool calls. 120B-A12B MoE. OpenAI-compatible API. Pay per token. $0.20 in / $1.00 out | $0.10 cached per 1M Try it → deepinfra.com/nvidia/NVIDIA-…
2
8
469
Day-zero drop: Ling-3.1-flash from @AntLingAGI is now live on DeepInfra ⚡ Built for long-horizon coding, multi-step analysis, and tool-using agents with 560B total parameters and 25B active per token. Per 1M tokens: $0.30 input · $0.90 output · $0.06 cached. Try it, compare it, and tell us what you build.
1
4
1
16
1,894
DeepInfra retweeted
I make this same post like every 2-3 years, because there's always new data further supporting it. Georges Harik (@gharik) is one of the most prescient people in AI, and definitely the least well known and underappreciated one. In 1999 he joined Google as one of the first employees (like #7 or something) because he thought he could use his AI knowledge to build a better ad system. He and Salar Kamangar built Adwords (Salar later bought YouTube and Georges later was the force behind Google wanting to buy Andy rubin's company to build Android) Georges left Google so he could focus on AI research, which he self funded. He did so with someone he worked with closely at Google, our friend Noam Shazeer (they built the AdSense targeting engine). When Google finally decided to work hard on AI around the time of the deepmind acquisition, they tried to get Georges and Noam to come back. Georges wanted to stay independent, and our friend Noam went on to do great things obviously. This was my good fortune because it led to Georges and I hanging out a lot, because he basically needed a new lunch buddy. Georges at the time was working on language models and despite karpathy saying nobody saw LLMs being so big even in 2017, Georges was telling me they were on the cusp of changing everything in 2013. My wife and I literally changed some of our parenting priorities that year (less tigery) because georges convinced me the world was going to change so much. Later on he and I got involved in a company making CV photo filters called Lambda. They needed to make money to survive so they started building ML boxes which Georges bought a bunch of. But his significant other was mad there were so many loud and hot boxes in the house, she started worrying about fire risk, so Georges told the lambda guys they should build a cloud because in the future, the power density of the systems was going to be too big for even most enterprises to handle. This was like 2017. That's how lambda cloud began, and the premise Georges had was that AI was going to change things so much, demand growth would outpace supply growth, and the value of compute was eventually going to rise and that lambda was effectively going to be a REIT... so we should own as many GPUs as possible. It took the world almost a decade to finally figure out what Georges saw then (see attached tweet). About 5 years ago when pretraining was still the only thing people cared about, Georges started telling me inference was going to be super impt. He was working on research investigating post training as a way to improve reasoning. He found some other guys working on the same idea that had a paper known as the STAR paper, and they worked together to prove it even further with another paper called quietstar. (They all later cofounded the neolab humans&). Georges got some friends to build deepinfra.com to be one of the first inference clouds because he saw it all early. He and the humans& team also smartly used all their money to buy compute knowing it would go up in price and also get harder to obtain. It's kind of amazing to me how he has gotten everything right so far ahead of time. It's also amazing to me how VCs don't really get or believe a lot of the things he says, they often tell me I am wrong whenever I parrot Georges' current thoughts... and then years later they all put out charts and papers reaffirming those same things as if they knew it all along. The founders of Google recognize Georges' brilliance and still talk to him a lot. (Besides being smart, he is a lot of fun to hang out with.) I'm just wondering when the rest of the world figures it out
I can't emphasize enough how important this @a16z chart seems and how few have internalized it.
21
41
9
550
87,853