Researcher @Databricks. Former @MosaicML, @CerebrasSystems. Addicted to all things compute.
San Francisco, CA
Joined October 2018
- Tweets954
- Following1.6K
- Followers9.1K
- Likes7K
Abhi Venigalla retweeted
The fastest inference in the world is coming to @OracleCloud.
@cerebras and @Oracle partner to enable ludicrous speed on OCI.
Cerebras brings fast AI.
Oracle brings deep expertise building and running AI infrastructure at scale.
Enterprises trust Oracle with their most important data and applications for decades.
Partnering with Cerebras gives Oracle customers more choice to match each AI workload to the compute that suits it best.
Coming soon, they’ll be able to build agents, assistants, and real time experiences with super fast AI in the cloud they already use.
Thank you to @MThiagarajan_ and the @Oracle team.
Excited to build with you.
Abhi Venigalla retweeted
Thrilled to announce the general availability of
@positron_ai's Atlas Inference Appliance on
@OracleCloud, making Positron the first AI chip startup to be deployed at scale with a hyperscaler. Look out for more announcements this week at Oracle Cloud World! blogs.oracle.com/cloud-infra…
Abhi Venigalla retweeted
We built a time machine for the web.
Introducing Exa Snapshot: an index of 400 billion historical snapshots of webpages that lets you search as if it's the past.
Snapshot is already being used for backtesting prediction models, RL at labs, exploring the pre-AI web, and more.
Abhi Venigalla retweeted
I made some public disclosures about our hardware at the @theallinpod conf this week and wanted to share the progress here. Earlier this summer we got hardware back! The execution was madness…we went from no team in Jan to a tape out in 5 months. AI enabled MUCH tighter loops of research and our execution speed shows the results.
This is the first large-scale demonstration of a causal, physical dynamical system to do real compute. 🚀
We released the Un-0 model (see link) in June and it runs on this physical system; the images below come from the actual hardware. What’s more, this chip requires <900 nJ to generate an image; this is many orders of magnitude less energy than conventional machines.
unconv.ai/blog/introducing-u…
Abhi Venigalla retweeted
The world is debating whether frontier AI needs to slow down. If it comes to it, do we know how?
A lab can say it stopped training. A country can sign a treaty. But, is the compute following the rules? @attestable is building that layer. New blog! 🧵
🤖 Made with AI
Abhi Venigalla retweeted
The world has identified verifiable AI as a missing civilization-scale primitive. The core technical obstacle, practical zero-knowledge proofs, was considered impossible.
We solved it.
Today, we are launching @attestable, the AI Integrity Company, and announcing a $20M seed round led by @jaminball at @AltimeterCap and @YonatanMandelba at @TLV_Partners , with participation from @HalcyonFutures, Cerca Partners, @Weiner_Lia at Netz, @nickymontanaa at Zero Knowledge Ventures, @assaf_rappaport, Asaf Ezra, Nadir Izrael, Jon Coller, Eyal Manor, @OmerPerchik.
Abhi Venigalla retweeted
We're coming out of stealth.
We've built our first racks after a successful A0 tapeout, $1B+ in customer contracts, and $800m raised.
Early customer tests show us achieving SOTA throughput, latency, and power efficiency on inference workloads.
Our first racks ship this summer.
Abhi Venigalla retweeted
Introducing our first model, Un-0!
We trained an image generator powered by a backbone of coupled oscillators in place of a more traditional conventional neural network.
Abhi Venigalla retweeted
Cerebras is now running Kimi K2.6 – a trillion parameter model – in enterprise trials.
At ~1,000 tokens/s, this is the fastest frontier model performance ever measured by Artificial Analysis @ArtificialAnlys.
Abhi Venigalla retweeted
🚀 Today we’re releasing FlashOptim: better implementations of Adam, SGD, etc, that compute the same updates but save tons of memory. You can use it right now via `pip install flashoptim`. 🚀
arxiv.org/abs/2602.23349
A bunch of cool ideas make this possible: [1/n]
Abhi Venigalla retweeted
Taalas Specializes to Extremes for Extraordinary Token Speed eetimes.com/taalas-specializ…
Abhi Venigalla retweeted
2 weeks ago, we rebuilt our entire product.
"Browser automation" fell short of our mission to eliminate all repetitive knowledge work.
The new Kaizen is the ultimate digital employee: always on, extremely capable, continually learning.
Sign up for access in the tweet below.
Abhi Venigalla retweeted
InferenceX v2: NVIDIA Blackwell Vs AMD vs Hopper - Formerly InferenceMAX,
GB300 NVL72, MI355X, B200, H100,
Disaggregated Serving,
Wide Expert Parallelism,
Large Mixture of Experts,
SGLang, vLLM, TRTLLM
semianalysis.substack.com/p/…
Abhi Venigalla retweeted
sim the people, sim the world, join simile.
they kick ass.
@joon_s_pk @msbernst @percyliang @ElainaYallen @mihikapoor
