@HowDevelop
Account based inIndia
About this account
- Account based in
- India
- Connected via
- India Android App
Account-level information from X, not a live location or the device used for a specific post.
AI Architect & Builder - Inference, LLMs, SLMs GSoC Org Admin - Jenkins | Docker Captain | CNCF Ambassador
New Delhi
Joined December 2018
- Tweets7.2K
- Following1.3K
- Followers8.4K
- Likes37.8K
Pinned Tweet
What an amazing day! Presented a poster at @PyTorch Conference: how we optimised the RLM paper with pre-fix caching & batched Sub calls with @vllm_project
And a full house for our Pytorch Conference talk on running LLMs using Executorch on Android!
Shivay Lamba retweeted
Introducing Flint, @Recursive_SI’s first model: a fast local coding model built with our automated research system, the Eureka Machine.
• Best-in-class fast local coding
• Up to 2x faster than comparable models: 125+ tokens/sec on a MacBook Pro, 150+ on RTX Spark
• Built from scratch in under 4 months
Private, unmetered intelligence on your own machine. Open weights available now on @huggingface, run it locally on your favorite framework or try it for free on @opencode or @pidotdev.
Shivay Lamba retweeted
A lot of people trying to imply that last 1 year of vibe coding is responsible for all the security vulnerabilities dropping across every piece of software this week.
But if you take a deeper look you’ll see most of the CVEs are impacting actually hand written code from the past; and in fact AI agents are super important to defend against cyber attacks (quickly deploying changes at scale, monitoring situations, writing the code to patch the exploits etc).
Just because humans wrote it doesn’t mean it is necessarily more secure than what AI wrote.
Shivay Lamba retweeted
We’ve spent the past year developing new primitives for GPUs. We believe this enables new algorithms to change how machines learn, open new markets, and dramatically reshape AI’s cost structure.
We have raised a $1 billion Series A, co-led by Index and Lux.
Shivay Lamba retweeted
Had a wonderful time presenting 2 talks at @AllThingsOpen:
1. How do you secure coding agents using @Docker Sandboxes
2. LLM inference on edge using @PyTorch Executorch and LiteRT for @Qualcomm_Dev QNN
Always have wonderful discussions and cross sharing of feedback at ATO!
Had a wonderful time presenting 2 talks at @AllThingsOpen:
1. How do you secure coding agents using @Docker Sandboxes
2. LLM inference on edge using @PyTorch Executorch and LiteRT for @Qualcomm_Dev QNN
Always have wonderful discussions and cross sharing of feedback at ATO!
Also great to catch-up with some of the best folks in the business after such a long time:
@kentcdodds @ossia @fharper @SwiftAlphaOne
This is only possible at ATO 🫡
Shivay Lamba retweeted
New research: We developed JOLT, a post-training method where one model acts as both teacher and student, with the teacher trained to give feedback the student can use.
On MATH, it matched GRPO's accuracy with 6.5x fewer training tokens.
perplexity.ai/hub/blog/a-goo…
Shivay Lamba retweeted
Today we release mammoth-1 and elephant-1!
We post-trained mammoth-1, the #1 ranked best decision model in the world, and elephant-1, which is the best model under 15B (and beats Jev).
We're open-sourcing all model weights and provide a technical report detailing all our training and data methods.
Shivay Lamba retweeted
We teamed up with @huggingface to give away $20,000 to anyone who's building with Beam 🤗
Use Beam for any project - make a demo or a dataset, benchmark the model, create an RL environment - and comment your link in the model's repo page by Monday, November 2.
We choose the winners. Winners choose cash or credits. Claim $25 in Hugging Face credits to build with Beam and enter the competition 👇
huggingface.co/reflection/Be…
Shivay Lamba retweeted
Inspired by @BhosalePratim's Macbrow, I built Winbrow: a Windows voice assistant.
@GradiumAI speech + @typesafeai Jev routing + browser automation adapted from @browser_use’s Jev Ultrafast project.
@Alibaba_Qwen 4B LLM handles replies. Phonon (TTS) speaks them both running locally on @Qualcomm_Dev X Elite’s NPU.
Built for Phonon’s OSS launch!
I've always wanted a way to talk to my Mac and do things on the go.
Until now, it was super slow.
So I built Macbrow.
Voice-controlled browser and computer-use agent.
Built using @GradiumAI @browser_use and @typesafeai
Still early and a work in progress.
github.com/timpratim/macbrow
Shivay Lamba retweeted
Model customization recipes are live on our website and in the cookbook repo.
Beam is now supported across RL and SFT stacks including @axolotl_ai, NeMo RL, NeMo AutoModel, Megatron Bridge (@NVIDIAAI), Miles (@radixark), SkyRL (@NovaSkyAI), and TRL (@huggingface).
Get cooking 🧑🍳
developers.reflection.ai/cus…
Inspired by @BhosalePratim's Macbrow, I built Winbrow: a Windows voice assistant.
@GradiumAI speech + @typesafeai Jev routing + browser automation adapted from @browser_use’s Jev Ultrafast project.
@Alibaba_Qwen 4B LLM handles replies. Phonon (TTS) speaks them both running locally on @Qualcomm_Dev X Elite’s NPU.
Built for Phonon’s OSS launch!
I've always wanted a way to talk to my Mac and do things on the go.
Until now, it was super slow.
So I built Macbrow.
Voice-controlled browser and computer-use agent.
Built using @GradiumAI @browser_use and @typesafeai
Still early and a work in progress.
github.com/timpratim/macbrow
Shivay Lamba retweeted
I got to build with @GradiumAI Phonon on launch day!
A smart mirror that sees your outfit and gives spoken style recommendations - all running locally on @arduino Ventuno Q.
@Alibaba_Qwen VLM to understand what you’re wearing
Phonon TTS to talk through suggestions
Both accelerated by the @Qualcomm_Dev Hexagon NPU
A new frontier for on-device speech.
We're open-sourcing Phonon, a suite of TTS models under 50m parameters, setting a new standard for naturalness and accuracy across languages, with the broadest inference support to date.
Phonon-31m is available under Apache 2.0.
gradium.ai/phonon🧵
I got to build with @GradiumAI Phonon on launch day!
A smart mirror that sees your outfit and gives spoken style recommendations - all running locally on @arduino Ventuno Q.
@Alibaba_Qwen VLM to understand what you’re wearing
Phonon TTS to talk through suggestions
Both accelerated by the @Qualcomm_Dev Hexagon NPU
A new frontier for on-device speech.
We're open-sourcing Phonon, a suite of TTS models under 50m parameters, setting a new standard for naturalness and accuracy across languages, with the broadest inference support to date.
Phonon-31m is available under Apache 2.0.
gradium.ai/phonon🧵
Fun setup to work on - and support the Phonon TTS pipeline via GenieX targetting the NPU
it was fun to work on this in collab with @carrycooldude @ashwinexe @BhosalePratim
Shivay Lamba retweeted
Our latest model advances bring stronger capabilities for building and migrating software in low-resource programming languages such as COBOL, Fortran, and Visual Basic.
These languages power software that banks, governments, and businesses depend on. Progress here means understanding decades of business logic and helping developers modernize those systems while preserving what works.
We’re building these capabilities around the challenges developers and enterprise customers bring us. If your team is working on these systems, tell us which languages and workflows we should tackle next.
openai.com/index/low-resourc…
Shivay Lamba retweeted
How to cut coding-agent costs by ~78.5% using Jev to route between open models
All 32 selected coding tasks passed hidden tests.
Plus: Beam vs Muse Spark across 20 coding tasks - comparing cost, speed, and results 👇
