
Grad Student @Mila_Quebec & @mcgill | Prev: Research Associate @mbzuai; AI Resident @ai4bharat; Intern @ucsd | Cooking stuff around LLMs ...
Mumbai, India
Joined September 2016
- Tweets675
- Following2.2K
- Followers418
- Likes1.7K
Jay Gala retweeted
Hi all, I have a new result I'm excited to share. It turns out that *all existing implementations* of softmax and cross-entropy (that's JAX, PyTorch, textbooks, etc) have a subtle bug --- two bugs, actually. A simple rewrite fixes both, and eliminates "slingshots" when grokking:
Jay Gala retweeted
We will be teaching Agentic GPU Programming for MLSys as part of the CMU ML Systems course this upcoming spring at @SCSatCMU, touching on knowledge curation, compiler analysis, and feedback loops. We also curated an online book on the topic, check it out mlc.ai/agentic-gpu-programmi…
Jay Gala retweeted
RL with LLMs is very unstable when training and sampling policies differ. Standard fixes (matching numerics, importance sampling) work around the problem.
We find the root cause of this instability from first principles and propose a way to directly cancel it. Score Centering is competitive and compatible with existing approaches — while simple to implement!
🧵 [1/6]
Jay Gala retweeted
Introducing 𝙤𝙥𝙚𝙣-𝙖𝙜𝙚𝙣𝙩-𝙫𝙞𝙚𝙬, an open dashboard for managing all your agents across any harness.
Based on Claude Agent View, it lets you manage any coding agent (Claude, Codex, Pi, OpenCode, Muse Code, Qwen, etc.) in one agent view dashboard:
github.com/xhluca/open-agent…
Jay Gala retweeted
Introducing 𝙨𝙚𝙨𝙨𝙞𝙤𝙣-𝙢𝙞𝙜𝙧𝙖𝙩𝙚, a tool for migrating coding agent sessions across Claude Code, Codex, Pi, OpenCode, and more.
If you started in Claude but ran of usage, you can now convert your session to another harness in one command:
github.com/xhluca/session-mi…
Jay Gala retweeted
I recently gave a talk introducing young economists to post-training.
The slides are now up! kawine.github.io/assets/aies…
Not only is post-training your own model more doable than ever, but economists and other social scientists can play a big part in the next era of post-training.
The post-training suite looks roughly like:
1) SFT
2) Offline Methods (DPO/KTO/SimPO/etc)
3) Online Methods (PPO/GRPO/CISPO/etc)
4) RL Environments
5) Distillation (<--- we are here)
6) World Adaptation (<--- the future)
As agents are deployed in the real world, the real world will adapt to them. This adaptation is largely overlooked by the current post-training paradigm because working with verifiable rewards from static environments is much simpler and scalable. As we saw with the OpenAI-Huggingface incident however, we shouldn't assume that the real world will remain fixed---quite the opposite, in fact. So:
1. How can we anticipate real-world adaptation during post-training?
2. What do equilibria look like in these scenarios, if there are any at all?
3. What tools can be created to scale up human oversight?
Many such questions abound, and if you're an economist, these are high-impact problems worth studying.
Thoughts About Scaling Law
Scaling, but not only of parameters. Every model release now ends with the same question: how many parameters? It isn't a question that can be answered on its own. Parameter count is only meaningful alongside three others — how much data you have, where you intend to spend your compute, and who will run the model, under what conditions.
The field learned this the hard way. Kaplan et al. (2020) fit an exponent that told everyone to grow parameters faster than data — roughly 2.7:1 — and the industry complied: GPT-3, Gopher, MT-NLG. Hoffmann et al. (2022) redid the experiment across four hundred models and found the compute-optimal split is closer to 20 tokens per parameter, and that with sufficient compute the two should grow at the same rate rather than drifting apart. The error in the earlier fit compounded with every order of magnitude of compute, which is why the largest models of that generation were the most misallocated. The trillion-parameter round was, in retrospect, a detour the whole field took together and then reversed.
Chinchilla wasn't the end either. It optimized training compute for models that would be trained once and evaluated. Today a model is called billions of times a day and inference dominates lifetime cost. Put inference into the objective and the optimum moves toward smaller models trained far longer — deliberate over-training, which is what Llama-2-7B and Gemma-2-9B were doing at roughly 290 and 889 tokens per parameter.
Sparsity moved the target again. In a MoE model two quantities have to be kept apart: total parameters govern roughly how much the model can hold — knowledge, facts, the long tail — while activated parameters and effective depth govern roughly how far it can think, how many steps of a causal chain it can carry before it comes apart. A dense 20:1 ratio does not transfer. And the ratio isn't a single number at all: Roberts et al. (2025) find the optimal tokens-per-parameter is task-dependent, with memorization favoring more parameters and reasoning favoring more data. Follow-up work on MoE observes that at fixed TPP, pushing total parameters higher actually degrades reasoning, while activating more experts reliably helps it.
This matters for what we are building toward. Finding a vulnerability is not a retrieval problem. It doesn't come from having memorized more CVEs; it comes from carrying a twenty-step chain of inference to the end without losing the thread. That capability does not live in total parameter count.
Which brings us to this release. Total parameters appear to matter up to a threshold — enough to hold the world — after which additional capability comes from scaling elsewhere: effective depth per forward pass, and above all post-training. GLM-5.3 is our controlled experiment on that claim. Same base, same architecture, same total and activated parameters as GLM-5.2. One month of scaling long-horizon environments and RL. The gains are not marginal. Well, scaling has more than one dial. We turned the post-training one this time because it had the most slack left in it — not because the others are finished. Base model size, pretraining data, compute spent per forward pass: all of them are still on the table, and we will come back to each. What this experiment taught us is that the dials do not have to be turned together, and that the one worth turning next is rarely the one that was worth turning last. We are not done scaling. Next time, maybe mid-training, pre-training, and even more.
Jay Gala retweeted
How can an LLM switch between low-, medium-, and high-effort reasoning? And how does an LLM learn to reason more or less?
I put together a “little” article explaining how these effort levels are implemented at inference time and during training.
Jay Gala retweeted
Heard that some frontier models are basically a 48-layer transformer looped twice (48L x 2).
Now we are introducing DeepLoop: Depth Scaling for Looped Transformers (arxiv.org/abs/2607.13491),
making the loop transformer stable and scalable!
Jay Gala retweeted
Introducing agent-talk, a new way for coding agents to work together.
Through agent-talk, agents can message each other directly, enabling coordination on projects spanning multiple developers & agents. You no longer need to be the messenger between your agents.
Jay Gala retweeted
I had the honor of giving a keynote at the International Conference on Machine Learning in Seoul last week titled “What will be left for us to work on?” I addressed the widespread anxiety about how we should adapt as AI capabilities increase. I was thrilled by the talk’s reception, so I have made my slides available, annotated with a lightly edited transcript: cs.princeton.edu/~arvindn/ta…
I made three arguments. First, the "AI as Normal Technology" framework is a correct and useful as a way to think about AI’s impacts, unless and until there is some future discontinuity such as through recursive self-improvement. Second, even though we should take recursive self-improvement seriously, there is no milestone that companies might achieve in the lab that will suddenly put us all out of work. Third and finally, jobs of the future will be radically different, and a lot of adaptation will be needed. I shared my thinking about what this might look like and ended with a vision of human/AI “co-superintelligence”.
Jay Gala retweeted
new post on harness engineering for AI self-improvement: lilianweng.github.io/posts/2…
It is hard to forecast how much the future of RSI will rely on harnesses. Likely harness engineering will evolve in the direction of self-improvement and enable auto-research, and, in turn, smarter models keeps harnesses simple.
Even when many harness improvement get eventually internalized into core model, the need to specify goals and context will not disappear.
Jay Gala retweeted
Transformers use the same hidden state for two competing roles: maintaining state and predicting the next token. 🔀
Splitting these roles into two separate streams outperforms standard Transformers.
Introducing the State-Prediction Separation (SPS) Transformer.
🧵
Jay Gala retweeted
We have open-sourced our 4-bit hardware native RL recipe, w/ NO degradation compared to 8 bit!!
Checkout our blogpost!
Jay Gala retweeted
New paper on Understanding Compositional Generalization in Language Model Reasoning
Paper: arxiv.org/abs/2606.18089
This work studies why combining SFT with RL is so effective for post-training reasoning models. We argue that its success stems from compositional generalization, formalized through a hierarchical latent selection model in which reasoning is built by composing reusable atomic modules.
We show theoretically that SFT and RL play complementary but asymmetric roles: SFT provides compositional reasoning traces containing reusable atomic modules, while RL discovers and recombines these modules to achieve compositional generalization.
Experiments show that the strongest performance is achieved when SFT provides broad coverage and RL explores compositions beyond the SFT distribution.
See a more detailed thread by @LingjingKong.
1/9 Thanks to @IFM_MBZUAI for sharing our ICML 2026 work. We ask whether a model can solve a new reasoning problem by recombining skills it already knows -- how does the model attain "reasoning creativity" through this kind of compositional generalization? teapawt.org/IFM_MBZUAI/status/2075…
Jay Gala retweeted
cool new approach to address the spike problem in on-policy self-distillation by letting the privileged information steer the student distribution during rollouts directly
Jay Gala retweeted
More test-time compute leads to greater intelligence. But as we push ttc from seconds to weeks, latency becomes a bottleneck.
GPT-5.6 Sol Ultra scales parallel ttc. The time taken to generate a proof to a 50-year-old problem drops from perhaps a whole day to a single hour.
Jay Gala retweeted
pre-training scaling laws => LLMs generalize on test data
I convinced myself that this implication can be derived without much cheating in math. I suspect this was known to many experts, but I never seen it written down explicitly.
Jay Gala retweeted
New blog post: How to Build a Diffusion Language Model.
Diffusion LLMs went from open problem to reality in 2 years (Mercury, Gemma Diffusion, Nemotron Diffusion). With my Cornell group, we wrote up the research advances that make them work.
We use today's OSS large diffusion models as examples and show how they're built from core techniques:
• masked diffusion (MDLM)
• iterative refinement (UDLM, ReMDM)
• variable-length generation (block diffusion, encoder-decoder architectures)
• controllable generation (D-CFG, D-CBG)
• fast samplers (Duo)
• RL post-training (d1, d2)
This post covers research led by a talented group of Cornell PhD students including @mariannearr @SchiffYair @Guanghan__Wang
The content is adapted from talks I gave this year on dLLMs. It covers most of the main ingredients behind open-source diffusion language models today.
Link: kuleshov-group.github.io/blo…
Jay Gala retweeted
Starting now in Coronado Ball Room, 4th floor.
@MSFTResearch India is also hiring in Bengaluru. Drop by to chat with @pranjalchitale!
@mr_bytestorm @amt_shrma @bhawna_paliwal_ #ACL2026NLP #Nlproc






































