Omar Khattab retweeted
extremely excited for our upcoming releases. retrievers aren't even vaguely close to anything resembling a ceiling
Omar Khattab retweeted
We've released a technical report on the released late interaction models
It's purposely kept short, simple and direct, because most of the recipe is not new (shared space is not really new as well, but pretty cool for ColBERT still)
There are still a lot of technical information if you are interested beyond the BP
We are preparing much more thorough papers for things where we did really bring a lot of novelty, pretty sure you'll enjoy those!
arxiv.org/pdf/2610.29523v1
Omar Khattab retweeted
Save 50%, only on Oct 21st!
Today, you can save on Building LLM Applications with DSPy by Serj Smorodinsky and Brett Kennedy — now in print — and other related titles: hubs.la/Q04BMk270
Learn how to build DSPy into fully agentic pipelines, integrating conversation memories, and connecting agents to external environments via MCP.
Omar Khattab retweeted
applications for slingshots more than doubled from batch 3 to batch 4.
funding open science is critical to democracy.
never in the past have scientists had to turn down so much money to do research they can talk about openly. top PhD students are receiving offers of millions of dollars per year from closed labs.
i'm proud that at Laude we support open research.
great work on slingshots batch four @bradenhancock and the @laudeinstitute team
Omar Khattab retweeted
No one changes the world alone
Introducing Ampersand - the first model built for us. Ampersand is a collaborator trained to help people achieve their individual and collective goals. In multi-month simulations, users collaborating with Ampersand accomplished more than with Fable and other frontier models
Available to everyone through our API
Omar Khattab retweeted
Incredibly grateful to @LaudeInstitute for supporting our work on WaggleHaus!
TL;DR: We believe that supporting agentic queries over massive data lakes requires rebuilding the data system from the ground up.
This includes ideas ranging from:
- making the data layer more "agent-friendly"
- to specializing the inference engine for the query workload
- to running agents within the system that continuously update views and indices for faster data access
If you're interested in a demo or becoming an industry design partner you can sign up here: wagglehaus.ai
Replying to @LaudeInstitute
WaggleHaus // @RussoMatthew, @tianyu_li_, @MikeCafarella, @tim_kraska, @samrmadden (@MIT, @UWMadison) — A query engine for executing semantic and agentic queries over enterprise-scale data lakes.
Omar Khattab retweeted
Check out our latest research: MemCurrent, a persistent agent memory architecture, which consistently stays on the cost-accuracy Pareto frontier on our internal and three public benchmarks. Try it in the new Agent Bricks Memory and Genie 🚀
Introducing MemCurrent, a persistent memory architecture designed to help production agents stop starting from zero.
MemCurrent combines episodic memory with derived memory across three access patterns:
• Plugins to log and load context automatically
• Tools the agent calls on demand
• An offline “dreaming” pipeline that consolidates memory in the background
Agents carry forward user preferences, prior corrections, metric definitions and successful workflows instead of rediscovering them every session.
On our internal benchmark built from real enterprise data, MemCurrent triples the agent's pass rate while using 31% fewer tokens and running 26% faster. It's built into Agent Bricks' Memory offering and already powers memory in Genie.
Read the research: databricks.com/blog/memcurre…
Omar Khattab retweeted
ScholarCatalyst is part of Slingshots Four!
Deeply “reading” the literature, i.e. knowing which earlier idea a new problem needs, takes years to get even okay at. Even the best systems do poorly on ScholarCatalyst. With @LaudeInstitute's support, we’ll train directly for this.
Replying to @LaudeInstitute
ScholarCatalyst // @yoonholeee, @ohmyksh, @chelseabfinn (@Stanford) — A benchmark for finding prior work that could inspire scientific research, and a retrieval system trained for this task.
Omar Khattab retweeted
Pedagogical RL // @SOURADIPCHAKR18, @NoahZiems, @amritsinghbedi3, @lateinteraction (@MIT, @LaudeInstitute) — A reinforcement learning framework that teaches AI models to generate plausible, successful reasoning trajectories they can learn from for challenging tasks.
Omar Khattab retweeted
Headlong // @NickAJalbert, @bradenjhancock, @NoahZiems, @a1zhang, @lateinteraction, @andykonwinski (@LaudeInstitute, @MIT) — A microharness for persistent agents.
Omar Khattab retweeted
Slingshots // Four is live!
Another batch, another fourteen projects shipping open source artifacts that I’m excited about. See below for the full list. A few themes from the batch:
1. Harness time: This quarter harnesses shot up in visibility, with increased appreciation for the parts of an agent that aren’t the model and what they can give you. This batch includes a harness supporting persistent agency (Headlong); a harness supporting self-improvement via context management (ACE); a harness supporting self-improvement of the agentic harness itself (Exo); and a harness supporting multi-agent setups (dotagents).
2. Up and down the stack: There’s innovation to be had at every layer of the stack. We saw projects worth backing at the level of kernels (Thunderkittens); inference (M*); training (Marin); data (Atlantic-CC); evals (Decision Assistants); optimization (SkyDiscover); applications (Wagglehaus), etc.
3. Talk of the town: Slingshots continue to tackle timely problems at the frontier. Concurrent with Jev taking over X, an even faster type 1 decision model (CLM) came out of academia. With RSI on the brain of every big lab researcher, we now have a public literature retrieval benchmark grounded in authors’ firsthand accounts of their research process (ScholarCatalyst). And a new RL training method (Pedagogical RL) addresses head-on the question vexing RL practitioners of how privileged information can be used to discover generalizable behaviors, not just verify.
Congrats to all the researchers in this batch and the previous three who continue to ship their research out into the world with open artifacts that can be adopted and built upon. Open science leads to better outcomes for everyone.
And the good times will continue to roll – batch five is looking just as good. If you’re a researcher with a project that’s gaining momentum and ready for an adrenaline shot, shoot me a DM or apply at laude.org/slingshots.
👏 @a1zhang, @AlexKrentsel, @ankrgyl, @Azaliamirh, @bariskasikci, @bfspector, @chelseabfinn, @chipro, @Diyi_Yang, @dlwh, @drmapavone, @HazyResearch, @jackyk02, @jonasgeiping, @JonSaadFalcon, @jure, @kothasuhas, @lateinteraction, @martin_casado, @mertcemri, @michaelryan207, @MikeCafarella, @NickAJalbert, @NoahZiems, @nsagan271, @ohmyksh, @percyliang, @qizhengz_alex, @RussoMatthew, @samrmadden, @shagarw21, @ShashwatGoel7, @shulynnliu, @simran_s_arora, @souradipchakr18, @stuart_sul, @tianyu_li_, @tim_kraska, @WilliamBarrHeld, @yoonholeee, @YejinChoinka, @Stanford, @MIT, @LaudeInstitute, @CarnegieMellon, @UW, @UCBerkeley, @MPI_IS, @UWMadison
Omar Khattab retweeted
ScholarCatalyst // @yoonholeee, @ohmyksh, @chelseabfinn (@Stanford) — A benchmark for finding prior work that could inspire scientific research, and a retrieval system trained for this task.
Omar Khattab retweeted
I'm giving a Rising Star talk on text optimization and "cumulative learning" at the AI Symposium at UMich today! (10:15AM ET)
⏰ Happening TOMORROW!
The 2026 #MichiganAI Symposium brings together researchers, industry leaders & students to explore foundational models & their impact on academia, industry and society.
🎤 Keynotes, talks, posters & more, join us at @UMichCSE!
ai.engin.umich.edu/events/20…
Omar Khattab retweeted
reading through these, I find it to be so different from my worldview
“My software skills are now irrelevant”
it’s a lie. doomerism. industry nihilism
idk about what secret SOTA models you have access to, but from what I see across my clients with hundreds of engineers is that software skills are more relevant than ever.
having judgment, knowing what architecture and scope of changes make sense, being decisive on what to NOT work on. being able to look at a change and know there’s a better way. all still matters.
the “real” work of software engineer is now 10x levered.
a capable engineer’s value has gone up. they’re not bottlenecked by implementation time and can leverage their skills at a much higher level.
“The LLM can do everything now”
really?
you see PMs and marketing building better systems and outperforming you, the engineer?
it’s easy to autopilot slop, create a prototype and thrash a codebase. it requires skill to build something of quality that not only impacts your company but also your customer base.
don’t buy into the “it’s so over”
we’re so back and never left
Omar Khattab retweeted
Not gonna lie, I was kind of surprised that we were able to create a review bot that’s apparently both faster and cheaper than all these venture backed solutions in just a week, given how much investment is going into coding and review agents right now. 🤷♂️ maybe just a different place on the cost-quality-speed curve (a fast high quality review is worth a dollar to us and maybe isn’t to someone else)? in any case, we’re happy customers of ourselves.
When we released headlong.ai, we got a spike of contributions (good problems!) but found ourselves knee-deep in PRs.
Luckily, Laude’s eng team has a lot of freedom to experiment, plus a tendency to favor DIY over off-the-shelf. @NickAJalbert, Justin Fiedler, @andykonwinski & team built and open-sourced RevEngine to hoist humans out of the loop during code review. It's since landed at the top of @GitHub’s ReviewBench leaderboard.
More on process and learnings in a blog soon. Let’s see if we can hold #1 until then 👀
Omar Khattab retweeted
When we released headlong.ai, we got a spike of contributions (good problems!) but found ourselves knee-deep in PRs.
Luckily, Laude’s eng team has a lot of freedom to experiment, plus a tendency to favor DIY over off-the-shelf. @NickAJalbert, Justin Fiedler, @andykonwinski & team built and open-sourced RevEngine to hoist humans out of the loop during code review. It's since landed at the top of @GitHub’s ReviewBench leaderboard.
More on process and learnings in a blog soon. Let’s see if we can hold #1 until then 👀
Omar Khattab retweeted
an increasingly important question is going to be: is your retriever good at tip-of-the-tongue queries?
Not because you'll often encounter them in the wild, but because they capture how deeply your model understands intent.
@dianetc_ was ahead of the curve here
Omar Khattab retweeted
The first person I tried to give my book to didn't want it.
Its published by O'Reilly, costs $70 on Amazon and I spent 9 months of my life writing it. Many more years before that learning the topic myself.
He asked me if I actually even look at the code anymore? He's a great engineer but today he just tells Claude to do it and he doesn't care if it uses DSPy or not. He wasn't sure why he'd need to read a book on the topic.
Actually DSPy is the only code I still look at because they boiled it all down to just a spec - you write inputs and outputs for each module then chain them together and the optimizer handles the prompt. Helps me reason about the workflow I'm automating.
I also just think it's useful to read the concepts in a book so you know how to steer Claude to try specific patterns that work. Even if you don't look at the code. Also as something to browse looking for ideas.
My first book for O'Reilly on prompt engineering came out in 2023 and sold over 10,000 units in year one, about half digital half physical. It'll be interesting to see what happens this time now that the world has moved on.
What do you think? Do you still read physical books? Should I make a version for your agent?
I joked he could rip the spine off and scan the pages in for Claude like Anthropic did with rare books. 😅
































