Professor, MIT EECS and Chief Scientist, Cambridge Mobile Telematics

Joined May 2011
WaggleHaus // @RussoMatthew, @tianyu_li_, @MikeCafarella, @tim_kraska, @samrmadden (@MIT, @UWMadison) — A query engine for executing semantic and agentic queries over enterprise-scale data lakes.
1
1
1
14
1,816
Slingshots // Four is live! Another batch, another fourteen projects shipping open source artifacts that I’m excited about. See below for the full list. A few themes from the batch: 1. Harness time: This quarter harnesses shot up in visibility, with increased appreciation for the parts of an agent that aren’t the model and what they can give you. This batch includes a harness supporting persistent agency (Headlong); a harness supporting self-improvement via context management (ACE); a harness supporting self-improvement of the agentic harness itself (Exo); and a harness supporting multi-agent setups (dotagents). 2. Up and down the stack: There’s innovation to be had at every layer of the stack. We saw projects worth backing at the level of kernels (Thunderkittens); inference (M*); training (Marin); data (Atlantic-CC); evals (Decision Assistants); optimization (SkyDiscover); applications (Wagglehaus), etc. 3. Talk of the town: Slingshots continue to tackle timely problems at the frontier. Concurrent with Jev taking over X, an even faster type 1 decision model (CLM) came out of academia. With RSI on the brain of every big lab researcher, we now have a public literature retrieval benchmark grounded in authors’ firsthand accounts of their research process (ScholarCatalyst). And a new RL training method (Pedagogical RL) addresses head-on the question vexing RL practitioners of how privileged information can be used to discover generalizable behaviors, not just verify. Congrats to all the researchers in this batch and the previous three who continue to ship their research out into the world with open artifacts that can be adopted and built upon. Open science leads to better outcomes for everyone. And the good times will continue to roll – batch five is looking just as good. If you’re a researcher with a project that’s gaining momentum and ready for an adrenaline shot, shoot me a DM or apply at laude.org/slingshots. 👏 @a1zhang, @AlexKrentsel, @ankrgyl, @Azaliamirh, @bariskasikci, @bfspector, @chelseabfinn, @chipro, @Diyi_Yang, @dlwh, @drmapavone, @HazyResearch, @jackyk02, @jonasgeiping, @JonSaadFalcon, @jure, @kothasuhas, @lateinteraction, @martin_casado, @mertcemri, @michaelryan207, @MikeCafarella, @NickAJalbert, @NoahZiems, @nsagan271, @ohmyksh, @percyliang, @qizhengz_alex, @RussoMatthew, @samrmadden, @shagarw21, @ShashwatGoel7, @shulynnliu, @simran_s_arora, @souradipchakr18, @stuart_sul, @tianyu_li_, @tim_kraska, @WilliamBarrHeld, @yoonholeee, @YejinChoinka, @Stanford, @MIT, @LaudeInstitute, @CarnegieMellon, @UW, @UCBerkeley, @MPI_IS, @UWMadison
Introducing Slingshots // FOUR: 14 projects across eight top institutions. Self-improving agent systems and harnesses, maximally-open models and training data, applications for research and decision-making – plus kernels and more. Say hello to the batch 🧵
7
12
1
56
9,452
Cool new work from my student Joshua.
Recent agentic systems (Claude Code, Codex, RLM, etc.) push context out of the prompt and into the environment (e.g., as files). This helps them maintain long-term knowledge about their goals and functionality. 🚨 While this is a good idea, we show a surprising result: systems that use external environments like this perform much better when given a small, fixed-size, in-context, agent-managed cache that "𝘱𝘦𝘦𝘬𝘴 𝘪𝘯𝘵𝘰" these environments. 🚀 Our paper, 𝗣𝗘𝗘𝗞: 𝙖 𝙨𝙮𝙨𝙩𝙚𝙢 𝙛𝙤𝙧 𝙗𝙪𝙞𝙡𝙙𝙞𝙣𝙜 𝙖𝙣𝙙 𝙢𝙖𝙞𝙣𝙩𝙖𝙞𝙣𝙞𝙣𝙜 𝗮𝗻 𝗼𝗿𝗶𝗲𝗻𝘁𝗮𝘁𝗶𝗼𝗻 𝗰𝗮𝗰𝗵𝗲 𝙛𝙤𝙧 𝙇𝙇𝙈 𝙖𝙜𝙚𝙣𝙩𝙨, introduces this idea. Compared with strong baselines, including RAG, Compaction Agents, and SOTA prompt-learning frameworks, PEEK dominates the cost–quality Pareto frontier: achieving +6.3–34.0% in quality, with fewer iterations and lower cost. Paper: arxiv.org/abs/2605.19932 GitHub: github.com/zhuohangu/peek More in the thread below! (1/N)
4
24
7,064
Sam Madden retweeted
📢 CfP: Conference on Innovative Data Systems Research #CIDR2027 (Amsterdam, The Netherlands). Papers due: August 4, 2026. @ViktorLeis, @samrmadden, and I are looking forward to your paper & demo submissions! cidrdb.org/cidr2027/
3
1
14
991
Interesting article about #SemBench, a new benchmark for semantic AI operators; our Palimpsest system does super well on it!
📣 We're spreading the word about #SemBench -- a brand new benchmark for semantic query processing over multimodal workloads including text, image, audio, and tabular data! 📜Paper: bit.ly/3WGsZf6 💻Website: sembench.org 💾Code: bit.ly/49DeuAg
1
800
Start thinking about your CIDR submissions now!
📢 CfP: Conference on Innovative Data Systems Research #CIDR2026 (Chaminade, USA). Papers due: August 5, 2025. Gustavo Alonso, @samrmadden, and I are looking forward to your paper & demo submissions! cidrdb.org/cidr2026/
1
2
1,413
Henry Corrigan-Gibbs, a professor in @MITEECS, has been named a recipient of the 2024 Junior Bose Award.
5
11
1,306
Last chance to register for CIDR 2025 in Amsterdam!
The CIDR 2025 program is online: cidrdb.org/cidr2025/program.… Registration closes today -- Join us in Amsterdam: cidrdb.org/cidr2025/registra…
1
4
1,832
Sam Madden retweeted
Vol:17 No:12 → Databases Unbound: Querying All of the World’s Bytes with AI vldb.org/pvldb/vol17/p4546-m…
1
5
30
4,103
It took three years to finish, but our follow-up to the 2006 "What Goes Around Comes Around" is finally out! Stonebraker and I examine the last 20 years in databases and discuss why relational databases + SQL will continue to remain on top. 📄PDF: db.cs.cmu.edu/papers/2024/wh…
23
332
68
1,254
173,178
Sam Madden retweeted
Sam Madden: ”The world is the database” @samrmadden @SIGMODConf #SIGMOD2024 🎉
5
1
51
10,426
Excited to announce the release of our Palimpzest system and paper!
Replying to @RussoMatthew
If this (very high-level) summary of our work has piqued your interest -- go read our full paper! 📄Paper: arxiv.org/pdf/2405.14696 💻Code: github.com/mitdbg/palimpzest… We would love to hear any feedback, ideas for more use cases, and/or opportunities for collaboration.
9
1,574
Submit to #NEDB2024 by 4/12 (11:59pm EST): cmt3.research.microsoft.com/… * Talks (2-page abstracts) on recent/new research or industry experience * Posters (1-page abstract) Stay tuned for more details on registration! bu-disc.github.io/nedbday/20… @samrmadden @vkalavri @__ssarkar
4
2
6
2,401
Amazon Redshift Serverless is launching next gen AI-driven scaling and optimizations. With the great work of @tim_kraska and his team, Redshift pushes the capabilities of serverless data analytics! #amazon #redshift #serverless #aidrivenscaling
6
1
16
3,418
It's official — our company, @ponderdata, is all set to join Snowflake! So delighted that we're joining forces with the leading cloud data warehouse — and bringing our data science capabilities to all their customers.
Snowflake announced its intent to acquire @ponderdata to further enable Python data scientists in the Data Cloud. We look forward to welcoming the Ponder team and the Modin community to Snowflake. Learn more: okt.to/I6WXlc
26
15
2
220
47,061
I make a guest appearance!
This quoted post is unavailable.
5
872
What are the most influential database papers of all time? Everyone has an opinion, but here's some data! I ran PageRank on the VLDB/SIGMOD/CIDR citation graph. Search for a paper, view a specific year, or look up an author's most "influential" papers. rmarcus.info/blog/2023/07/25…
7
23
4
115
17,114