Carlos Guestrin (@guestrin) header
Carlos Guestrin (@guestrin) profile picture

@Stanford Prof. @Noeri_AI Co-CEO. National Acad of Eng. Frm Sr Dir AI @Apple. Co-author of XGBoost, LIME, TextGrad, Alpaca, TVM, GraphLab.

Stanford
Joined November 2009
Photo by Carlos Guestrin (@guestrin)Photo by Carlos Guestrin (@guestrin)Photo by Carlos Guestrin (@guestrin)Photo by Carlos Guestrin (@guestrin)Photo by Carlos Guestrin (@guestrin)Photo by Carlos Guestrin (@guestrin)Photo by Carlos Guestrin (@guestrin)Photo by Carlos Guestrin (@guestrin)Photo by Carlos Guestrin (@guestrin)Photo by Carlos Guestrin (@guestrin)
Carlos Guestrin retweeted
I don't think people have realized how crazy the results are from this new TTT + RL paper from Stanford/Nvidia. Training an open source model, they - beat Deepmind AlphaEvolve, discovered new upper bound for Erdos's minimum overlap problem - Developed new A100 GPU kernels 2x faster than the best human kernel - Outperformed the best AI coding attempt and human attempt on AtCoder The idea of Test Time Training is to train a model *while* it's iteratively trying to solve a task. Combining this with RL like they do in this paper opens up the floodgates of possibilities for continual learning Authors: @mertyuksekgonul @LeoXinhaoLee @JedMcCaleb @xiaolonw @jankautz @YejinChoinka @james_y_zou @guestrin @sun_yu_
45
196
14
1,745
111,814
Carlos Guestrin retweeted
Excited to share our release of LOTUS 1.1.0, which now makes it easier than ever to get started with LLM-powered data processing over a variety of custom knowledge sources. Seamlessly connect to data from the web, your SQL databases, vector databases and more. And process it all with the power of semantic operators. github.com/lotus-data/lotus
7
28
5
152
19,125
SAIL is delighted to announce Carlos @guestrin, the Fortinet Founders Professor of Computer Science, as the next Director of @StanfordAILab. Carlos is a talented researcher and leader, known for his work on explainability, graphs, compilation, and boosted trees in AI.
6
20
1
95
11,531
Carlos Guestrin retweeted
We've been building LOTUS at Stanford and Berkeley to make LLM-powered data processing fast, easy and declarative. LOTUS is an open-source query engine that makes programming as easy as writing Pandas and optimizes your programs for up to 400x speedups. To celebrate the holidays, we're excited to share our release of LOTUS 1.0.0 with a batch of new updates that make reasoning over your data faster, easier and better than ever! Code: github.com/guestrin-lab/lotu… 🧵👇
16
181
17
1,276
161,512
Carlos Guestrin retweeted
Can interpretability help defend LLMs? We find we can reshape activations while preserving a model’s behavior. This lets us attack latent-space defenses, from SAEs and probes to Circuit Breakers. We can attack so precisely that we make a harmfulness probe output this QR code. 🧵
11
82
19
372
59,128
Carlos Guestrin retweeted
🧵LLMs are great at synthesizing info, but unreliable at citing sources. Search engines are the opposite. What lies between them? Our new paper runs human evals on 7 systems across the✨extractive-abstractive spectrum✨for utility, citation quality, time-to-verify, & fluency!
1
23
2
66
14,481
Carlos Guestrin retweeted
Super excited to share our work on LOTUS, a query engine for reasoning over large corpuses of data with LLMs! Joint work w/ the amazing @sid_jha1, @matei_zaharia & @guestrin Read the paper: arxiv.org/abs/2407.11418 Try out the code: github.com/stanford-futureda… 🧵👇
8
31
8
184
33,689
Prior work has used LLMs to simulate survey responses, yet their ability to match the distribution of views remains uncertain. Our new paper [arxiv.org/pdf/2411.05403] introduces a benchmark to evaluate how distributionally aligned LLMs are with human opinions. 🧵
4
36
3
155
28,444
Carlos Guestrin retweeted
Many providers offer inference APIs for the same models: for example, there were over nine Llama-3 8B APIs in Summer 2024. Do all of these APIs serve the same completion distribution as the original model? In our new paper, ✨Model Equality Testing: Which Model is This API Serving?✨, we formalize this question as a two-sample distribution testing problem: the user collects samples for their task from the API and a reference distribution, and conducts a statistical test to see if the two distributions are the same. We design tests which show nontrivial power in detecting when models have been quantized, watermarked, or finetuned! (🧵 1/5)
7
34
7
167
46,417
Carlos Guestrin retweeted
It’s happening! TVM Conference. Incredibly proud of and grateful to the whole UW SAMPL team and TVM contributors.
7
3
48
Carlos Guestrin retweeted
"if... users do not trust a model or a prediction, they will not use it" -@sameer_ @guestrin arxiv.org/abs/1602.04938v1
12
21
Carlos Guestrin retweeted
LIME, an algorithm that can explain the predictions of any classifier or regressor in a faithful way by @guestrin goo.gl/OdyG1i
21
57
Dato GraphLab demo yesterday CSIRMDS. Looking forward to trying it out cc @datoinc @nunuska @vasiloglou #datascience
3
5
7 Python Tools All Data Scientists Should Know How to Use ow.ly/UTnBO
17
36