Chief Scientist @dbnlAI #AITesting, Founder @ https://xitter.cf/t.co/IevLGfnUT0 PhD in #biostatistics @UCBerkeley, founder @wimlds, co-founder @RLadiesGlobal

Oakland, California, USA 🌴
Joined February 2009
Hey folks, come and find me elsewhere? I'm trying to move my attention and energy to the Good Place.
2
7
1,305
Erin LeDell - ledell.bsky.social retweeted
Cancer patients with the same diagnosis often have very different tumor biology. Molecular testing can reveal underlying differences, but that's slow and expensive. Introducing Holon-S1, our platform to predict genes and biomarkers from routine pathology slides. • beats two other models at predicting spatial gene activity in a controlled comparison • has identified potentially novel biomarkers in breast cancer and colon cancer • evaluated across 16 organ types and more than 15 scanners, using slides from both formalin-fixed, paraffin-embedded and fresh-frozen tissue. We believe Holon-S1 has the potential to help researchers find new biomarkers in slides they already have, discover treatment targets, and bring more personalized cancer care within reach!
170
344
78
2,636
248,225
Erin LeDell - ledell.bsky.social retweeted
The world is sleeping on the amazing things we can do with cheap fast neutrons. Marathon (led by the inimitable trio Kyle, Adam, @jfp_fusioneer) is building a reactor for isotopes, batteries, alchemy, & more. Climbing the ladder to precise matter control & abundant electricity
Last month, we demonstrated high-rate alchemy: turning mercury into real, stable gold, beating CERN’s record by a factor of 10. Last week, we enriched isotopes in the world’s most powerful plasma centrifuge, beating the Soviet record that stood for 40 years. Now, we’re building a fusion reactor in San Francisco to achieve record power density.
3
16
936
Erin LeDell - ledell.bsky.social retweeted
Last month, we demonstrated high-rate alchemy: turning mercury into real, stable gold, beating CERN’s record by a factor of 10. Last week, we enriched isotopes in the world’s most powerful plasma centrifuge, beating the Soviet record that stood for 40 years. Now, we’re building a fusion reactor in San Francisco to achieve record power density.
1,241
3,583
2,909
25,761
8,881,288
Erin LeDell - ledell.bsky.social retweeted
New Mexico has issued a public health order that removes federal restrictions to COVID-19 vaccine access so that pharmacies in New Mexico can vaccinate people of all ages and risk profiles. Every state needs to do this!
708
6,747
426
27,586
616,197
Sara is one of the most amazing AI leaders I know. She's built one of the most unique labs in the industry, made huge advances in the field, all while being a fierce champion for under-served communities. If you don't know her work, please have a look at her post below!
It has been an incredible honor to spend the past few years leading @Cohere_Labs @cohere . This has been the adventure of a lifetime. However, after much deliberation, I made a tough decision 2 months ago it is time to say goodbye.
7
1,184
Erin LeDell - ledell.bsky.social retweeted
I open sourced Sniffly, a tool that analyzes Claude Code logs to help me understand my usage patterns and errors. Key learnings. 1. The biggest type of errors Claude Code made is Content Not Found (20 - 30%). It tries to find files or functions that don't exist. So I restructured my code base for discoverability, and the average number of steps Claude Code needs for each instruction went from 8 to 7 steps.
45
127
26
1,197
155,926
Erin LeDell - ledell.bsky.social retweeted
BREAKING (ACLU): A federal judge reversed NIH's terminations of hundreds of critical research grants that were canceled because of their alleged connection to disfavored topics, including diversity, equity, inclusion, and gender identity. This is a major win for public health.
11
956
23
4,132
88,551
Erin LeDell - ledell.bsky.social retweeted
new blogpost on writing in the ~glorious~ age of LLMs
19
161
11
1,374
119,027
Erin LeDell - ledell.bsky.social retweeted
Use Signal. We promise, no AI clutter, no surveillance ads—whatever the rest of the industry does. We lead we don’t follow❤️
151
590
65
3,191
305,489
Erin LeDell - ledell.bsky.social retweeted
As someone who was formally trained in applied statistics, this book legitimately changed my life. It's old now, but fundamentally it's the intellectual bridge between statistics and machine learning. And I crossed it.
What is the best book you ever read on Artificial Intelligence and Machine Learning?
16
18
4
383
35,739
Erin LeDell - ledell.bsky.social retweeted
Truly excellent video by @MLStreetTalk about how a handful of providers have systematically overfit to @lmarena_ai. 26 mins of video showcase how easy it has been to distort the rankings. As scientists, we must do better. As a community, I hope we can demand better.
3
20
3
133
8,816
Erin LeDell - ledell.bsky.social retweeted
This happens when you don’t have good AI evals
I just got off the phone with a founder. It was an early Sunday morning call, and they were distraught. The company had launched with a breakout AI feature. That one worked. It delivered. But every new release since then? Nothing’s sticking. The team is moving fast. They’re adding features. The roadmap looks full. But adoption is flat. Internal momentum is fading. Users are trying things once, then never again. No one’s saying it out loud, but the trust is gone. This is how AI features fail. Because they teach the user a quiet lesson: don’t rely on this. The damage isn’t logged. It’s not visible in dashboards. But it shows up everywhere. In how slowly people engage. In how quickly they stop. In how support teams start hedging every answer with “It should work.” Once belief slips, no amount of capability wins it back. What makes this worse is how often teams move on. A new demo. A new integration. A new pitch. But the scar tissue remains. Users carry it forward. They stop expecting the product to help them. And eventually, they stop expecting anything at all. This is the hidden cost of broken AI. Beyond failing to deliver, it inevitably also subtracts confidence. And that subtraction compounds. You’re shaping expectation, whether you know it or not. Every moment it works, belief grows. Every moment it doesn’t, belief drains out. That’s the real game. The teams that win build trust. They ship carefully. They instrument for confidence. They treat the user’s first interaction like a reputation test, because it is. And they fix the smallest failures fast. Because even one broken output can define the entire relationship. Here’s the upside: very few teams are doing this. Most are still chasing the next “AI-powered” moment. They’re selling potential instead of building reliability. If you get this right, you become the product people defend in meetings. You become the platform they route their workflow through. You become hard to replace. Trust compounds. And when it does, it turns belief into lock-in.
5
7
2
74
13,059
Erin LeDell - ledell.bsky.social retweeted
It is very easy to make mistakes when creating evals for your AI product. @sh_reya and I run through the most common mistakes in this talk (with memes 🌶️!) . Chapter summaries below: 00:51 Foundation model benchmarks are not the same as your application evals 03:00 Generic Evals Are Useless 04:00 Do not outsource labeling & prompting to non domain experts 09:28 You should make your own data annotation app 12:40 Your LLM prompts should be specific and grounded in error analysis 15:25 Use binary labels 18:57 Look at your data 23:41 Be careful of overfitting to test data 25:40 Do online tests Links more resources in the reply
10
33
6
310
46,186
Erin LeDell - ledell.bsky.social retweeted
This is going to be one of the highest signal sessions of the series. Most issues with RAG are poor retrieval. Search OG @softwaredoug is going to share his bag of tricks from 10 years of optimizing search in industry maven.com/p/29a33a/hybrid-se…
RAG is dead posts are annoying as F "R" is retrieval and "AG" is the LLM. This means you think retrieval is dead. Seriously, you think retrieval is dead? Keyword search, metadata filtering (dates, users), grep, and other filtering are retrieval. Good luck without retrieval
2
19
1
132
23,320
Erin LeDell - ledell.bsky.social retweeted
Overview of Large Language Models for Statisticians They bridge the gap between statistics and AI - identifying key areas where statistical expertise can enhance LLM development. List emerging statistical challenges in LLM: uncertainty quantification, decision-making, causal inference, distribution shift, interpretability, fairness, privacy and watermarking.
2
3
17
1,046
Erin LeDell - ledell.bsky.social retweeted
I'm excited to teach this lightning lesson with @sh_reya on improving your AI consistently with evals. Even though this is the most important topic in applied AI, there are sparse educational materials on this! We are fixing that in this series. maven.com/p/0c0359/improve-a…
5
24
167
10,030
Erin LeDell - ledell.bsky.social retweeted
Brilliant protest. Yosemite National Park workers hung an upside-down American flag — traditionally a symbol of distress or a national threat — thousands of feet off the ground on the side of El Capitan.
4,280
17,723
1,237
145,642
6,049,929