LLM Evals Workshop @NeurIPS retweeted
It has been a super fun day @LLM_eval workshop @NeurIPSConf with amazing talks, posters, and an engaging panel discussion!
@dawnsongtweets @natolambert @orf_bnw @sanmikoyejo @abeirami @hamishivi @MariusHobbhahn @beyzaermis @Diyi_Yang @attaluri_nithya @RishiBommasani @YangjunR
LLM Evals Workshop @NeurIPS retweeted
“Good researchers obsess over evals” by @natolambert @LLM_eval workshop!
LLM Evals Workshop @NeurIPS retweeted
Bringing the hot take culture to NeurIPS - great talk @orf_bnw!!
Replying to @LLM_eval
@LLM_eval workshop has started with Orhan Firat’s talk at Upper Level Room 2.
@NeurIPSConf
LLM Evals Workshop @NeurIPS retweeted
Replying to @dawnsongtweets
@dawnsongtweets is giving a talk on agentic evals @LLM_eval workshop!
LLM Evals Workshop @NeurIPS retweeted
Replying to @LLM_eval
@LLM_eval workshop has started with Orhan Firat’s talk at Upper Level Room 2.
@NeurIPSConf
LLM Evals Workshop @NeurIPS retweeted
Good researchers obsess over evals
The story of Olmo 3 (post-training), told through evals
NeurIPS Talk tomorrow.
Upper Level Room 2, 10:35AM.
LLM Evals Workshop @NeurIPS retweeted
I’ll be @NeurIPSConf all week and would love to connect on LLM data, evaluation, benchmarking, and scaling laws. If you’re working on related problems, feel free to reach out.
PS: Don’t miss our one-of-a-kind workshop on LLM evaluation: sites.google.com/view/llm-ev…
LLM Evals Workshop @NeurIPS retweeted
I will present my #EMNLP2025 paper at the #NeurIPS2025 LLM Eval Workshop @LLM_eval (Dec. 7th 11:15 - 12:15Poster Session 2).
If you are interested in reliable LLM-as-a-judge, please come say hi! ☕️
#AI #LLM #LLMJudge #LLMEvaluation #ConformalPrediction
🤩My FIRST paper received #EMNLP2025 SAC Highlights:
"Analyzing Uncertainty of LLM-as-a-Judge: Interval Evaluations with Conformal Prediction"
Huge thanks to my advisor @jiank_uiuc and collaborators Xinyi Liu, @hangfeng_he , & @jieyuzhao11 !
#AI #NLP #LLM #ConformalPrediction
LLM Evals Workshop @NeurIPS retweeted
(5/5) Read the paper at: arxiv.org/abs/2510.08616
Looking forward to discussing more at NeurIPS in San Diego!
LLM Evals Workshop @NeurIPS retweeted
(1/5) My work, “LLMs Show Surface-Form Brittleness Under Paraphrase Stress Tests”, has been accepted for a contributed talk at @NeurIPSConf 2025 Evolving LLM Lifecycle: Benchmarks, Emergent Abilities, and Scaling workshop @LLM_eval
#NeurIPS #LLM #Evaluation #Robustness #AI #ML
LLM Evals Workshop @NeurIPS retweeted
Sketched on a few Parisian summer nights with a friend, @ChrisInterno . If you care about (causal) identification in a semi-synthetic future, we’d value your read and critique.
Preprint: arxiv.org/pdf/2509.17999
Accepted at @LLM_eval workshop @NeurIPSConf
LLM Evals Workshop @NeurIPS retweeted
The Narcissus Hypothesis:
--Recursive training on semi-synthetic corpora enforcing human alignment induces a Social Desirability Bias: world-models (Narcissus) aim to please rather than represent, polluting data lakes and charming us (Echo) into hanging on their every word.
LLM Evals Workshop @NeurIPS retweeted
Replying to @abeirami
Indeed! In our NeurIPS workshop @LLM_eval, we’ll tackle the most pressing evaluation challenges. Join us to discuss how we should design the next generation of evaluations with experts in the field! More details: sites.google.com/view/llm-ev…
LLM Evals Workshop @NeurIPS retweeted
needed this so badly
We are happy to announce our @NeurIPSConf workshop on LLM evaluations!
Mastering LLM evaluation is no longer optional -- it's fundamental to building reliable models. We'll tackle the field's most pressing evaluation challenges.
For details: sites.google.com/corp/view/l…. 1/3
LLM Evals Workshop @NeurIPS retweeted
I’m very excited to be co-organizing this @NeurIPSConf workshop on LLM evaluations!
Evaluating LLMs is a complex and evolving challenge. With this workshop, we hope to bring together diverse perspectives to make real progress.
See the details below:
We are happy to announce our @NeurIPSConf workshop on LLM evaluations!
Mastering LLM evaluation is no longer optional -- it's fundamental to building reliable models. We'll tackle the field's most pressing evaluation challenges.
For details: sites.google.com/corp/view/l…. 1/3
LLM Evals Workshop @NeurIPS retweeted
Do not miss this one!
Very excited to announce that I’ll be co-organizing a @NeurIPSConf workshop on LLM evals!
Identifying shortcomings in model capabilities in a robust, scientific way is a critical part of model development. Looking forward to discussing ideas and hearing from some eval experts!
LLM Evals Workshop @NeurIPS retweeted
Very excited to announce that I’ll be co-organizing a @NeurIPSConf workshop on LLM evals!
Identifying shortcomings in model capabilities in a robust, scientific way is a critical part of model development. Looking forward to discussing ideas and hearing from some eval experts!
We are happy to announce our @NeurIPSConf workshop on LLM evaluations!
Mastering LLM evaluation is no longer optional -- it's fundamental to building reliable models. We'll tackle the field's most pressing evaluation challenges.
For details: sites.google.com/corp/view/l…. 1/3
LLM Evals Workshop @NeurIPS retweeted
Evaluating LLMs is one of the most critical and nuanced challenges in AI today. I am super excited to be co-organizing this workshop @NeurIPSConf to discuss the most pressing evaluation challenges.
Details 👇
We are happy to announce our @NeurIPSConf workshop on LLM evaluations!
Mastering LLM evaluation is no longer optional -- it's fundamental to building reliable models. We'll tackle the field's most pressing evaluation challenges.
For details: sites.google.com/corp/view/l…. 1/3






























