Lukas Edman (@LukasNLP) profile picture

Post-Doc at TU Munich, interested in just about anything in low-resource NLP

Joined October 2021
Photo by Lukas Edman (@LukasNLP)Photo by Lukas Edman (@LukasNLP)Photo by Lukas Edman (@LukasNLP)Photo by Lukas Edman (@LukasNLP)Photo by Lukas Edman (@LukasNLP)Photo by Lukas Edman (@LukasNLP)Photo by Lukas Edman (@LukasNLP)Photo by Lukas Edman (@LukasNLP)
Thanks #BabyLM at #EMNLP2026 for the Challenge Awards for Qwenfant (aclanthology.org/2026.babylm…) and, on behalf of my student Serdar Gülbahar @cs_serdar, RecGPT (aclanthology.org/2026.babylm…)! It's always really fun and interesting working on the challenges for more efficient pretraining!
12
303
Ever feel like it's too hard to keep track of what LLMs cannot do as well as humans? We're making your life easier over at: what-llms-can-not-do.github.… We're compiling a list of papers testing the abilities of LLMs against humans. Check it out! And you can help contribute too!
1
2
5
97
Would love to hear your feedback too :)
33
Lukas Edman retweeted
Excited to kickstart this effort with @glnmario and a star-studded advisory team! 🚀 Also, we're hiring for 2 MTS and 1 Ops manager! Come build the future of white-box audits with us: parallx.ai/careers
Introducing Parallax 🔍 We're a new UK/EU-based nonprofit research lab building scalable methods and infrastructure to audit the beliefs, goals, and plans that shape model behaviours in long-horizon agentic evaluations. parallx.ai — Thread 🧵 1/
9
17
79
4,794
Everyone talks about how great ChatGPT and Claude are, but Olmo is literally in the world cup finals #NLProc
1
129
Thanks to everyone who showed up at my posters: EXECUTE, and Positional Overload w/ Lukas Kinder! #ACL2025 #ACL2025NLP
1
9
391
Happy to announce two papers at #ACL2025! 1. We made an extension to our CUTE benchmark, EXECUTE! We find that LLMs actually *do* have the ability to do character-level manipulation, but language bias, and tokenization too, get in the way. openreview.net/forum?id=m955… 1/2
1
1
9
638
2. Positional Overload: Positional Debiasing and Context Window Extension for Large Language Models using Set Encoding (PDF coming soon!). Lukas Kinder at KIT did all the hard work, showing that we can use shared position IDs across texts to extend context length and debias MCQA
2
113
Thanks to everyone who stopped by my poster at #EMNLP2024 today! Had some really fun and interesting discussions with you all :)
5
2
2
89
6,840
I'm happy to announce that our LLM benchmark for measuring orthographic understanding, CUTE, was accepted to EMNLP main! Looking forward to seeing you all in Miami! #NLProc Arxiv: arxiv.org/abs/2409.15452 HF Leaderboard: hf.co/spaces/leukas/cute_lea… Github: github.com/leukas/cute
1
7
349
Lukas Edman retweeted
Very excited to present my work at @CisLmu tomorrow; thanks for having me! 😄
🎓 We're thrilled to host Gabriele Sarti (@gsarti_) in our PhD seminar series tomorrow, July 16th, from 12:00-13:00 in Oe67 BU 101! Join us for his talk on interpreting context usage in generative language models, featuring the Inseq toolkit and PECoRe framework. 🕛Don't miss it!
1
2
38
2,217
Thanks to everyone who stopped by my poster yesterday at #EACL2024! It was a lot of fun talking to you all and hearing your thoughts on character-level models for #nmt!
7
1
2
27
899
I'm happy to announce that my work "Are Character-level Translations Worth the Wait? Comparing ByT5 and mT5 for Machine Translation" with @gsarti_, @_atoral, @gertjanvannoor1, and @AriannaBisazza was accepted to #TACL! I'll be presenting it at #EACL2024! arxiv.org/abs/2302.14220
1
4
1
31
2,212
Lukas Edman retweeted
After a year of restless development, I'm finally happy to announce Inseq, a new tool to democratize post-hoc interpretability of sequence generation models 🐛 github.com/inseq-team/inseq #nlproc #xai Some highlights 👇 1/
6
37
8
167