That's a wrap! We (@glnmario, @christos_c, @_dieuwke_, @vernadankers, @khuyagbaatar_b, @a_kazemnejad & @ryandcotterell) thank all presenters, authors, reviewers and attendees!! The keynotes, the cats 😻, the posters, the talks and the lively panel: it was fantastic👏 🔥
Come listen to the hot takes of our panelist in the Brickell room! Do we still need generalisation evaluation? 🧐 #GenBench2024 #EMNLP2024
Still at the poster session? Come join us for keynote 3 by @sameer_!
Did you miss the GenBench poster session? Don't worry we've got you, here are (nearly all) posters! 😉 #GenBench2024 #EMNLP2024 Next up: keynote by Sameer Singh at 3!
Last spotlight presentation:
MMLU-SR: A Benchmark for Stress-Testing Reasoning Capability of Large Language Models
aclanthology.org/2024.genben…
Unfortunately the authors couldn't make it, the work is kindly presented by their colleague Hengyi Wang 🙏
Continuing with Bastian Bunzeck, presenting
The SlayQA benchmark of social reasoning: testing gender-inclusive generalization with neopronouns
aclanthology.org/2024.genben…
Next presenter is Jiwoo Lee, presenting
MultiPragEval: Multilingual Pragmatic Evaluation of Large Language Models
aclanthology.org/2024.genben…











