Postdoc @CWI, PhD @irlab_amsterdam @UvA_Amsterdam| Conversational Search Systems & Evaluation with users | Commonly known as Clem, @MasakhaneNLP
Amsterdam
Joined October 2017
- Tweets121
- Following280
- Followers186
- Likes414
Pinned Tweet
On July 8th, I successfully defended my PhD ๐โจ
My thesis, "Rethinking the Human-Centered Evaluation of Conversational Systems," explores aligning conversation evaluation with real human needs.
Thanks to my supervisors @mdr and @maliannejadi for their support.
Happy to share that our work on LLM-generated museum object descriptions has been accepted to Findings of #EMNLP2026!
We investigate how the type of metadata provided to an LLM (not just how much) affects the generated museum descriptions. Joint work with Laura Holink.
๐๐๐ ๐ ๐ฑ๐ผ๐ป'๐ ๐ท๐๐๐ ๐ฒ๐๐ฎ๐น๐๐ฎ๐๐ฒ.
๐ง๐ต๐ฒ๐ ๐ฑ๐ฒ๐ฐ๐ถ๐ฑ๐ฒ ๐๐ต๐ฎ๐ "๐ด๐ผ๐ผ๐ฑ" ๐บ๐ฒ๐ฎ๐ป๐.
In ๐๐ฆ๐ข๐ณ๐ฏ๐ช๐ฏ๐จ ๐ต๐ฐ ๐๐ถ๐ฅ๐จ๐ฆ (EACL 2026), we test this:
โ Let LLMs write their own evaluation rules
โ Then apply them
๐๐๐๐ ๐ข๐ค๐๐๐ก ๐๐๐ซ๐๐ก๐ค๐ฅ๐จ ๐๐ฉ๐จ ๐ค๐ฌ๐ฃ ๐๐ซ๐๐ก๐ช๐๐ฉ๐๐ค๐ฃ ๐๐๐๐ก๐๐๐ฉ.
๐๐๐-๐ฃ๐ข๐ด๐ฆ๐ฅ ๐ฆ๐ท๐ข๐ญ๐ถ๐ข๐ต๐ช๐ฐ๐ฏ ๐ช๐ด ๐ฏ๐ฐ๐ต ๐ฏ๐ฆ๐ถ๐ต๐ณ๐ข๐ญ. ๐๐ต ๐ณ๐ฆ๐ง๐ญ๐ฆ๐ค๐ต๐ด ๐ฉ๐ฐ๐ธ ๐ฎ๐ฐ๐ฅ๐ฆ๐ญ๐ด ๐ฅ๐ฆ๐ง๐ช๐ฏ๐ฆ ๐ฒ๐ถ๐ข๐ญ๐ช๐ต๐บ.
๐ aclanthology.org/2026.findinโฆ
Clemencia (Clem) retweeted
๐จ AfricaNLP 2026 First Call for Paper
The 7th AfricaNLP Workshop at EACL 2026 (Rabat, Morocco) invites papers on Multilingual Multimodal LLMs for African languages.
๐ Submission deadline: December 19 2025 (AoE)
Details: sites.google.com/view/africaโฆ
#AfricaNLP #EACL2026 #NLP
Clemencia (Clem) retweeted
Weโre now accepting ARR commitments for PALS 2025! If your ARR-reviewed paper fits with our themes on LLM personalization, submit by September 4: openreview.net/group?id=EMNLโฆ
See the full call for papers and topic details on our website: pals-nlp-workshop.github.io
#EMNLP25 @emnlpmeeting
Clemencia (Clem) retweeted
3 days remaining for direct submissions to PALS 2025! Share your findings or works in progress on LLM personalization here: openreview.net/group?id=EMNLโฆโฆ
See our website for the call for papers and information about relevant topics: pals-nlp-workshop.github.io
#EMNLP25 @emnlpmeeting
Clemencia (Clem) retweeted
You are welcome to join us at Giotto Platea for the LLM4Eval workshop #SIGIR2025 .
Clemencia (Clem) retweeted
Chirag Shah is this morning giving a keynote on: From Relevance to Reality: Scaling Human-Centered Evaluation in the LLM Era
Grateful to my committee: Evangelos Kanoulas, @DrCh0le , @sivareddyg , @zhaochun_ren , @theoaraujo , @HelbergerN7484, Fabio Crestani, and @JudithGood (chair).
The thesis is available online: pure.uva.nl/ws/files/2378583โฆ
Clemencia (Clem) retweeted
Join us at @emnlpmeeting for:
"Tailoring AI: Exploring Active and Passive LLM Personalization" ๐ฏ๐ง
To answer, when should LLMs personalize? What role do users play in LLM-personalization?
๐
Deadline Aug. 1
๐ Details in thread ๐งต๐
#EMNLP2025 #LLM #AI #personalization
1/5
Clemencia (Clem) retweeted
๐ข Deadline extended!
Submit to #LLM4Eval @ #SIGIR2025 by April 30 (AoE)
We welcome work on LLM-based evaluation, including:
๐ง beyond query-doc
๐ฃ๏ธ simulating users
๐งช synthetic eval data
๐ llm4eval.github.io/SIGIR2025โฆ
#CFP #IR #LLMs #SIGIR2025
LLMs are reshaping how we evaluate ranked lists, conversations, and even simulate users.
At #LLM4Eval @ #SIGIR2025, weโre spotlighting 3 special themes:
๐ง Beyond query-doc
๐ฃ๏ธ Simulating users
๐งช Synthesizing evaluation data
๐ Curious? Read on & submit by April 23!
#LLMs #IR
Clemencia (Clem) retweeted
If you are have submitted a paper to ARR/ACL evaluating on African languages and not happy with the meta reviews or unsure if it will get into ACL 2025
You can consider submitting your paper and the reviews to our AfricaNLP workshop sites.google.com/view/africaโฆ
The 6th AfricaNLP Workshop will be co-located with ACL 2025 in Vienna, Austria, on the theme: "Multilingual and Multicultural-aware LLMs" sites.google.com/view/africaโฆ
Submission deadline: March 7, 2025.
We accept both archival and non-archival papers.
#AfricaNLP
@MasakhaneNLP
Glad to be organizing the third series of #LLM4Eval @ #SIGIR2025!
We have just announced three special themes we are especially excited about: beyond query doc evaluation, simulating users, and synthesizing evaluation data.
Submit by April 23 ๐ง ๐ฃ๏ธ๐งช
LLMs are reshaping how we evaluate ranked lists, conversations, and even simulate users.
At #LLM4Eval @ #SIGIR2025, weโre spotlighting 3 special themes:
๐ง Beyond query-doc
๐ฃ๏ธ Simulating users
๐งช Synthesizing evaluation data
๐ Curious? Read on & submit by April 23!
#LLMs #IR
Clemencia (Clem) retweeted
๐ข Call for Papers: LLM4EVAL @ SIGIR '25 - The 3rd Workshop on Large Language Models for Evaluation in IR! @SIGIRConf
๐๏ธ Submission: April 23, 2025 (AoE)
๐ Full CFP: llm4eval.github.io/SIGIR2025โฆ
๐ Workshop: llm4eval.github.io/SIGIR2025โฆ
Clemencia (Clem) retweeted
I have multiple vacancies for PhD and Masters students at @Mila_Quebec @McGill_NLP in NLP/ML focusing on representation learning, reasoning, multimodality and alignment. Deadline for applications is Dec 1st. More details: mila.quebec/en/prospective-sโฆ
