Manuel retweeted
📢 ARR August 2026 cycle statistics are available!
Did you know ARR publishes statistics for every cycle, including Great Reviewers recognized by Area Chairs?
👏 Many thanks to all reviewers, ACs, SACs, and everyone who contributed!
🔗 stats.aclrollingreview.org/i…
#ARR #NLProc
Manuel retweeted
CALL FOR AI DETECTION BENCHMARKS
I believe it is vital that third parties are able to audit AI detectors like Pangram. Our largest sample size benchmark, from UChicago, was run on Pangram 3 and is a year old now. New LLMs are being released all the time, and the binary task doesn't capture the full spectrum of real world performance. A great benchmark will help shape how the world interacts with AI over the coming years.
I am putting out a call for new third-party evaluations that attempt to answer one or more of the following questions:
- How well do current detectors catch text from the latest frontier AI models? What about in high context settings, like deep research or an agent harness?
- How well do current detectors do on mixed authorship text? Ideally, research in this area explores the full spectrum of AI assistance from light grammatical edits to full co-authorship.
- Any sort of sliced evals around language, background, or ethnicity. Null results that show no bias are still interesting to us.
What I value in a benchmark is extraordinarily clean data, frontier LLM data, and a high enough difficulty that the benchmark is not saturated by most detectors. If you want credits to run your benchmark, please apply here: pangram.com/contact-us/resea…
Manuel retweeted
Keynote 1 at #EMNLP2026 begins at 9:30. Pascale Fung (@pascalefung) takes the stage in five minutes.
Manuel retweeted
EMNLP welcome reception will be in around 1.5 hours! Registration is very well organised and no queue. Volunteers are here to help you on arrival! Enjoy the conference! #EMNLP2026
Manuel retweeted
Registration for #EMNLP2026 opens at 14:00 at HUNGEXPO, Budapest, and runs until 19:30. The Welcome Reception follows from 18:00 to 20:00. Program: 2026.emnlp.org/program/
Manuel retweeted
🚨 New Paper! 🚨
Multiple-choice benchmarks use accuracy (boring), but education has way cooler scoring schemes! 🤩
👎 Lose points if wrong
🔁 Try until you're right
🃏 Wager points
At #EMNLP2026, we show these schemes shift LLM ranks, align with LLM Arena, + unmask LLM quirks
Manuel retweeted
What is TMLR doing under a 300% increase in submissions?
- Suspensions of >150 authors
- Publicly naming major violations
- Submission quotas distinguishing slop patterns
- Desk rejections 6% → 53%; focus on clarity
- AI reviews evaluating soundness
blog.tmlr.org/2026/adapting-…
Manuel retweeted
Emails sent to [email protected] are often quite rude. Before pressing send, please keep in mind that ARR is run mostly by volunteers. PLEASE TREAT US WITH RESPECT!
#ARR @ReviewAcl
We have just implemented a self-assessment checker for this and now deployed at aclrollingreview.org/qualifi….
Manuel retweeted
🚨EvalEval is excited to announce that we are hosting a microconference (hybrid) on Embedding Evaluators in Practice in SF!
More details on the agenda and outcomes in thread 🧵
Invite-only, sign up 👇
luma.com/nfu166a1
Manuel retweeted
📢 ARR Oct authors
At least one author must have an OpenReview account by the ddl. Others have 1 week to complete profiles. ARR cannot resolve account issues.
FAQ on lottery exemptions:
aclrollingreview.org/sustain…
Only EMNLP/AACL26 can be verified before indexing.
#ARR #NLProc
Manuel retweeted
📢 ARR Reviewer Qualifications Checker is Live!
For the Oct cycle, each submission must name a qualified service contributor to be guaranteed review.
Before submission, you can quickly verify your status: openreview.net/group?id=aclw…
Policy: aclrollingreview.org/sustain…
#ARR #NLProc
Manuel retweeted
🔔CFP for the #ACL2027NLP main conference is up! 2027.aclweb.org/calls/main/
📝Submission deadline to ARR is Jan 4, 2027.
⭐️ACL2027 Theme Track is "Homogenization and knowledge collapse in LLMs".
We're expanding our approach to content provenance to include text in response to EU regulatory requirements, while recognizing the significant limitations of current text watermarking technology.
Our tools already help verify whether an image or audio file was created with our models. This work builds on those efforts to help people better understand when content may have been generated or edited with an OpenAI model.
In the EU, we’ll start watermarking eligible text from ChatGPT and Codex over the coming weeks to comply with the EU AI Act.
Customers using our API can turn on text watermarking for select models worldwide today.
Manuel retweeted
Small bird, fast wings, Kolibri is here.
78B parameters. 3.46B active. Up to 1M tokens of context. Built in Europe.
Now the weights are yours. Run it on your own hardware, under Apache 2.0.
arXiv has updated our policy on rate limiting for all submitters.
This update was made to fairly distribute moderator time & support the arXiv community of staff, volunteers, readers & authors.
Please read our announcement to learn more: blog.arxiv.org/2026/10/01/up…
Manuel retweeted
📢 ARR October 2026 authors
You do not need to wait until the deadline. Once you make a submission, even a partial one, the designated service contributor form and Responsible Checklist become available.
Please complete them within 48h.
aclrollingreview.org/sustain…
#ARR #NLProc


























