Professor of Natural Language Processing at Cambridge University | Chief Scientist at Trismik
Cambridge, UK
Joined February 2012
- Tweets126
- Following111
- Followers621
- Likes11
Have you ever had a model you expected to be a winner turn out not to be the best once you tested it on your own data?
That’s one of the reasons we built QuickCompare.
Today our Cambridge spinout, Trismik, is launching QuickCompare to help AI teams compare LLMs on their own tasks and data before committing time and budget to deployment, fine-tuning, or migration.
Built for teams asking:
* Which model is best for our workflow?
* Which model is most reliable?
* Which model is worth deeper investment?
We’re live on Product Hunt today:
producthunt.com/products/qui…
We’d love your support and feedback.
#LLM #AI #ProductHunt #Startups
If humans can learn geography from books, why do we say LLMs don’t understand the world? This essay explores why LLMs master linguistic boundaries but falter on the physical ones we learn through action. #LLM #GenerativeAI #WorldModels tinyurl.com/2kk92u5p
Are Doubt and Uncertainty the Same Thing?
LLMs show uncertainty but cannot yet experience doubt, a richer metacognitive process. Because models lack self-awareness of their own ignorance, they can appear cautious while still hallucinating. See nhcollier.ai/
I’ve published a new piece called Beyond Alignment, a look at what AI could become if we designed it to understand, not just to comply.
👇
nhcollier.ai/reflections/bey…
After 10 years on my old site, I’ve officially moved to a new domain: nhcollier.ai.
Hope to see you there.
Nigel Collier retweeted
🚀 Thrilled to share our paper: "A Multi-Faceted Analysis of Personalized Preference Learning." We introduce a multi-faceted framework to evaluate personalized preference learning algorithms in real-world conditions.
📄 Paper: arxiv.org/pdf/2502.19158
Nigel Collier retweeted
🚨New Paper Alert🚨
Many personalization methods optimize performance but ignore real-world impact.
We examine its effects on:
✅ Performance
⚖️ Fairness: Can it represent minorities fairly?
⚠️ Unintended Effects: Does it harm safety?
🔄 Adaptability: Quickly adapt to new users?
🚀 We're hiring an Applied Scientist! Join a Cambridge AI spinout launching Apr/May '25. PhD in NLP/ML + 2-3 yrs industry exp needed. Work on product data, algorithms, & research papers. UK/Europe-based. Shape AGI’s future! Email CV: [email protected] (subject "Trism 2025").
Nigel Collier retweeted
Thrilled to share our new paper: "Can LLM be a Personalized Judge?"
We investigate the reliability of LLMs in judging user preferences based on personas and propose improvements using verbal uncertainty estimation to enhance accuracy. 🎭👨⚖️
📄 Paper: arxiv.org/abs/2406.11657
Nigel Collier retweeted
"Role-playing" with LLMs is increasingly popular in chatbots and also "simulation" for social sciences. Can LLMs simulate individual perspectives in subjective NLP tasks? Our #ACL2024 paper w. @nigelhcollier investigates this question. 🧵👇 arxiv.org/pdf/2402.10811 1/7
Nigel Collier retweeted
Our paper "On the Effectiveness of Parameter-Efficient Fine-Tuning" is accepted at #AAAI2023! We theoretically explain why Parameter-Efficient models(Adapter,LoRA,BitFit...)have good performance and design an approx best way to find which parameter to tune. arxiv.org/abs/2211.15583
ALT Paper: https://arxiv.org/pdf/2211.15583.pdf Code: https://github.com/fuzihaofzh/AnalyzeParameterEfficientFinetune
Here's the link to our paper 'On Reality and the Limits of Language Data' arxiv.org/abs/2208.11981 with @EhsanShareghi and @hardy_qr #machinelearning #AI #CambridgeUniversity #MonashUniversity #deeplearning #NLProc
Delighted to announce our paper 'On Reality and the Limits of Language Data' in collaboration with @EhsanShareghi and @hardy_qr at . We've spent the last 9 months reading and thinking about the limitations of pre-trained language m…lnkd.in/d6RSeVXN lnkd.in/dT-t3n22
FW: Earth Species Project is hiring Senior AI Research Scientist jobs.lever.co/earthspecies/2…
Nigel Collier retweeted
Pleased to announce that our paper 'Rewire-then-Probe: A Contrastive Recipe for Probing Biomedical Knowledge of Pre-trained Language Models' is accepted at #ACL2022! Joint work with @CambridgeLTL forks @hardy_qr @EhsanShareghi @yixuan_su Charlotte Collins and @nigelhcollier.
Nigel Collier retweeted
Sharing our recent tacl paper... 😎 okay, our recent arxiv preprint called token-aware contrastive learning (TaCL),
by Yixuan Su, me, @mengzaiqiao, Lei Shu, @EhsanShareghi and @nigelhcollier.
Nigel Collier retweeted
Proud to share that Fangyu Liu & @nigelhcollier have been awarded the Best Long Paper Award at the 2021 @emnlp Conference, with collaborators from McGill Uni & Uni of Copenhagen.
More details at: mmll.cam.ac.uk/news/cambridg…
@CambridgeLTL @PontiEdoardo @hardyqr
Nigel Collier retweeted
I am delighted to share that I will be joining @EdinburghNLP at @EdinburghUni from 2022 as a lecturer in Natural Language Processing. I am currently recruiting PhD students, so if you are passionate... (1/6)
Nigel Collier retweeted
MaRVL (marvl-challenge.github.io/) won the Best Long Paper Award at EMNLP 2021!
Congrats to the awesome team @ebugliarello (co-lead) @PontiEdoardo @sivareddyg @nigelhcollier @delliott.
Have a nice weekend and see you in Punta Cana :)
Happy to share the titles of 5 @CambridgeLTL papers (tinyurl.com/n8c7e8j5) in #EMNLP2021 and 1 in CoNLL. Congratulations to all our authors including @hardy_qr, @ebugliarello, @PontiEdoardo, @sivareddyg, @annalkorhonen, @EhsanShareghi, @mengzaiqiao, @_simonB, @licwu,@QianchuL