Switzerland
Joined August 2015
- Tweets50
- Following79
- Followers127
- Likes61
Beatriz Borges retweeted
🗒️Can we meta-learn test-time learning to solve long-context reasoning?
Our latest work, PERK, learns to encode long contexts through gradient updates to a memory scratchpad at test time, achieving long-context reasoning robust to complexity and length extrapolation while scaling efficiently at inference.
PERK can be applied to existing pretrained language models without requiring architectural or parameter modifications to the base model.
#LLM #LongContext
Find out how PERK operates and performs 👇
Beatriz Borges retweeted
🚨New Preprint!!
Thrilled to share with you our latest work: “Mixture of Cognitive Reasoners”, a modular transformer architecture inspired by the brain’s functional networks: language, logic, social reasoning, and world knowledge.
1/ 🧵👇
Beatriz Borges retweeted
I am recruiting 2 PhD students for Fall'25 @csaudk to work on bleeding-edge topics in #NLProc #LLMs #AIAgents (e.g. LLM reasoning, knowledge-seeking agents, and more).
Details: cs.au.dk/~clan/openings
Deadline: May 1, 2025
Please boost!
cc: @WikiResearch @AiCentreDK @CPH_SODAS
Beatriz Borges retweeted
🚨 New Preprint!!
LLMs trained on next-word prediction (NWP) show high alignment with brain recordings. But what drives this alignment—linguistic structure or world knowledge? And how does this alignment evolve during training? Our new paper explores these questions. 👇🧵
Beatriz Borges retweeted
Are LLMs linguistically productive and systematic in morphologically-rich languages as good as humans?
No 🤨 Our new NAACL 2025 paper (arxiv.org/abs/2410.12656) reveals a significant performance gap between LLMs and humans in linguistic creativity and morphological generalization.
Beatriz Borges retweeted
🚨 New Paper!
Can neuroscience localizers uncover brain-like functional specializations in LLMs? 🧠🤖
Yes! We analyzed 18 LLMs and found units mirroring the brain's language, theory of mind, and multiple demand networks!
w/ @GretaTuckute, @ABosselut, & @martin_schrimpf
🧵👇
Data Consortium (Pt. 3): @sanidhya_k, @ValerioPiazzaVP, Viesturs Simanis, Viktor Kuncak, @CevherLIONS, @aroraakhilcs, @chiappa_alberto, @AntSclocchi, Étienne Bruno, Florian Hofhammer, Gabriel Pescia, @RizkGeovani, Leello Dadi, ...