Pinned Tweet
Small bird, fast wings, Kolibri is here.
78B parameters. 3.46B active. Up to 1M tokens of context. Built in Europe.
Now the weights are yours. Run it on your own hardware, under Apache 2.0.
Kolibri 1 is now supported in vLLM 0.33 🎉
Thanks to the @vllm_project and @huggingface communities for making it happen!
Kolibri can reason at four efforts: none, low, medium, and high. Our SFT training traces didn't have effort labels, so we had to label them post-hoc.
A new blog post by @L_Salewski explains how we did this, with interactive figures 🧵
Does it work? On the SFT checkpoint, reasoning length orders low < medium < high on 23 of 24 benchmarks. At a fixed effort, hard prompts still get 32.5 times the reasoning of easy ones.
After RL, the released model keeps 98% of its high score at low, with 76% of the tokens.
1
2
354
The post has the full method, what RL adds on top, and the open problems. You can even set the post's own reasoning effort, adapting its length!
Blog: aleph-alpha.com/en/blog/reas…
Tech report: arxiv.org/abs/2610.31945
Thanks to @L_Salewski and the SFT team.
3
357
Parsy is currently the best parsing model in the world.
Read on for how we built this model on top of our parsing harness. 🧵
We re-ran ParseBench with the public scoring code, and the open-weight models matched the leaderboard while LlamaParse initially did not. @llama_index traced the gap and refreshed the scores the same day, and is adding scheduled runs so anyone can reproduce the leaderboard.
2
5
444
Knowing where every element sits on the page makes the model useful beyond extraction. For example, for source validation in chat assistants.
As Parsy keeps the bounding box of every element, an answer can point to the exact region on the page it came from.
Read the full post by @ABCalec, @yassinekh67, and Lukas Tatge: aleph-alpha.com/en/blog/pars…
2
401
How does the community evaluate multilingual capabilities of LLMs? Mostly by translating evaluation datasets, since most of them are predominantly in English. How does translation change what the eval actually measures?
Foreign cultural context is the harder problem. Questions about another country’s laws still test that country’s culture, but in German. A translation often implicitly decides what that cultural context is, influencing what that eval measures.
1
1
322
As model builders for German-speaking users, we believe this choice should be ours to make. Read more in our new blog by Alejandro, Raziye, Prabhu, @frankstefansch1, and Martin: aleph-alpha.com/en/blog/tran…
2
347
Scaling RL environments and their infrastructure comes with several challenges. We documented our experiences while building Kolibri: stalling GPUs, images filling the disks, crashed sandboxes scored as wrong answers, and reward hacks.
Blog post by @gitlostmurali, @LukasBluebaum, and Max Hammer: aleph-alpha.com/en/blog/why-…
Tech report: aleph-alpha.com/downloads/te…
2
794






