Aleph Alpha (@Aleph__Alpha) header
Aleph Alpha (@Aleph__Alpha) profile picture

Our Specialized Sovereign Large Language Model for Mission Critical Environments is here: https://teapawt.org/t.co/261IusY3RI

Heidelberg, Germany
Joined December 2018
Small bird, fast wings, Kolibri is here. 78B parameters. 3.46B active. Up to 1M tokens of context. Built in Europe. Now the weights are yours. Run it on your own hardware, under Apache 2.0.
435
1,008
490
9,793
2,695,897
Kolibri 1 is now supported in vLLM 0.33 🎉 Thanks to the @vllm_project and @huggingface communities for making it happen!
2
4
1
86
5,546
Kolibri can reason at four efforts: none, low, medium, and high. Our SFT training traces didn't have effort labels, so we had to label them post-hoc. A new blog post by @L_Salewski explains how we did this, with interactive figures 🧵
3
7
1
44
3,255
Does it work? On the SFT checkpoint, reasoning length orders low < medium < high on 23 of 24 benchmarks. At a fixed effort, hard prompts still get 32.5 times the reasoning of easy ones. After RL, the released model keeps 98% of its high score at low, with 76% of the tokens.
1
2
354
The post has the full method, what RL adds on top, and the open problems. You can even set the post's own reasoning effort, adapting its length! Blog: aleph-alpha.com/en/blog/reas… Tech report: arxiv.org/abs/2610.31945 Thanks to @L_Salewski and the SFT team.
3
357
Parsy is currently the best parsing model in the world. Read on for how we built this model on top of our parsing harness. 🧵
2
5
2
44
3,060
We re-ran ParseBench with the public scoring code, and the open-weight models matched the leaderboard while LlamaParse initially did not. @llama_index traced the gap and refreshed the scores the same day, and is adding scheduled runs so anyone can reproduce the leaderboard.
2
5
444
Knowing where every element sits on the page makes the model useful beyond extraction. For example, for source validation in chat assistants. As Parsy keeps the bounding box of every element, an answer can point to the exact region on the page it came from. Read the full post by @ABCalec, @yassinekh67, and Lukas Tatge: aleph-alpha.com/en/blog/pars…
2
401
How does the community evaluate multilingual capabilities of LLMs? Mostly by translating evaluation datasets, since most of them are predominantly in English. How does translation change what the eval actually measures?
3
5
22
1,802
Foreign cultural context is the harder problem. Questions about another country’s laws still test that country’s culture, but in German. A translation often implicitly decides what that cultural context is, influencing what that eval measures.
1
1
322
Scaling RL environments and their infrastructure comes with several challenges. We documented our experiences while building Kolibri: stalling GPUs, images filling the disks, crashed sandboxes scored as wrong answers, and reward hacks.
5
3
2
26
2,788