@huggingface engineer. I'm the reason your LLM frontend has a jinja2cpp dependency. Sometimes yells about housing and trans rights instead of working He/him

Dublin, Ireland
Joined April 2021
Big announcement today @huggingface: We now have a unified API for tool use across models from @MistralAI, @AIatMeta, @cohere, @NousResearch and more! That means that you can reuse the same simplified, portable code to add tool capabilities to all of those models! 🧵
9
74
8
352
78,945
Given how stringent the anti-distillation measures are now it's crazy that GPT-4 used to give you top-5 token probs with no CoT to hide. You could probably have recovered that whole model for <$10M
2
3
856
Of course the flip side of this is that $10M still sounded like a very expensive training run in 2023
199
Preparing for the future means being fully equipped to run a 10T model at home the moment the weights drop
1
1
1
19
1,754
buddy I'm getting 7 and i'm still proud
Why do people buy $20k local machines just to run GLM 5.3 at 70 TPS? Bro I just used a random provider on openrouter ran it the entire night and paid $10.
1
11
1,400
Matthew Carrigan retweeted
A universal predictive model of the cell would dramatically accelerate science, allowing biologists to perform experiments digitally. Today we’re announcing a major partnership with the DOE and NIH. The goal of this partnership is to generate the data that will be needed to build an accurate model of the cell with artificial intelligence. Isomorphic, Google DeepMind, and Meta are joining us as founding partners in the Virtual Biology Initiative. This is the beginning of a large scale coordinated effort to map cellular biology to power the development of digital models of life. Other leading scientific institutions and consortia including the Allen Institute, Broad Institute, Gladstone Institutes, the Human Cell Atlas, the Human Protein Atlas, the Wellcome Sanger Institute, as well as NVIDIA, are working together as part of this international scientific project. Creating a predictive model of the cell is one of the most important challenges for the next decade of science. The insights that come from this could unlock a far greater understanding of disease, and open new paths for cures. We invite the worldwide scientific community and other funders to join us in this effort.
106
247
101
1,779
262,454
immediately knew @Fluke_Ellington was responsible for this naming
Meet Mistral Large 4, aka Le Chonk. • 1T parameters, natively multimodal. 49B active. It is the best open weights model from US or Europe on aggregated benchmarks. • State-of-the-art on critical workloads, including cyber defense, manufacturing and finance and it surpasses closed frontier models on visual grounding. • Forged in Europe end-to-end and is deployable from Europe via our own Mistral Cloud infrastructure. • Available to all via API today. Working with cybersecurity partners privately. Open weights release end of October.
1
4
753
Tell your biologist friends - ESMC and ESMFold2 are the current state of the art for open protein modeling! In addition to modernized architecture and much better accuracy, they also support more complex multi-peptide and protein-ligand interactions!
The ESMC and ESMFold2 models are now on Huggingface! You can now install it directly from PyPi or from huggingface/transformers v5.16.0. As a part of this, we officially are releasing support for our fused Triton kernels and FoldCP in partnership with @nvidia!
2
835
Matthew Carrigan retweeted
The ESMC and ESMFold2 models are now on Huggingface! You can now install it directly from PyPi or from huggingface/transformers v5.16.0. As a part of this, we officially are releasing support for our fused Triton kernels and FoldCP in partnership with @nvidia!
2
30
4
217
16,131
Most sensible people gave up on hosting open frontier models a while ago. Kimi K3 is 2.8T params and fitting that in RAM or GPUs will cost $100,000+, right? Wrong! You can run Kimi locally at full quality with native experts, Q8 everything else! 🧵
2
1
16
3,026
And once it makes the changes, recompile, test, run it and that's it - you have frontier intelligence on your local machine. And if you got the full 16-drive array that system will be ready for the 10T models of 2027 as well 😅
1
299
Also oops, linked the wrong thread for the hardware reference. You want this one. xitter.cf/carrigmat/status/18842…
Complete hardware + software setup for running Deepseek-R1 locally. The actual model, no distillations, and Q8 quantization for full quality. Total cost, $6,000. All download and part links below:
2
407