Leading research at @arcee_ai | Formerly Data Research Lead @DbrxMosaicAI | Visiting Researcher @meta | Ph.D | #TXSTFOOTBALL fan | https://xitter.cf/t.co/4G6Jf3b0V4

Redwood City, CA
Joined August 2011
I’m so incredibly proud of what we are building at @arcee_ai . It’s a truly special place. We are only getting started though. We’ve been quiet for a while, but we haven’t been idle. I can’t wait to share more about what we have been grinding on for the past ~6 months. I won’t spoil anything, but you can get some idea from this announcement.
Today, we are announcing our Series B funding round, valuing the company at more than $1B. This round accelerates our next-gen Trinity models across diverse infrastructure, expands our work with the DOE and national labs on Genesis-Science-1, and enables us to build the platform teams need to build, evaluate, deploy, and operate open models in production. We are grateful to our team, partners, open-source community, and investors. Led by @Vista_Equity, Cambium Capital, and @emergencecap, with participation from AI10 Ventures, @Hitachi, IAG, @M12vc, @p7ventures, and @Wipro.
4
7
1
107
6,159
Cody Blakeney retweeted
the internet didn’t implode so now I still have to go to work. thanks for nothing
5
5
1
134
3,213
Cody Blakeney retweeted
beggin @arcee_ai to drop a nemotron-3.5-super-shaped coding agent RL-ed to death inside prime-agent. just a little something for the gpu poor out there.
3
1
2
30
3,434
Yes, but the better question is why. Is it good and a product of squeezing our performance or an unintended artifact of some training stage.
Replying to @thomashikaru
Our hypothesis: LLMs have a pressure for information density, leading to compressed language, novel ngrams, and a preference for short alternatives in linguistic alternations, even when this is not humanlike - humans have a pressure for successful communication with other humans
3
10
719
Cody Blakeney retweeted
It would take like 30 minutes to explain why I'm getting images sent to me at work on slack, but it is pretty sick.
3
2
23
880
I mean who isn’t these days
lmao john schulman just basically blurts out that thinking machines is working on a continual learning model
2
1
29
1,448
The things you can do with data get so much cooler as your context length grows. Literally a limitless playground of imagination.
2
26
918
Which lab has the best model tech reports these days? What sets them apart?
3
19
1,297
I changed my mind. I think I can teach the model spite.
28
766
The data must be cleaned
High alpha in looking at the data
3
1
38
945
a year later and I think they may be still running for 20 years the way GPU rental prices are going.
So in like 5 ish years ... what is going to happen to all the H100s ... landfill?
2
2
1
27
1,917
Turns out this is also true for a lot of people in industry too
If gradstudents knew what actually worked in training SOTA LLMs they would be so mad
30
1,218
I bet new grads I'll be interviewing before long won't even know what Tensorflow is. I had to explain to one of the younger people on my team yesterday what Caffe2 was 🙃
People I work with have called me a “boomer” because I used tensorflow at the beginning of my PhD
11
59
2,432
TIL Waymos turn the windshield wipers on when it's raining 🤷‍♂️
6
19
999
Cody Blakeney retweeted
They are swizzling me at work tomorrow.
1
2
15
873
It would take like 30 minutes to explain why I'm getting images sent to me at work on slack, but it is pretty sick.
3
2
23
880
Cody Blakeney retweeted
The reason Standford/Ivy League grads tell you to drop out of college is because they tell themselves "my accomplishments come from my own hard work" and not "I owe a large portion of my success to my school"
so funny to see the amount of people with @ ivy league and @ big tech on their bios hating on gabriel for saying this "status for me, but not for thee"
7
9
325
7,632
Cody Blakeney retweeted
Forward pass: 1s Backwards pass: 2s Optimizer step: 0.5s Hashing everything: 600s Allreduce: 1s Someone with strong systems-performance intuition, please take a serious pass at this code. The urgency is unfortunately load-bearing: my family is dying
21
17
1
626
29,879
Does anyone remember the Yi family of LLMs? Those were great.
2
14
887
They are swizzling me at work tomorrow.
1
2
15
873