Athul Paul Jacob (@apjacob03) header
Athul Paul Jacob (@apjacob03) profile picture

co-founder & chief ai officer @percepta | @generalcatalyst | Ex: @mit_csail phd, @uwaterloo, @google, fair @metaai, @milaquebec | co-created cicero / diplodocus

Cambridge, MA
Joined September 2011
Photo by Athul Paul Jacob (@apjacob03)Photo by Athul Paul Jacob (@apjacob03)Photo by Athul Paul Jacob (@apjacob03)Photo by Athul Paul Jacob (@apjacob03)Photo by Athul Paul Jacob (@apjacob03)Photo by Athul Paul Jacob (@apjacob03)Photo by Athul Paul Jacob (@apjacob03)Photo by Athul Paul Jacob (@apjacob03)Photo by Athul Paul Jacob (@apjacob03)Photo by Athul Paul Jacob (@apjacob03)
Apply to the @generalcatalyst undergraduate research fellows program!
Introducing @generalcatalyst Research Fellows - a program for undergraduates ready to pursue their most ambitious ideas. We’re supporting approximately 20 exceptional undergraduate builders from leading schools. In partnership with @Modal, each fellow will receive up to $25K in compute for a 90-day project of their own. For the bold, the curious, and those building what they wish existed: applications are open now. Tell us what you want to build! generalcatalyst.com/research…
3
1
7
655
Athul Paul Jacob retweeted
Thank you to everyone that came out for the launch of our DEMO zine. 🎉 We have 50 copies left, keep an eye on @hirshjain's account if you want to claim. 👀
2
10
970
Athul Paul Jacob retweeted
Thank you to everyone that came out for the launch of our DEMO zine. 🎉 We have 50 copies left, keep an eye on @hirshjain's account if you want to claim. 👀
1
4
1
18
1,491
Athul Paul Jacob retweeted
To reiterate: big things loading
Sometimes a demo is simply to remind the world that your competition has no desire to dream -- and no ability to evolve.
2
1
18
1,128
Athul Paul Jacob retweeted
I’m a Lion King fanatic, karaoke bar pianist, and researcher in AI decision-making. This was inevitable. “Can You Feel the AGI?” Original in the reply below.
4
7
25
995
🌍
I'm hiring for our interpretable world modeling effort at Percepta! The core question: how can we make an agent build a simulator, understand a company, and then design a policy, all from unstructured data? Come work with me and our amazing team. jobs.ashbyhq.com/percepta/90…
1
1
15
1,062
Athul Paul Jacob retweeted
Big things loading………..
2
2
1
31
2,199
Athul Paul Jacob retweeted
We're partnering with Sapienne, a community for women building in AI, on a rooftop event later this month. Details here: luma.com/9kulxk97
3
11
458
Athul Paul Jacob retweeted
Replying to @DBahdanau
@DBahdanau is 🐐 Over the years, I've had the awesome fortune of working with the best ML researchers in the field, plus the incredible new cohort of future leaders who IC the AI tech we use daily. And Dima still stands out as a rare trifecta: great leader x brilliant researcher x exceptional systems engineer.
Bahdanau is 🐐 He cooked edge transformers years before we got to 2-simplicial as well.
5
6
1
178
16,125
Athul Paul Jacob retweeted
(1/N) Attention grows its memory by accumulating the KV cache at quadratic cost overall; linear attention-like models keep things cheap, but squeeze the context into a lossy fixed-size state. Spotlight is our proposal for a growing memory mechanism with constant cost per token.
1
4
11
985
Athul Paul Jacob retweeted
LLMs don’t need retraining to become more capable. Our new architecture, Spotlight, gives AI models growing memory, allowing them to gain knowledge and capabilities without changing their weights. Token generation takes constant work, no matter how much information is stored.
55
143
28
1,500
95,693
1/ What would it take for LLMs to be able to grow their own capabilities? We introduce spotlight, a memory architecture with growing capacity but with linear computational complexity. We show that this suffices to host evolving ecosystems like software by building Python directly into an LLM. We also share some very early language modeling results where it outperforms attention and linear attention on long context capabilities!
7
18
3
70
8,096