comp bio @RetroBio_
San Francisco, CA
Joined September 2018
- Tweets898
- Following1.2K
- Followers625
- Likes13.4K
jared tumiel retweeted
We started a new program at @RetroBio_ to explore what can be achieved by going deep on combinations of small molecules to achieve rejuvenation. Incepted by me and led by @z_chiang
jared tumiel retweeted
Sustained molecular rejuvenation demonstrated in serially transplanted iHSCs (stem-cell-derived blood generating cells) -- a new preprint from @RetroBio_
jared tumiel retweeted
super excited to announce our collaboration to the world! here’s the backstory: we started with a shared goal of using AI to generate novel discoveries that would be non-trivial for human scientists to make
At @OpenAI, we believe that AI can accelerate science and drug discovery. An exciting example is our work with @RetroBiosciences, where a custom model designed improved variants of the Nobel-prize winning Yamanaka proteins. Today we published a closer look at the breakthrough. ⬇️
jared tumiel retweeted
my team is hiring for a research associate! we're looking for ambitious people right out of their undergrad who want to get 1-2 years of experience in a fast moving environment before starting a PhD (at or outside of Retro)
jobs.lever.co/retro/b332a16f…
jared tumiel retweeted
EY basically told you to predict the next token and take it as a bug report if your epistemology is not helping you predict the next token. If an agent wants to make its Brier score go down eventually it *has* to learn to balance various incomplete systems or it gets stuck.
jared tumiel retweeted
This is unfortunate because the ostensible benefit of aggregators is matching people with diverse preferences to the diverse menu of options available. But instead we get "cultural mode collapse".
jared tumiel retweeted
chain-of-thought
tree-of-thought
monte-carlo-tree-of-thought
graph-of-thought
backtracking-tokens-of-thought
vector-space-of-thought
oh-wait-that's-just-a-model-of-thought
hilbert-space-of-thought
non-euclidean-geometry-of-thought
covariant-general-relativity-of-thought
jared tumiel retweeted
it's only called reasoning if it's from the brain region of homo sapiens. otherwise, it's just sparkling auto-regression
jared tumiel retweeted
Probably need gradient clipping or cosine LR decay
ALT A plot of the S&P 500 index sharply dropping in the first few days of August 2024.
so much alpha in one blog post:
practical scaling of LLMs by @tomtumiel
link below
discusses tricks & techniques for model training and inference at scale:
- model compilation
- kernel fusion
- KV-caching
- gradient accumulation
- low-rank finetuning
- sharding & data parallelisation
+ more, go check it out!
ttumiel.com/blog/model-scali…
