llm research @nvidia; ex @googledeepmind, @google brain & @mila_quebec.
toronto
Joined June 2011
- Tweets84
- Following189
- Followers959
- Likes549
We're looking for Summer Interns to join the Post-Training Team at @NVIDIA!
DM me with your updated resume and three concise bullets detailing your most relevant experience — e.g. publications, repos, blogs, etc.
RT please to help us find top talent.
life update: thrilled to announce that i’ll be joining @nvidia as a research scientist on the alignment team. grateful for the support from mentors and peers. this is a dream come true for both the researcher and the gamer in me!
Course Correcting Koopman Representations
Accepted at #ICLR2024!
We identify problems with unrolling in imagination and propose an unconventional, simple, yet effective solution: periodically "𝒓𝒆𝒆𝒏𝒄𝒐𝒅𝒊𝒏𝒈" the latent.
📄 arxiv.org/abs/2310.15386
@GoogleDeepMind
1/🧵
Why not get the best of both worlds by combining SSMs and Transformers?
Excited to share our work at #NeurIPS2023: "Block-State Transformers."
BST hits new highs in long-range language modeling and LRA tasks.
paper: arxiv.org/abs/2306.09539
1/
Think of BST as a sequel to "Block-Recurrent Transformers." (arxiv.org/abs/2203.07852)
In BRT, the transformer blocks talked to each other in a slow, sequential way, via recurrence. The catch? Blocks down the line had to wait their turn to process info. BST changes that game.
2/
1
14
2,286
to @iclr_conf reviewers who failed to acknowledge the rebuttals in time, 𝘁𝗵𝗲𝗿𝗲 𝗶𝘀 𝘀𝘁𝗶𝗹𝗹 𝘁𝗶𝗺𝗲. you can revise your review/score and include a post-rebuttal section. i know this is common knowledge but a friendly reminder never hurts. #iclr2024
11
1,747