Low Latency QD @ Cit Sec
Stanford, CA
Joined April 2024
- Tweets36
- Following162
- Followers186
- Likes120
Conner Takehana retweeted
introducing chipmunk—a training-free algorithm making ai video generation 3.7x & image gen 1.6x faster! ⚡️
our kernels for column-sparse attention are 9.3x faster than FlashAttention-3 and column-sparse GEMM is 2.5x faster vs. cuBLAS
a thread on the GPU kernel optimizations 🧵
Our latest joint work w/ SandyResearch @ UCSD: training-free acceleration of Diffusion Transformers w/ dynamic sparsity, led by @austinsilveria @SohamGovande!
⚡️ 3.7x faster video and 1.6x faster image generation while preserving quality!
🧵 Open-source code & CUDA kernels!
Happy Thanksgiving! Introducing ThunderMittens for your ThunderKittens, TK kernels for Apple chips! - @AaryanSinghal4 and I
we wrote a blog about TK on M2s: hazyresearch.stanford.edu/bl…
Conner Takehana retweeted
Thankful for TK kernels that now run on Apple hardware - with @CKT_Conner, bringing faster attention and GEMMs to your M2 MacBooks! happy thanksgiving 🍁
Conner Takehana retweeted
Thrilled to be unveiling Thunderkittens 0.1: now with more simplicity, more speed, and more kernels!
Had a blast working on this with @spectorb, @simran_s_arora, and folks at @HazyResearch 🚀
(1/7) In celebration of National Cat Day, we’re excited to release our first major batch of updates to ThunderKittens! ThunderKittens is now easier, better, faster, and cuter than ever before! In addition to massive speed boosts, we’re releasing a broad swath of kernels, new features, and tons of usability improvements.
(Blog post: hazyresearch.stanford.edu/bl…, Paper: arxiv.org/abs/2410.20399)
As always, joint with @AaryanSinghal4, @simran_s_arora, @HazyResearch, and team!
Conner Takehana retweeted
Introducing ambientGPT: an open-source and multimodal MacOS foundation model GUI
Run GPT-4o and open-source models with full ambient knowledge of your screen.
Foundation models have long been confined to the browser. With ambientGPT, your screen context is directly inferred as part of the query, ensuring you never need to explicitly upload context again!
Github: github.com/siddrrsh/ambientG…
Conner Takehana retweeted
BREAKING: Legendary mathematician and hedge fund manager Jim Simons has passed away, age 86.
His Medallion fund was called "Greatest Money-Making Machine of All Time" and made an annual return of 62% per year from 1988 to 2018 (before fees).
Conner Takehana retweeted
Don't really blame @hosseeb for this to be honest.
Its pretty clear the rest of the crypto VCs are following some variation of my due diligence framework. Most don't have @dragonflyvc's resources.
I have now updated it for future reference.
This quoted post is unavailable.
Conner Takehana retweeted
Introducing Gemma with a 10M context window
We feature:
• 1250x context length of base Gemma
• Requires less than 32GB of memory
• Infini-attention + activation compression
Check us out on:
• 🤗: tinyurl.com/gemma10hf
• GitHub: tinyurl.com/gemma10git
• Technical blog: tinyurl.com/gemma10blog
Built by: @maxaljadery, @AkshGarg03, @siddrrsh
ALT We are so back.
