I make search go brrrrr. Founder of https://xitter.cf/t.co/NPdS6lZFDj, creator of Mighty Inference Server.

Flower City, NY
Joined March 2009
I made a calculator a while ago that I use with clients and training. Here's a rough equivalent for hot (all vectors in RAM) using traditional compute, across various clouds/configs. The cost is on RAM and CPU, but I don't have numbers for QPS
4
341
I'll never understand homebrew
185
My reaction to the daily RAG solution pitch spam I get.
2
274
Taking bets as to whats going on here...
1
206
Watching the awesome multimodal search muves.io demo by @DmitryKan and @aarnetalman at #bbuzz. 20 ANN queries in 250ms using @gsitechnology APU!
1
4
10
Replying to @ylecun
Social networks don’t have a simple mechanism for me to say “this is spam”. Maybe let us tell you instead of trying to guess all the time? Look at the options here - where is the spam flag?
1
TIL Google uses ML to generate regex for content parsing.
1
6
You guys have it easy. This is the crap I have to deal with! No idea where these recs are coming from.
1
Tokenization got a whole 9 lines in the falsehoods about search post for a good reason!
I just spent most of my day going down the dark, dark rabbithole 🐰that is tokenization. A thread 🧵(1/n)
1
6