Building @PortkeyAI - the production platform for AI teams. 1st OSS project crossed 10k stars! passionate about LLMs in prod

Joined September 2008
Mystery solved. I can sleep in peace now. This is acceptable
Replying to @itsnebulalol
They misread 256 bit as 0-256, I bet
1
1
9
703
Fun stuff with @amazonIN today It delivers a wrong product to me which lists to be 10 day returnable. I submit a return request. The website says - sorry not possible. So I call the customer care center and they confirm that I’m right a wrong product was delivered. Phew. But.. Now they need a week to set up an inquiry. For what? To see what exactly happened. Meanwhile, what should I do? “Sir, that I don’t know” Can I order again from Amazon? “sir I can’t say anything there. inquiry will decide” Felt like I was back at UCO Bank in Pilani in 2007 🤣
2
24
2,288
I have a feeling we need to install firewalls per house now. I’m going to get one soon next to the router which restricts outgoing access proactively. Wouldn’t want a hacker to get access to my fridge!
6
33
1,113
Rohit Agarwal retweeted
drag to make ai answers shorter
102
66
34
2,065
78,083
Today we're reintroducing @quivlyai, backed by @ycombinator. Quivly is the AI workforce for everything after the sale, built especially for companies with usage-based pricing. Teams using Quivly take customers live in 7 days instead of 30, then expand them 4.3x on average. Our agents turn kickoff calls into launch plans, chase blockers, catch risk and expansion signals, and have the full account story ready at renewal. Closing the deal is just the beginning. Quivly handles everything after that.
75
26
11
242
35,254
This is a big fallacy in token cost conversions today. With caching in effect and model switching at play, blended costs are usually between 0.6 to 1.1 dollars per million tokens even for frontier usage.
poteto's cursor profile is public. She's used 1.5T tokens in the last 30 days. Assuming an avg rate of $8/M that's $384k/day or $11m. In the last 30 days. Per year thats $132M. Let's assume Cursor has some insane deal with Anthropic and gets 90% off. That comes out to $38k/day or $1.1M in Sept/Oct. $13m will get me 26 sassy staff-level all stars for $500k/yr
Readers added context they thought people might want to know
The Cursor profile at cursor.com/@lauren shows 1.5T tokens used. Cost estimates at $8/M do not account for prompt caching common in agent coding, where cache reads are billed at ~10% of input rates per analyses of Anthropic pricing. This results in lower effective costs. cursor.com/@lauren chudi.dev/blog/claude-pr… carlosaragon.online/blog/anthropic…
334
Rohit Agarwal retweeted
Introducing Graphical. It's a simple, powerful, and fun tool to design visual languages, style components, and work with coding agents to create interfaces that look memorable and feel unique. I hope you'll check it out at graphicalui.com!
242
246
87
4,913
564,252
Hall of fame response to a probable pesky AI bot gunning for refunds with tenacity
Replying to @AQululu66418
We’ve already responded to you numerous times via DM on different social media platforms. The response isn’t going to magically change just because you’re asking the same question on X now. /Flo
4
719
Rohit Agarwal retweeted
jev what? created a cheatsheet for anyone who needs a rundown
1
2
8
504
Rohit Agarwal retweeted
bro just dropped Gemini's system prompt
you are going to fail, so fail while daring greatly
123
461
42
12,814
573,800
Rohit Agarwal retweeted
Jev is going to result in an explosion of small, specialised models. And I'm absolutely here for it.
11
11
5
177
4,755
I never realised we needed GitHub features till they started launching some cool stuff!
2
251
2900 fixes is the bar for a minor release now.
Bun 1.4 - Fixes over 2,900 GitHub issues - +1,517 tests from the Node.js test suite - Reduces idle CPU by 5x - Reduces memory usage by up to 35% - Starts up to 50% faster on Linux - Rewrites Bun in Rust Thank you everyone who contributed since Bun 1.3! bun.com/blog/bun-v1.4
1
2
607
Rohit Agarwal retweeted
This is the only “LLM router” I need
i wanted a more physical way of switching models so I made this mini app... sound on
1
1
7
509
The only question worth answering: “is it load bearing?”
2
7
417
Sqlite is winning. I like that!
Introducing celld: a self-hosted, distributed Durable Objects and Workers implementation - celld = V8 + S3 + SQLite + LTX+ Tokio - programmed with exactly the Cloudflare Workers/DO JavaScript APIs and config - order of magnitude cheaper at scale - writes are durable before they're acknowledged, RPO=0 - only depends on an S3 compatible bucket - no other infrastructure - ~4 MB memory per cell instance overhead - hibernated cells cost ~nothing, just their S3 storage - open source, Apache 2 licensed
2
427
Rohit Agarwal retweeted
We removed ~80% of the Claude Code system prompt for our newest models, this is what we've learned about writing system prompts, skills and Claude.MDs for them.
464
1,902
706
16,309
4,955,159
The comments on this are wild. AI models just suck - all they do is cause chaos.
Crazy how many people this is happening to. Hugging Face, now this guy…
1
1
5
710