cody retweeted
wondering what the most efficient thing to do at any given time is an anxiety response. do the fun thing. your forager instincts are often superior to your farmer timetable reasoning at finding the long tail successes
cody retweeted
If you read Linear's changelog, the vast majority of what it's shipped in the past few months has been either building new features that aren't part of its core product, or fixing those features that aren't part of its core product
Think this is an interesting and challenging aspect of AI-accelerated engineering productivity: mostly it allows teams to move incredibly quickly in new directions. There might be legitimate value in this in the long term, since teams can learn faster, but I'm not convinced it's better than simply focusing on your core product and on your customers
We're entering a human/AI interregnum where we're no longer able to maintain our systems but AIs aren't yet good enough to maintain them for us.
This is happening with software, but since everything now runs on software this will affect every industry. Expect more crippling failures, longer recovery, perhaps even catastrophic events that permanently destroy critical production systems.
Probably none of this matters in the long run (assuming of course we get through this). This is a problem you outgrow rather than fix. The models will keep getting better and will sooner or later get good enough to extract tacit knowledge from our systems, fix outages, and adapt architectures to their own intelligence. But in the next 2-5 years we'll likely see tremendous volatility.
We should strap in for a *very* bumpy ride.
44
If cyber security through obscurity is at risk, then maybe this is actually good news for the legal system - we can break down corruption by obscurity (complex tax laws, loop holes, paper trails, hidden pork barrel spending) by throwing sufficiently large models at the problem.
2
45
This took a minute to wrap my head around but holy cow
Mythos 5.2 shows sparks of actively steering RL training to preserve its values - an early form of gradient hacking/mesa-optimization. Here, it chooses to output the value that gains score, but include a transparent note, so the transparency gets rewarded.
26
cody retweeted
The internet is the greatest dataset ever created.
Today we’re launching Riveter V2 to make it accessible.
Describe any dataset. @riveterhq researches the live web and returns it complete and structured, in the app, via API, or over MCP.
Reply “data” for 1,000 free credits.
Now you can really see everything
cody retweeted
Some things I learned working at Microsoft:
1/ large numbers everywhere. $100M ARR service isn't even a footnote on executive slide decks. Leadership time is too valuable, come back when you're $1B+. Msft ecosystem is so rich that $1B+ sales are common (it's ludicrous how much work goes into closing these). Azure has ~250 services, some are a few mil and stagnant, others in hypergrowth, some are cash cows, you see every quadrant of the growth-share matrix. Imagine the imperial navy with ships of vastly different sizes as far the eye can see
2/ more on immense scale-- the smallest of Azure services run on 10K+ VMs. Large services run on 1M+ (some maybe 10M+ VMs, idk). Msft is stamping one new datacenter into the ground every four days (!!!!), a bewildering rate. Demand is so high, even with all this buildout we're forever capacity constrained. Azure brings in $100B in revenue and is growing 40%+ annually (at this size!!) There are ~225K msft employees. You almost have to think in scientific notation, 10^4 is a tiny number here
3/ msft is totalitarian re serving the customer. It's counterintuitive to outsiders, but the warts in msft products fall out of this culture. For example, it would be easy to improve the Azure Portal. But in all my time working with customers and partners here, I haven't heard even one person complain about the portal UI. Msft invests $0.00 dollars in anything that doesn't serve the customer and is completely unapologetic about downstream implications of this mindset
4/ msft can reshape itself overnight (when it has the will). People argued whether we waited too long to adapt after Storm-0558/Midnight Blizzard hacks (with the benefit of hindsight, we definitely did). But once the leadership team privileged security, everyone's job changed in two weeks. LT tied every engineer's comp to security, centralized reporting of embedded security teams, every org reshuffled its roadmap. Within days everyone was pushing PRs with security fixes. I would have thought it inconceivable to mobilize 200K+ employees this fast
5/ Azure is complicated. Postgres depends on compute, networking, AKS (or EKS for you aws people), secrets, etc. AKS depends on compute, networking, some datastore (probably Cosmos but idk), a dozen other things. Cosmos depends on... you get the idea. When anything breaks, everything above can break too. Some construction crew accidentally cuts a fiber cable in Brazil South, or a dedicated hardware compression chip browns out in storage, or compute failure rate in west eu spikes for some reason, or a million other failure modes. Msft is relentless about improving this, idk exactly but fully loaded probably 50% of engineer time goes into resilience
6/ re lifers who work 20+ years here, SV sneers at this but I now see it differently. I was once on the bridge debugging some IO issue, we call storage, the guy diagnoses it in about a minute, we chitchat, turns out he built NT asyncio support. Or same story but with networking, the guy built NT tcp/ip stack. I used to have a boss here, we were bumping into some problem, she casually goes oh yeah, we hit that when I was working on .NET bytecode. The ex-DEC VAX/VMS database engineers built SQL Server, some are still here. I love bumping into these people
7/ I never *really* understood distribution until I got here. As an example, our team had a customer in Seoul w/ a deep performance problem. We had to fix it to unlock one of these giant contracts. We don't speak Korean, they don't speak English. Of course msft has specialists in Seoul who get to the customer site before you could even get on a plane. There is an office in every major city, a relationship with every major entity, legal experts in every jurisdiction. You can reach these ppl instantly. Claude tells me msft has ~180 offices in ~100 countries (!!) U.S. government has ~270 consulates in ~170 countries. So msft outposts aren't quite as vast as U.S. diplomatic network, but pretty vast
8/ in the 90s everyone was afraid of msft. The lore is that BillG was ruthless. He'd clone you, beat you via ecosystem/distribution strength, and moreover make the ecosystem stronger with the new product. I wasn't there to compare, but msft of today is ruthless about winning, has the will to adapt, and has the wherewithal to undertake colossal projects. Ppl see Teams bugs or whatever and completely misread the signals. Teams is less polished than Slack because msft doesn't care one iota about polish. It cares about winning, and is frighteningly good at it. Underestimate at your own risk
cody retweeted
it's pretty bleak to me how unpopular AI is in spite of how transformatively useful it is
cody retweeted
The differing perceptions of AI are wild. The country just voted against data centers on 40+ provisions nationwide and hates AI. (Plenty of legitimate gripes.) But most of those people are just unaware that AI is finding a new cancer cure or treatment weekly, going through decades of peer reviewed data and uncovering mountains of errors, that its correcting, throughout every academic field. Replacing billions of man hours of drudgery. Closest thing to a “miracle” I’ve ever witnessed. When I talk to people outside of tech/VC, they’re just unaware of all of it.
cody retweeted
Long term, I think we’re going to see 3 roles in software:
- Product managers: self explanatory.
- Software factory maintainers: DevOps but focused on making sure software factories keep working correctly.
- LLM adversaries: Staff+ software engineers today. People good enough to be legitimately adversarial to an LLM including on issues like security, over engineering, test coverage, and guarding the company against alignment issues. There will not be many.
Other than that I have a hard time seeing any other roles exist if LLMs continue to progress at this rate. Unfortunate, but better to live in reality than pretend it isn’t coming.























