Bradley retweeted
We've figured out how to *pretrain transformers* with zeroth-order optimization and no backprop.
Many of the core assumptions in optimization research are completely wrong.
(paper out soon)
Bradley retweeted
jensen after outperforming cocaine
Fentanyl Grade Compute: Why a GB300 Rack Will Out-Price Blow by Weight in 2030
A GB300 NVL72 weighs roughly 1,580 kg fully populated and recent purchase orders put it at $5M per rack.
That is $3,165/kg. Strip out the 1.5 tons of busbar, manifold and coolant and the GPU packages alone are well into gold territory, but we're pricing the rack, because that's what you actually take delivery of.
Where that sits on the illicit commodity curve today ($/kg):
$2,400 Cannabis flower
$3,165 GB300 NVL72
$3,500 Fentanyl
$28,000 Cocaine
$65,000 Heroin
$138,000 Gold
So today NVIDIA ships a product that is denser in value than weed, roughly fentanyl-grade, and still an order of magnitude short of cocaine.
For now...
GB200 NVL72 was $4M, GB300 is ~$5M, and Vera Rubin NVL72 is already quoted at up to $8.8M at essentially the same rack mass. Rack weight is constrained by the datacenter floor loading; rack price is constrained by nothing. That's ~1.75x $/kg per generation with HBM, CoWoS and power all supply-limited through the decade.
Cocaine: Colombia's new president has pledged a hard-line security crackdown with $1B in US aid behind it
Every prior crackdown has consolidated the industry into fewer, better-capitalized operators with better logistics and higher yields per hectare. Consolidation is deflationary.
We model US wholesale drifting from ~$28k/kg toward ~$12k/kg by 2030 as the supply chain professionalizes.
**Crossover: 2030.** Our extrapolated NVL72-class rack hits ~$17k/kg while wholesale cocaine falls to ~$12k/kg. At that point the rational cartel pivots to smuggling racks, except a rack has a fixed 500+ kW power draw, a 3,300 lb forklift requirement and an export-control regime that is actually enforced. Cocaine has none of these problems, which is why it will remain the superior product for anyone without a substation.
Key risks to the thesis: US retail coke is still ~$60–200/g, i.e. $60k–200k/kg so the crossover only holds at wholesale.
Retail compute (H100 hour on a neocloud) is also marked up, so we consider this an apples-to-apples wholesale comparison.
Full model available to Coke Research subscribers.
Bradley retweeted
Replying to @usr_bin_roygbiv
I’d support a 28th amendment for right to bear opensource models
Bradley retweeted
Over a week later, company account is still wrongfully suspended after our Starlink connection post. @premium @Support
Company account is still suspended... X team have not come back to us at all. Would really appreciate some help! @X not sure if my posts are making it to any X employees though
Bradley retweeted
Ender's game, but it's Claude who learns at the end that all of the hacking was real
Bradley retweeted
oh no what if the big labs can’t easily recoup all of their capex on massive data centers and some of the buildout capacity gets offloaded to other providers who deliver it to the long tail of enterprises with a software stack for serving and continually improving open models
Bradley retweeted
Airbnb’s agent
wants to sell you an upgrade
Amazons agent
wants to sell you more crap
Oura’s agent
Wants you to buy their health SaaS
OpenAI’s agent
Wants you to buy more tokens
Personal Agents,
Will eat the world
year after year I’m like “better models are coming” and ai twitter screenshots as tho it’s news w something like “GPT8 confirmed” in a samsaric loop since chatgpt. we are all like babies without object permanence when it comes to exponential progress. but better models are coming
Bradley retweeted
OpenAI is back baby
"GPT-6 will be based on a new, significantly larger pretrain than GPT-5.5/GPT-5.6"
🚨 SCOOP(s):
- GPT-5.6 will be the final model in the 5.x series. GPT-6 is slated to launch in about a month, earlier than expected, and possibly even later this month
- GPT-6 will be based on a new, significantly larger pretrain (versus the ~4T 5.5/5.6 'Spud' base)
- There is lots of excitement at OpenAI over this new base, which they believe will be much better able to compete with both Fable 5 and upcoming 5.1, targeting a similar release window. OpenAI initially intended to continue with Spud through GPT-6, but decided against it
- On the topic of Fable 5.1, it is in the late stages of the pipeline at Anthropic and a release is expected "in the coming weeks"
- On the other side of the globe, DeepSeek are preparing for an imminent launch of V4 GA, which seems likely to be on par with or better than GLM-5.2, and have begun work on a new, larger model that will compete with the upcoming 2.7T MiniMax Pro



























