
all things ai and coding while streaming, DM for consulting. pet projects @herorunai + https://teapawt.org/t.co/4lSXuoK33k
Joined January 2022
- Tweets7.3K
- Following731
- Followers2K
- Likes815
Pinned Tweet
I ran a 35-billion parameter AI agent on a $600 Mac mini.
Specs: M4 Mac-Mini 16GB RAM
The model doesn't fit in RAM. It pages from the SSD at 30 tokens/second.
On NVIDIA, the same paging gives you 1.6 tok/s. Apple Silicon gives you 30. That's 18.6x faster.
No cloud. No API keys. $0/month.
Here's what it can do 🧵
thestreamingdev() retweeted
David Friedberg: Restricting Open Source AI is a Path to Tyranny
“Open source needs to be allowed and frankly encouraged to proliferate because the absence of that means that you're going to have tyrannical groups, ultimately, they become tyrannical.
They don't intend to be tyrannical, but every group that has the power to control what people see, what they're allowed to do, what they're allowed to access, how they're allowed to use things, what those specific weights are on ‘facts of history,’ on ‘proven science,’ on ‘the truth.’
That is where people become tyrannical because they have an opinion where they think they're right, and if they have the power, they will act on that opinion, and it will ultimately give them tyrannical force over a broader population.
That's what will happen if we limit the proliferation of open source software in AI.
And I've said it before, I'll say it again, ultimately, you can regulate, you can restrict, you can control, you can litigate, you can criminally penalize people for the outputs of what they use software to do.
But to limit software, to label software, to make it a point of restriction and control creates a regulated monopoly for the closed source products that are out there that ultimately, if aligned with certain government agencies, gives those government agencies and those individual corporations power and control over you, the individual, what you're allowed to do, what you're not allowed to do, and every business on Earth no longer operates freely.
None of us should want that. I don't care what your political affiliation is.”
Travis Kalanick says he’ll pull up to Nvidia HQ with employees ready to walk out for Jensen: “We don't have control of the outcome, but let's fucking fight."
"I obviously experienced this. I went through six months of ops before I went down. And I held on as tight as I could, but eventually I just couldn't."
"But any wisdom I can provide about that experience to Jensen or the team of people around him that I think are ultimately going to lean in to fight to get him back, because it matters so much, that's what I'm bringing to the party."
"I sent Jensen the screenshot of the stories when there was a petition for me. I'm like, 'petition good, walk out better'. I didn't get a response."
"But I will show up to NVIDIA HQ with a wafer encrusted megaphone with tons of NVIDIA employees who want to walk out, tons of CEOs, founders who believe in what I just said, who are believers and don't want an AI overlord. And let's fight for what's right and give it a best shot. We don't have control of the outcome, but let's fucking fight."
Travis Kalanick on being ousted from Uber: “you definitely shouldn’t raise from Benchmark Capital”
"I got to first shoot the arrow, which is you definitely shouldn't raise from Benchmark Capital. Got to get that out there.”
“Where did it get weird? 2017 was my problem year. And Benchmark was running a war room. They were an unspoken activist investor that was creating a once a week crisis against me, without speaking of it.”
“The best I can see is that they wanted liquidity and they felt like I wouldn't give it. And we were already preparing for an IPO, but I didn't tell them that.”
“We wanted to make sure we'd done the right thinking, got prepared so we could just say, 'We're going to do it, and here's how we're going to do it.'”
“Bill Gurley's a bit of a catastrophist. It's always the end of the world. And that forces you to do really weird things if you think the world's always going to end, including trying to take me out."
🥱
*BESSENT: $NVDA BOARD FIRING JENSEN HUANG DOES NOT LET REST OF COMPANY OFF THE HOOK
*BESSENT QUESTIONS WHETHER NVIDIA KNEW ITS CLIENT OR PREVENTED LEAKAGE TO "OBVIOUS PASS-THROUGH SHELL COMPANIES"
*TREASURY SECRETARY DEMANDS ACCOUNTABILITY ACROSS NVIDIA OVER >$4B IN AI CHIP SALES TO MEGASPEED
*BESSENT: "THE BOARD CANNOT JUST FIRE HUANG AND THINK IT ALL GOES AWAY. WE CAN'T HAND CHINA AN INCH"
91
Wait til you learn you can do this with a cloudflare tunnel 😂
You can put Durable Objects behind your Tailscale tailnet.
It gets its own 100.x address, dial into private machines and also act as an exit node or subnet router.
github.com/littledivy/tailne…
2
317
thestreamingdev() retweeted
US industrial capacity has been eroding for decades, and with it the fortunes of our middle class and to an extent, our national security. Data center development and our leadership in AI can reverse that trend, finally. Current hysteria to block all projects everywhere is a gift to China.
they’ve been doing it for awhile
my spidey senses are telling me the labs are, as we speak, using unguardrailed versions of their unreleased models to systematically reverse-engineer ALL of the internet’s software, apps, and games, then feeding the reconstructed source code straight into their training pipelines while simultaneously building guardrails to ladder-pull the rest of us
113


















