Michael Bloch (@michael_bloch) header
Michael Bloch (@michael_bloch) profile picture

Ex McKinsey Senior Partner now working with philanthropic foundations to scale up non-profits and solve social issues . Love Jewish books and learning

Israel
Joined January 2009
Photo by Michael Bloch (@michael_bloch)Photo by Michael Bloch (@michael_bloch)Photo by Michael Bloch (@michael_bloch)Photo by Michael Bloch (@michael_bloch)Photo by Michael Bloch (@michael_bloch)Photo by Michael Bloch (@michael_bloch)Photo by Michael Bloch (@michael_bloch)Photo by Michael Bloch (@michael_bloch)Photo by Michael Bloch (@michael_bloch)Photo by Michael Bloch (@michael_bloch)
Who would have thought Apple memory premium made it cheap vs. competitors ?!
The memory unit economics of Apple Silicon are insane. When you realise LLM inference is massively memory-bound (even at high concurrency!), you find that $ per memory bandwidth ($/GB/s) is the most important metric for inference. M5 Ultra: $5499, 96GB @ 1.2TB/s, $4.5/GB/s DGX Spark: $6950, 128GB @ 273GB/s, $25.5/GB/s DGX Station: ~$150K, 252GB @ 7.1TB/s (HBM3e), $21.1/GB/s M5 Ultra has 5.6x better $/GB/s than DGX Spark and 4.7x better $/GB/s than DGX Station. I am surprised Apple didn't increase their prices more (maybe they will so might be a good time to buy...) I expect 512GB M5 Ultra Mac Studio to start at $15899 (following the usual +$25/GB incremental memory price). That's a crazy good price for that much high speed memory. With RDMA over Thunderbolt 5 you get single digit microsecond latency and you can connect up to 5 Thunderbolt 5 cables between Macs for 400Gb/s network bandwidth (same as ConnectX-7). Thunderbolt 5 cables are ~$25 each. The main problem is the software on Apple Silicon is not great. There are about 30 competing inference engines, each supporting a small set of models, and quite unstable. The ecosystem around MLX is immature and limited (e.g. no Dynamo, LMCache, llm-d, ...). In our experience, more serious customers like Governments and Enterprises are put off by that and want something stable with an ecosystem of tools and software to run inference in production.
1
85
Michael Bloch retweeted
Europe: Break Glass Emergency Protocol Europe is spiraling. It’s been on a downward trajectory for a while, but now is time for a last resort common-sense plan while we still can: 1) Bring back a value system anchored in meritocracy. Reward ability, effort and results. Find role models from each community and walk of life, make them national heroes. Find ones on the other end of the spectrum and make punitive examples out of them. 2) Restore law and order. Break it and face real, swift consequences. Indictment also means you lose every social benefit and state subvention. 2x law enforcement budgets. Change the rules so forces on the ground stop fearing retribution for doing their jobs. 3) If you reject and disrespect the country and its values, you’re no longer welcome. Pending status + crime = immediate deportation. Raise the bar for naturalizations. 4) 12-months Europe-wide regulations purge. Aggressively delete the non-sensical regulations killing Europe’s competitiveness. Default: remove. 5) Elect people who will execute this, or accept the consequences. Keep voting for more welfare and suicidal empathy and there’s no turning back and no soft landing. Watching what’s happening in Europe should also be a telltale for America. Here, we should also ensure we defend and protect this framework with all we’ve got, or end up in the same tragic state as our European friends.
20
16
5
203
12,998
Michael Bloch retweeted
🔥 RARE MOMENT OF TRUTH AT UNITED NATIONS: As world leaders used the UN podium to condemn Israel, we invited courageous Yemeni journalist @JustLuai to tell the truth: “Our problem in the Middle East is neither Israel nor the Jews. It is the Islamist dictatorships.”
227
2,977
244
8,127
278,057
Crazy. This will change household work forever
The holy grail for robotics is being able to generalize: doing work in unseen places We rented 30 homes in the Bay Area and are doing tasks without any new training
176
Replying to @Hi_MINISFORUM
@Hi_MINISFORUM hey, bought a brand-new NAB6 server from amazon and am happy with it. I was very surprised however to discover out of the box that the NVMe drive had 977 power-on hours, 189 cycles and 5.9TB data written. Any explanation?
2
1
194
When the master speaks, we listen (to his podcast), when he writes a book, we buy it asap
I read this over Shabbos. 💕
1
1
4
1,550
Michael Bloch retweeted
Such an important video. Forget Jewish New Yorkers for a minute. Every patriotic American should denounce @NYCMayor. He takes the side of the only genocidal party in the Gaza war, Hamas. He tried to subordinate US law to an intl treaty our country rejected.
“Mayor Mamdani, I’m an Arab Muslim Israeli, and let me tell you why you’re wrong.” Lourd Atia debunks all of Zohran Mamdani’s lies and shares the truth about what life is really like for her in Israel.
33
257
6
1,134
44,500
This is an incredible (free) app for techies interested to play with LLMs deeply integrated with iOS
We’re deeply honored that Federico Viticci @viticci, Editor-in-Chief of the renowned tech publication MacStories, has published an in-depth review of Open Minis. Thank you for the thoughtful recommendation—it will help Minis reach more people and make the productivity benefits of AI more accessible to everyone. Truly grateful. macstories.net/reviews/open-…
1
228
Michael Bloch retweeted
Taiwan solved tax evasion in 1951 with a trick so cheap it should embarrass every tax authority on the planet. The problem was an all-cash economy full of small shops. A merchant pockets the cash, skips the receipt, and the sale never existed. Auditors can't catch what was never recorded, and hiring enough of them to watch every noodle stand costs more than the missing tax. So finance chief Ren Xianqun flipped the incentive. Print a lottery number on every receipt. Draw winners every two months on live TV. Top prize today: NT$10 million, about $310K. Suddenly the customer and the shopkeeper want opposite things. The merchant wants the sale off the books. The customer wants the ticket. And there are millions more customers than merchants. Every transaction now carries a built-in witness demanding the paper trail. Year one, reported tax revenue jumped 75%, from NT$29 million to NT$51 million. Seventy-five years later, roughly 70% of Taiwanese still play. Convenience stores redeem the smallest NT$200 prizes at the register, so even a coffee receipt feels like a scratch card. The elegant part is what the audit force costs. The prize pool runs about NT$7 billion a year, roughly $20 million. In exchange, the government gets 23 million unpaid auditors working every checkout line in the country, forever. No inspector general on earth delivers that coverage at that price. Greece, Italy, Portugal, and Slovakia all copied it. The most effective compliance tool ever built looks like a game, and that's exactly why it works.
In order to prevent stores from evading taxes, every receipt in Taiwan is automatically a lottery ticket, too, which can win up to $300k, turning customers into voluntary tax auditors:
614
6,864
803
30,235
3,865,608
Knowing @DBashIdeas highest quality standards this will be awesome !
1
1
4
2,484
Michael Bloch retweeted
Replying to @academic_la
Yes, my former unit. Yes, my real name is Reuven Weinstein. I served 2017-2019. I'm not sharing my commanders info. Here's a picture of me and the girl in the video. Nice "gotcha." It backfired.
6
1
42
1,956
Universities as financing operations with classrooms attached. Tough but fair — although it applies more to the US than to countries with subsidized universities
⚡️The American university system is the largest wealth transfer from the young to the old in human history and nobody frames it that way because the people who benefit from it control the framing. Eighteen year olds who can’t legally buy a beer are signing six figure debt obligations to institutions that face zero accountability for outcomes. The loan is non-dischargeable in bankruptcy. The university gets paid regardless of whether the student gets a job. The incentive structure is pure extraction. Get them in. Get the money. What happens after is their problem. 43% underemployment isn’t a failure of the students. These kids did exactly what they were told. Study hard. Get good grades. Go to college. Get the degree. They followed the script perfectly and the script was a lie. Not a lie that anyone intended maliciously at first. But a lie that became profitable enough that nobody corrected it even after the data made it obvious. The people who designed this system, the administrators pulling $500k salaries, the tenured professors teaching subjects with zero market application, the loan servicers collecting interest on degrees in fields that haven’t produced a living wage in twenty years. None of them are underemployed. They’re doing fine. The 43% is subsidizing their comfort. Now add AI. The entry level professional jobs that justified the debt are the first ones being compressed. Not blue collar work. Not trades. The exact white collar knowledge work positions that the degree was supposed to unlock. Legal research. Financial analysis. Consulting grunt work. Content production. The 43% who are already underemployed are about to be joined by a significant chunk of the 57% who thought they made it. The people who will come through this are the ones who figured out early that the credential was a trap. The ones who built skills instead of collecting letters after their name. The ones who found asymmetric paths. The ones who created value directly instead of waiting for an institution to certify them as valuable. The university system had a real function once. It produced genuine education and genuine opportunity. That function has been hollowed out by decades of misaligned incentives until what remains is mostly a financing operation that happens to have classrooms attached. And 43% of its recent customers just confirmed with their own lives that the product doesn’t work.
159
What kind of question is this? Books of course (OK and a few bookcases to put the books)
They give you $2 million. You got 20 minutes to spend it or it's gone. Can't buy cars, planes, yachts, or houses. No gold or diamonds either. What you buying?
1
119
Iran has the best empty slogans
A new banner in Tehran’s Enghelab Square reads in Arabic: “The entire Persian Gulf is our hunting ground.”
101
Very wise - in this case - and more broadly. A new take on the wisdom of crowds (and I would add financial market behavior to the list - Israel’s went up sharply since the start of the war)
This quoted post is unavailable.
1
115
Quick lessons from the Iran war so far: - The Islamist regime is weaker than its Lebanese proxy, Hezbollah. The regime bet everything on proxy warfare and let its Washington enablers build its aura of military invincibility. It was caught off guard in June. When it tried to catch up, Israel started finishing the job. - Closing the Strait of Hormuz hurt Iran's non-Western friends and forced Tehran to let their ships through, weakening its chokehold on global oil prices and the economy and taking away its only leverage. - Europe is powerless; its role has vanished on the global stage, whether in Ukraine or the Middle East. Its social welfare programs consumes all its budgets and attracts non-Western populations whose votes further paralyze European foreign policy and make it as useless as the UN. - Israel is the fastest-rising global power. - India and Pakistan are also rising (judging by how they deployed ships to Hormuz while Europe stayed shy and hidden). - Islamist Iran hates the Gulf more than anything else. The six GCC countries belong to the Western capitalist system and have no place in the East, BRICS, Iran, or China. The GCC's natural allies are America and Israel. - If Trump is Reagan, Netanyahu is Thatcher. The Trump-Netanyahu duo is projecting as much Western power on the global stage as Reagan and Thatcher did in the 1980s.
61
440
62
2,446
280,852
Tough lessons learned in the trenches doing real AI enterprise deployment
I've been building Powtoon for 13 years. 850+ enterprise deployments. Lockheed Martin, Fortune 500s, the whole range. Here are 7 things I've learned shipping AI to the enterprise that nobody talks about at conferences:
126
Michael Bloch retweeted
There are two wars going on - the actual one where demoralized IRGC and Basij squads and being targeted and killed and there's no higher headquarters to ask for help or send help. That's the reality on the ground. And The war on X - where regime apologists have primacy on U.S. media and misrepresent the pulse of the Iranian people. Where politicians and academia cheerlead the latest U.S. casualty or loss of military aircraft and equipment. We are 14 days into Epic Fury and the enemy is demoralized, in disarray, and being targeted by precision Isreali drones with information and actionable intelligence provided by the people. 2-3 man cells are now HVTs - that destroys moral and fractures units. The leadership is not responding - the ranks are not showing up. This is Day 14. For the first time in 47 years the oppressor regime now feels what 80% of the Iranian people feared everyday - that they could be next. The roles are shifting - the people can now call in air strikes and drone strikes anywhere they see regime groupings. Don't let the cheerleaders for the regime convince you otherwise - The Iranian people are not buying it and neither are the IRGC and Basij terrorists.
189
943
63
3,270
173,150
True. And so sad.
We had a good thing, Britain. A really good thing. You taught us this game. Mahan studied you. We just wrote bigger checks. The deal was simple. We spend the trillions. Fight the hard wars. We even let you sit out Vietnam. And you? You hold the chokepoints you already own. You run Lloyd’s. Ships in the narrows, insurance on the hulls. That’s all you had to do and we would back your interests with the strongest military and financial markets in the world. That was the deal. Now look at you. You gave up Aden. Fine. You kept Diego Garcia so we could reach it with bombers. Now you’re giving that away too. To a Chinese client state. You built Israel to guard Suez. Now your Foreign Secretary threatens to arrest their PM. You built a base nearby to back it up. Iran hit your base in Cyprus. You didn’t have one warship in the Mediterranean. Spain got there first. Spain. You gave up Hong Kong but backed Taiwan. Now you’re letting China build the largest embassy in Europe on top of London’s fiber-optic cables. We gave you Five Eyes. You gave Beijing a SIGINT platform in the heart of the City. Gibraltar. Three hundred years. Actual sieges. Now the Spanish run your border checks. You lost South Africa but kept the Falklands so we can overfly the Magellan Strait. Argentina could probably take that with rowboats today. Your king kept ownership of the Canadian, Australian and New Zealand navies to fill the gaps. Those navies are now a laughing stock. Your warships and bombers patrolled the GIUK gap. Now you don’t have enough but you also don’t want us buying Greenland. Fine. You do it. With what? We gave London the @IMOHQ to regulate shipping, you backed the EU agenda to carbon tax every ship to build woke UN slush fund. Iran closed Hormuz. In the ‘80s, 540 ships got hit. Lloyd’s never blinked. Because your navy was there. Now Lloyd’s cancels. Because it isn’t. You scrapped your only amphibious ships. Sold them. To Brazil. You have more admirals than warships. You built two light carriers but they keep springing leaks and you don’t have enough escort ships to support them. The English Channel. Stopped Napoleon. Stopped Hitler. Now you can’t stop rubber dinghies. You had one job. Have the warships, diplomatic backbone and insurance to support shipping through the straits. That’s it. That’s all we asked. And you blew it. Chokepoint by chokepoint. Called it progress.​​​​​​​​​​​​​​​​ Now hundreds of ships are stuck in the Persian Gulf and the world is blaming us. But that’s ok. All those solar panels you bought from China will keep you warm in that dreary weather I guess.
102