Joined January 2024
Japan’s wave of corporate breaches is the latest sign that AI is changing how hacking works. Since Sept 25, 18 Japanese companies have disclosed breaches, including Tokyo Metro, Japan Post, Lawson, Nikkei, Yamato and Sagawa. Attackers got about 6.6M Times Car accounts, some with driver’s license images. Burger King Japan says 11.18M app member records were affected, and Sourcenext says up to 22.5M records may be out. Last week, JPCERT/CC, the country’s national computer emergency response team, posted its findings from the investigations into these breaches. The attackers used AI to scan for known vulnerabilities and to attack companies’ APIs. Often they did this by pulling apart a company’s Android app to find the endpoints and any keys left in the code. It is also no surprise that Japanese companies are particularly vulnerable. Japan is still catching up on basic digitization, with many offices still using fax machines to this day! Now even the PM is getting involved, urging anyone running a PHP website to patch two critical vulnerabilities immediately, or temporarily take the site offline if they can't. xitter.cf/takaichi_sanae/status/…
皆様に、今夜に対応して頂きたい大至急のお願いです。   多くのウェブサイトで使用されているPHPに関し、PHPのセキュリティチームが、重大な2件の脆弱性に関する注意喚起を行っています。   公開しているウェブサイトでPHPを使用しているか確認し、今夜、10月21日午後11時(日本時間)に公開される修正パッチについて、可及的速やかに適用できるよう準備をお願いします。   修正パッチを速やかに適用することが困難な場合は、例えばウェブサイト等を一時的に停止させることも、リスクを低減させるための有効策の一つと考えられます。   国家サイバー統括室のXアカウントでも関係する情報を発信していますので、そちらも参考にして下さい。 国家サイバー統括室(注意・警戒情報)(@cyber_forecast) / X
17
23
6
183
30,030
SemiAnalysis retweeted
Today we launch SGLang-TorchTPU, built with @Google TPU team and Meta @PyTorch team. We’re excited to see it powering production inference at Meta! SGLang-TorchTPU is a TPU plugin for SGLang that brings: - Top open models on TPU: Muse Spark Open, GLM-5.3 Flash, Kimi K3, Ling 3.1 Flash, MiniMax H3 - SGLang’s production features for large agentic workloads - Custom MegaKernel: Muse Spark Open hits 770 tok/s decode at bs=1 on InferenceX 8K/1K SGLang-TorchTPU is available now: github.com/sgl-project/sglan…
Big day for the @PyTorch ecosystem at #PyTorchConf2026 🚀 We’re officially open-sourcing TorchTPU—enabling native, hardware-accelerated PyTorch execution across Cloud TPUs and custom infrastructure. Here’s everything we launched to supercharge your training & inference workloads 🧵👇 goo.gle/4Bl0zdG
7
21
15
139
35,543
SemiAnalysis retweeted
vLLM 🤝 TPU 🚀 Native PyTorch serving on TPUs is here! Built with @Google and @inferact, vLLM-TorchTPU brings familiar PyTorch tools to TPU inference, with prefix caching, speculative decoding, and disaggregated serving. 🛠️ Excited to keep building with the community!
Native PyTorch on TPUs is here—and TorchTPU is officially open source. Train and serve models using the tools you already know: @vllm_project, @sgl_project, @_llm_d_, TorchTitan, @huggingface, and @raydistributed. Learn more from #PyTorchConf2026 → goo.gle/4hWxEVH
5
21
3
173
16,519
Three teams in one month have pushed LLM decode forward with megakernels: Inferact on Google TPUs, AMD with TileRT and FlyDSL, and now NVIDIA on GB300, now live on InferenceX. We're excited to see these gains and dig into the engineering behind faster inference. Megakernels combine work that normally runs in separate programs. Here's why that matters and how each team's approach works. (1/8)🧵
15
8
3
123
21,623
NVIDIA's GB300 trace shows one K3 layer block going from 23 kernels to 13, and from 130 to 69 microseconds. Combining work of overlapping communication with other tasks and fetching weights early all help shorten the step. Kimi-K3 CuTe DSL decode: github.com/vllm-project/vllm… image source: Inferact blog (7/8)
4
1
9
6,616
As agentic workloads grow, high interactivity cases, especially how quickly a model generates tokens for each user, is becoming increasingly valuable. We're also seeing AI coding tools accelerate kernel development, where correctness can be tested and performance can be measured. Faster iteration gives talented engineers more room to explore and refine new ideas. We're excited to see what the next wave of kernel innovation brings. (8/8)
2
2
9
6,268
💭WHY IS DEEPINFER NOT ON INFERENCEX? DeepSeek dropped DeepInfer a few days ago, but the code is missing key components that is crucial for inference serving, and building them adds too much assumptions. (1/5)🧵
13
6
4
202
39,628
And vLLM on InferenceX performs extremely well. Explore our results, DSv4.1 serving results, configs, logs, and profit estimator on InferenceX.com (4/5)
3
1
28
7,641
Assuming 60% utilization, GB300 generates $50/GPU/hr profit at 125 TPS with Openrouter's prices, while DeepSeek makes $39/GPU/hr off-peak. As per Jenson, COMPUTE IS REVENUE. (5/5)
3
1
1
33
10,037
Is 50 GW in a single year too aggressive? "Dear Brad called us out publicly and cut our forecast in half." So Jeremie (@JeremieEO) and Reyk (@robotknower) came on with Jordan (@JordanNanos) to show their work. They go site by site from satellite and explain why haircutting the number double counts the delays already baked in. Plus moratoriums, 9-month modular builds, and why 2028 is the year to watch.
27
13
4
188
46,125
WHAT 1,730 CRYSTAL PULLERS TELL US ABOUT MUSK’S 20 GW PLAN: Musk says SpaceX has a “highly proprietary” plan to add 20 GW of power by end-2027, beyond just gas turbines. Solar is a part of it and things are moving. China shipped 1,730 crystal pullers to the US in Jul–Sep 2026, vs. 15 in the prior 18 months. Pullers grow the silicon ingots that are sliced into wafers for solar panels. (1/3)🧵 xitter.cf/WOLF_Financial/status/…
ELON MUSK SAYS SPACEX CAN BRING POWER ONLINE 12 TO 18 MONTHS FASTER THAN ANYONE ELSE And he has a plan to add 20 gigawatts next year On the earnings call, Musk said SpaceX $SPCX is turning on about 220,000 Nvidia $NVDA GB300 chips every month, and that pace will speed up next year. He expects to reach close to 3 gigawatts of compute in the next few months. He says he's highly confident SpaceX adds another 10 gigawatts next year, for about 13 total. The bigger plan would add 20 gigawatts, and he says the odds of getting there are "rising rapidly." He kept the details of that plan private, calling it "highly proprietary" because if he spelled it out, others would try to do the same thing. One advantage he did share comes from rocket engines. Turbine blades and vanes are one of the biggest bottlenecks in the industry, running 12 to 18 months behind the rest of the turbine. SpaceX is now casting its own, using what Musk calls the most advanced casting capability on Earth. "That means that we can bring power online 12 to 18 months faster than anyone else."
29
36
11
464
64,207
The math: benchmarks put one solar puller at ~11–15 MW/yr (Soochow ‘23, Linton prospectus, ESIA ‘24). 1,730 pullers ≈ 20–25 GWp/yr. Benchmarks are ~3 yrs old and these units cost ~50% more, so ~30 GWp is plausible. At a 20–23% capacity factor, with storage and backup, that’s ~4–7 GW of power (~35–60 TWh/yr). (2/3)
5
4
2
82
14,720
We track Chinese equipment exports (and many other datasets) monthly in the SemiAnalysis ChipBook in order to get leading indicators on where the puck is going. Sign up here👇️ (3/3) semianalysis.com/chipbook/
2
1
43
9,696