
CEO & Founder | PhD | Startup Advisor | @Columbia | Author Generative Software Engineering https://xitter.cf/t.co/9oqvHuTX5f | 🔔 Follow for AI & Vibe Coding Tips 👇
PNW
Joined July 2023
- Tweets17.8K
- Following551
- Followers12.3K
- Likes5.3K
David Hendrickson retweeted
🤯 So you can actually get a 100K context & ~50 tps on one 16GB GPU.
Putting Qwen3.8-27B onto an RTX 4070 Ti super is the kind of localmaxxing I ❤️ to hear about.
Recipe 👇
🧠 Qwen3.8-27B
🎮 RTX 4070 Ti SUPER — 16GB
📚 100,000-token context
⚡ 47–50 tok/s
💾 15.93GB VRAM
This recipe stacks several optimizations:
✧ 13.5GB hybrid GGUF
→ attention stays IQ4_XS
→ FFNs compressed to IQ3_S
✧ BeeLlama.cpp instead of stock llama.cpp
✧ KVarN compressed KV cache
→ K = kvarn5
→ V = kvarn4
✧ Last 1,024 KV tokens kept at higher precision
✧ MTP-2 speculative decoding
Changing the KV cache from kvarn5/kvarn5 → kvarn5/kvarn4 alone reportedly freed another ~6% VRAM and pushed context from 88K → 100K.
🎯 So this is what they did …
Weights → selectively quantized.
KV cache → selectively compressed.
Recent context → kept high precision.
Decode → speculated.
⚠️ This uses BeeLlama.cpp, a llama.cpp fork, not stock llama.cpp/LM Studio, and the 47–50 tps number is a community report.
Links 👇
🔗 Reddit r/LocalLLaMA/comments/1w1lq7u/qwen_38_27b_at_50_toks_with_100k_context_on_a/
David Hendrickson retweeted
I published my analysis of Qwen3.8 27B and Muse Glimmer xhigh mode: Accuracy, Token Efficiency, and Memory Use
kaitchup.substack.com/p/qwen…
The most surprising result: Qwen3.8 27B xhigh is much more token-efficient than Qwen3.6 for most non-agentic tasks.
So, the community feedback, "Qwen3.8 27B thinks too much," might only apply to agentic tasks.
My agentic benchmarks are running: Claude Code vs mini-swe-agent vs pi, low/medium/xhigh
Large evals
Hopefully, I'll have all the results by next week.
Thank you @verdacloud for the compute sponsorship!
David Hendrickson retweeted
I've been waiting to see if the LLMs are able to master the IQ test (non-training data) over repeated attempts. Yes, they have. I've never seen this before. Does this convinced you LLMs are AGI (score better than 99% of humans)? Or has the Overton window moved?
David Hendrickson retweeted
New: one-click ZDR (zero-data retention) in the Chatroom
Compare models side-by-side with full privacy: openrouter.ai/chat
David Hendrickson retweeted

Anthropic@AnthropicAIJul 1
United States
United StatesConnected via WebAccount-level information, not a live location or per-post device.
Claude Fable 5 will be available again globally tomorrow.
After a series of productive conversations with the US government, we're redeploying the model with a new set of classifiers to target and block more cybersecurity tasks. In the near term, some routine tasks like coding and debugging will fall back to Opus 4.8. We’ll continue to refine these classifiers over the coming weeks to reduce false positives and better distinguish genuine misuse from legitimate requests.
We’ve also begun drafting a consensus framework—with Amazon, Microsoft, Google, and other Glasswing partners—for assessing the severity of AI jailbreaks and how AI developers should respond to them. We invite other industry partners and model providers to join us in this effort.
Finally, we’re scaling up our collaboration with the US government on model testing and safeguards. This will include pre-release access to models and safeguards for evaluation, information sharing on jailbreaks and misuse, and dedicated resources for joint research.
Thank you to our users for your patience, and to our partners across the government, industry, and the research community who worked alongside us to make Fable 5 available again.
Read our full blog: anthropic.com/news/redeployi…
David Hendrickson retweeted

zerohedge@zerohedgeJun 25
United States
United StatesConnected via United States App StoreAccount-level information, not a live location or per-post device.
"the share of tokens used for US models on OpenRouter has collapsed": Bloomberg
David Hendrickson retweeted
🚀🚀
Nous Research@NousResearchMay 26United States
United StatesConnected via WebAccount-level information, not a live location or per-post device.
Qwen 3.7 Max is now supported in Hermes Agent
David Hendrickson retweeted
🚀 Localmaxxers, run Qwen3.6-27B in your browser!
100% WebGPU • Fully Local • Zero Cloud
Localmaxxers just got their biggest browser flex yet. 😎
Posted by @ngxson (Hugging Face)
🧪 27B parameters
📦 Q2_K_XL GGUF (~11.2 GB) via wllama
🖥️ Runs entirely in-browser on WebGPU
📱 Apple M5 Max: 97% GPU utilization
No server. No telemetry. Pure client-side inference.
David Hendrickson retweeted
ok its not the most important thing we've ever done but i find it more useful than it seems on the surface.
check out pets in codex!
(and try hatching one)
🚨 Musk's lawyers just showed the jury the most damaging document in evidence on Brockman:
November 2017 Brockman writes in his private diary:
>"the true answer is that we want [musk] out... if three months later we're doing b-corp then it was a lie"
>“can’t see us turning this into a for-profit without a nasty fight. i’m just thinking about the office and we’re in the office and his story will correctly be that we weren’t honest with him in the end about still wanting to do for profit just without him”
January 1, 2018 Brockman emails Musk:
>"it's an honor to work alongside you. every meeting with you, i continue to learn, grow, and see the world in a new way"
Brockman was planning to oust OpenAI co-founder Musk while publicly thanking him for the privilege of working alongside him.
openai is already teasing with gpt-5.6
so if you checked the internal codex logs to verify which model was being used, and you found the rollout mapping
most calls were routed to gpt-5.5, but one entry appears to show gpt-5.6, which means the codex environment may have had access to a rollout entry labeled
David Hendrickson retweeted

Logan Kilpatrick@OfficialLoganKApr 22
United States
United StatesConnected via United States App StoreAccount-level information, not a live location or per-post device.
TPU’s are a core part of the Google secret sauce, excited to see our 8th generation TPU see the light of day : )
David Hendrickson retweeted
GPT-5.5 or GPT-Spud, @OpenAI's most powerful AI to compete with @AnthropicAI's Mythos, to release next week (Thursday April 23rd).
OpenClaw 2026.4.14 🦞
More reliability updates:
✨ Smarter GPT-5.4 routing and recovery
🌐 Chrome/CDP improvements
🧵 Subagents no longer get stuck
💬 Slack/Telegram/Discord fixes
⚡️ Various performance improvements
Was sleeping, and we still shipped. github.com/openclaw/openclaw…
David Hendrickson retweeted
My dear front-end developers (and anyone who’s interested in the future of interfaces):
I have crawled through depths of hell to bring you, for the foreseeable years, one of the more important foundational pieces of UI engineering (if not in implementation then certainly at least in concept):
Fast, accurate and comprehensive userland text measurement algorithm in pure TypeScript, usable for laying out entire web pages without CSS, bypassing DOM measurements and reflow
David Hendrickson retweeted
I’ve released quantized versions of Qwen3.5 27B using:
- AutoRound (INT4), with linear attention layers remaining in 16-bit.
- LLM Compressor (NVFP4/MXFP4), with linear attention layers, shared expert, and MLP gate remaining in 16-bit.
Optimized for fast inference with vLLM (validated on v0.16.1rc1).
huggingface.co/collections/k…
Note: still under evaluation; additional quantizations coming soon.
Acknowledgments: @verdacloud for compute sponsorship.
David Hendrickson retweeted
🚨 The Qwen3.5 series of distilled models is here! 🎉 These proved to be very useful in the past for those inferencing at home with underpowered PCs. Unfortunately, we don't see a model small enough to fit on a single RTX-5090 w/32 GB VRAM, so those will have to use quant models.
Qwen3.5-27B seems to be the surprising winner and certainly a replacement for Sonnet 4.5. 🦞 Clawdbots rejoice as this could fit on a 64GB AMD Halo Strix PC $2K or 64GB M3 Mac Ultra $4K.
🚀 Introducing the Qwen 3.5 Medium Model Series
Qwen3.5-Flash · Qwen3.5-35B-A3B · Qwen3.5-122B-A10B · Qwen3.5-27B
✨ More intelligence, less compute.
• Qwen3.5-35B-A3B now surpasses Qwen3-235B-A22B-2507 and Qwen3-VL-235B-A22B — a reminder that better architecture, data quality, and RL can move intelligence forward, not just bigger parameter counts.
• Qwen3.5-122B-A10B and 27B continue narrowing the gap between medium-sized and frontier models — especially in more complex agent scenarios.
• Qwen3.5-Flash is the hosted production version aligned with 35B-A3B, featuring:
– 1M context length by default
– Official built-in tools
🔗 Hugging Face: huggingface.co/collections/Q…
🔗 ModelScope: modelscope.cn/collections/Qw…
🔗 Qwen3.5-Flash API: modelstudio.console.alibabac…
Try in Qwen Chat 👇
Flash: chat.qwen.ai/?models=qwen3.5…
27B: chat.qwen.ai/?models=qwen3.5…
35B-A3B: chat.qwen.ai/?models=qwen3.5…
122B-A10B: chat.qwen.ai/?models=qwen3.5…
Would love to hear what you build with it.
David Hendrickson retweeted
REPORT: Microsoft is gearing up to ditch OpenAI and ChatGPT, and build its own frontier models.
In a new interview with FT, Microsoft AI chief Mustafa Suleyman confirmed the move, stating:
"We have to develop our own foundation models, which are at the absolute frontier, with gigawatt-scale compute and some of the very best AI training teams in the world."
Read more below!

























