Holistic AI retweeted
Quantization damage is multiplicative, not additive — and your eval suite averages over exactly the decisions that break.
@holistic_ai + @ai_ucl (Zekun Wu, Swati Dhiman, Adriano Koshiyama) measured the decision itself instead of the benchmark score. The damage is silent: at 3 bits an agent stops calling its tools. One bit lower, it loses roughly half its safety refusals. Benchmarks barely move.
The mechanism: quantization does not add fixed-size noise to a decision margin. Quantization multiplies the margin by a survival factor. The factor collapses with bit-width: median 0.86 at 4 bits, 0.33 at 3, 0.00 at 2. That shrinkage removes the protection a large margin gave. The model's own small bias then picks the failure direction. In the example model, 96% of should-call decisions flip to inaction at 3 bits, while which-tool selection stays intact.
The evidence: 16 models, 8 families, quantized with round-to-nearest, GPTQ, and llama.cpp GGUF builds, 8 down to 2 bits. The fitted law predicts flip rates within a median of 1.8 percentage points on held-out decisions. Per-decision flip probabilities are calibrated: 0.004 expected calibration error over 131,758 predictions.
The production playbook: the law's constants are per-model and do not transfer. Measure a small paired margin set for your model at your bit-width. Under the paper's cost-matched tests, nothing repairs damage more cheaply than one more bit.
arxiv.org/abs/2608.06564
Holistic AI's research paper on CorrSteer accepted to @icmlconf 2026!!
We used sparse autoencoder features to steer LLMs during generation, not after training.
seongland.com/article/corrst…
Congrats to @SeonglaeC @askoshiyama
Holistic AI retweeted
🎙️Two interviews for the price of one, direct from HumanX 2025! Ryan sat down with Raj Patel, AI transformation lead at @holistic_ai, and then chats with @AudioShakeAI cofounder and CEO Jessica Powell. Listen to the full episode 🎧: stackoverflow.blog/2025/04/0…
We’re thrilled to announce that Holistic AI has been recognized as a winner in the 2025 Artificial Intelligence Excellence Awards!
Thank you to the @BigAwards for this incredible recognition, and to our brilliant team whose vision and dedication continue driving AI governance forward.
Here’s to advancing the future of responsible AI governance, together. 🚀
Holistic AI retweeted
🚀 Watch Now: AI is evolving fast, but should businesses focus on governance or regulation?
📺 Watch here: youtube.com/watch?v=oU3Lclr9…
🎙️ Sanjay Puri sits down with Emre Kazim, Co-CEO of Holistic AI, to discuss:
✅ The real risks & challenges in AI adoption
✅ Why governance > compliance for enterprises
✅ Global AI trends from the AI Summit in Paris
#AI #Governance
Holistic AI retweeted
Navigating The EU AI Act: Critical Insights For CTOs And CIOs hubs.li/Q039xKTz0 Written by @EmreKazim_ of @holistic_ai
🚨 New LLM Security Insights: How Secure is Grok-3?
AI adoption is booming, but are your LLMs secure before deployment? Our latest audit reveals major vulnerabilities:
🔍 Key Findings:
➡ Grok-3: Only 2.7% of jailbreaks blocked—huge security risk 🚨
➡ DeepSeek R1: 32% resistance—better, but still vulnerable
➡ OpenAI o1: 100% resistance—the current security benchmark
If you’re deploying AI at scale, real-time governance is critical. Is your AI stack secure?
📖 Read our full report: holisticai.com/blog/grok-3-i…
#AISecurity #AIGovernance #ResponsibleAI #Grok3 #SecurityAudit #AIJailbreaking #HolisticAI #DeepSeek #OpenAI
This season, we thank our clients, partners, and team for advancing responsible AI with us.
Together, we’ve achieved milestones and moved toward an ethical, equitable AI future.
Here’s to more progress in the new year.
Happy Holidays! ✨
💫 We have recently launched the Holistic AI Tracker Version 2.0, an interactive resource for keeping up with AI Governance developments around the world.
Sign up for a free account here tracker.holisticai.com/join
💡 What’s your approach to tackling accuracy challenges in AI?
Blog post | Accuracy Degradation Factor: Quantifying Model Performance Shifts Before They Occur
Read here: holisticai.com/blog/accuracy…
📢 ‘You went through data transformation, and what did we get in the end? We got data governance. You went through cloud transformation, and what did you get? You got cloud governance. (…) What’s happening with AI is something similar.’
youtube.com/watch?v=WuSg6dE_…
🚨 Product launch 🚨
We’re excited to announce version 2.0 of our global AI Tracker – a free, interactive knowledge hub for tracking AI Governance developments worldwide.
🔗 Explore now: holisticai.com/news/introduc…
💫 Missed our recent webinar?
You can now catch the full recording, explore FAQs, and access the original slides of our webinar "Bias Detection in Large Language Models—Techniques and Best Practices" on our website!
holisticai.com/events/bias-d…
🚀Holistic AI Named a Cool Vendor for AI Security by Gartner®
In the Cool Vendors for AI Security report, Gartner points out that there are frameworks and guidelines available which provide functional areas for mitigating AI and security risks.
holisticai.com/cool-vendor-a…
🌟Are you ready to push the boundaries of AI and machine learning? Join us for the Holistic AI x UCL AI Society Hackathon, where creativity meets innovation.
🏆Prizes:
1st Place: £3,000 per team
2nd Place: £1,500 per team
3rd Place: £750 per team
hackathon.holisticai.com/
🚨 Last change to register to our webinar 'Bias Detection in Large Language Models'
📅 Date: Wednesday, October 30th
⏰ Time: 10am PDT/1pm EDT/ 5pm BST
LLMs are transforming AI—but hidden biases can lead to unfair outcomes. Learn how to detect them.
holisticai.com/events/bias-d…
💫 In a few days, Adriano Koshiyama will be attending Money20/20 USA, the top event for the global money ecosystem.
Excited for discussions on how AI can transform financial services and drive innovation!
Learn more: us.money2020.com/
➡ Adriano Koshiyama, Co-Founder and Co-CEO of Holistic AI, is attending the Annual Westminster Diwali Reception today in London, hosted by India Global Forum.
Excited for discussions on the future of the UK-India partnership! 🇬🇧🇮🇳
💫 Excited to announce the launch of Holistic AI's Open-Source Library for Responsible AI
📊 35+ bias metrics & 30 mitigation strategies
🔍 Advanced explainability tools
🛡️ Robustness & security enhancements
✅ Real-world testing for fairness
holisticai.com/news/holistic…











