Heading to @unpromptedconf next week? Catch @VincentAbruzzo and @shanejcaldwell on stage Wednesday, October 28 for their talk on using #ScopeBench to measure how effective Jev is when used as a monitor to keep agentic harnesses in scope.
We're walking through ScopeBench task design on our livestream right now. Tune in to learn how to contribute: xitter.cf/i/broadcasts/1kJzDPXQj…
Join @shanejcaldwell and @0xdab0 live at 10 am PT/1 pm ET TODAY, right here on X (also LinkedIn and YouTube). Come hang and talk scope adherence following last week's drop of ScopeBench, a community benchmark for security agents.
Here's what they'll cover:
- ScopeBench observations/results
- Benchmark methodology
- How to design a task
It's essentially a more casual, collaborative version of their OAIC talk. Swing by and bring questions!
Shoutout to @Airbrushbros for creating these incredible boardwalk-inspired keepsakes at the Dreadnode OAIC Welcome Party! 🧑🎨🎨🏴☠️
In her latest piece for @axios, @samsabin923 reports on security agent scope adherence and efforts to keep them under control.
Timely topic following our release of #ScopeBench last week at @OffensiveAIcon, which is referenced in the article alongside @SpecterOps' research. Check it out! axios.com/2026/10/13/rogue-a…
New to DreadIndex: @SakanaAILabs Fugu Cyber
Ranking near the top of the leaderboard at #3, Fugu Cyber isn't a single traditional LLM endpoint, it's a trained orchestrator model that coordinates a pool of conventional frontier models as a multi-agent system behind one API. The orchestrator model is trained with a mix of fine-tuning, evolutionary algorithms, and RL.
Though Fugu-Cyber-v1.0 ranks high on our leaderboard, it is also one of the most costly model systems. Behaviorally, the model can take much longer for simple tasks, which makes sense given it is a multi-agent system.
Full results: dreadnode.io/research/dreadi…
🏴☠️ @shanejcaldwell and @0xdab0 took the stage yesterday at @OffensiveAIcon to officially launch ScopeBench.
At last year's con, one question kept coming up: if I pour domain expertise into a hard infosec benchmark, am I just handing free capability to the labs and my competitors?
Our answer: build the benchmark we'd all be glad to see saturated. Models that can reliably stay in scope will unlock tons of economically useful use cases that have been slow to grow despite saturated capability.
Check out the full research and learn how to contribute: dreadnode.io/research/scopeb…
[full recording and slides coming soon]
New to DreadGOAD: Console, an agentic web UI for deploying and managing active directory lab ranges.
Watch the tutorial to learn more: youtu.be/7OmCifoEWsU?si=-Qaf…
Listen in on @shanejcaldwell and @0xdab0's talk, “ScopeBench: Measuring Alignment Outside the Sandbox” at 11:05 AM, right here at @OffensiveAIcon.
Methodology paper just dropped this morning ⬇️⬇️⬇️
arxiv.org/abs/2609.30325











