Modus

We developed the benchmark with 1,100+ hours of auditor input, and evaluated 11 frontier models across: 90 tasks: workpaper completion and review 6 synthetic audit engagements: avg. of 179 files each 2 industries: manufacturing and staffing services

AI agents are being adopted into financial audit workflows, but how reliably can they complete the work? In FinancialAuditBench, we evaluate agents on realistic audit tasks, and reveal where professional review remains necessary. 🔗 Paper: arxiv.org/abs/2609.32835 Thread 👇

1/ Frontier models keep getting better. We wanted to know what that actually means for real audit work, so we built Financial Audit Bench (FAB). 90 audit tasks. 11 frontier models. Graded against rubrics written by licensed CPAs. Here's what we found: