Friea Berg (@friea) profile picture

Strategic Initiatives, Snorkel AI

San Francisco, CA
Joined September 2008
Photo by Friea Berg (@friea)Photo by Friea Berg (@friea)Photo by Friea Berg (@friea)Photo by Friea Berg (@friea)Photo by Friea Berg (@friea)Photo by Friea Berg (@friea)Photo by Friea Berg (@friea)
Opus 5 debuts at #2 on Senior SWE-bench, just behind the leader Fable 5. Opus 5 improves on performance-per-compute, achieving its score at 32% of the output tokens of Fable 5 on average. It also excels on senior-level bug investigations, taking the #1 spot across all models.
3
14
3
77
19,830
We obtained early access to evaluate @spacexai's newest Grok 4.5 model on GDPval+: real professional deliverables (from a variety of economic sectors and occupations), graded against expert-authored rubrics. Grok 4.5: 29%. GPT 5.5: 22%. Claude Opus 4.8: 21%.
27
55
19
449
1,034,347
We expect agents to act like senior engineers, but most benchmarks still evaluate them like interns. Excited to introduce Senior SWE-Bench, an open-source and @harborframework-native benchmark that assesses agents as senior engineers on long-horizon tasks with realistically under-specified instructions. We expect agents to build real features going on just a quick Slack message, nothing like the super technical instructions most benchmarks provide. Senior SWE-Bench fixes that. Claude Opus 4.8 is the current leader at 24% high quality solves, but it took 117K tokens on average to get there. Claude Sonnet 5 looked like it was going to swoop in for the top spot, but we found it cheated on 26% of trials.
19
61
28
249
87,276
Friea Berg retweeted
Thanks @SnorkelAI for the great tasks and especially @fredsala, Tom Walshe, and Jeong Shin for the collaboration Terminal-Bench 2.0 on the horizon 👀 + some other exciting releases!
We're excited to announce Snorkel's role as one of the top contributors to Terminal-Bench 2.0! Terminal-Bench has quickly become the gold standard for evaluating AI agent capabilities in terminal environments—and we're helping build the next generation. 🔗 snorkel.ai/blog/evaluating-c…
2
12
797
-2016 (classic era): focus on data efficiency 2017-2025 (pretraining era): focus on compute efficiency 2026-: focus on data efficiency (again) The standard Transformer paradigm is optimized for compute efficiency. As we look at data efficiency, we'll see very different design decisions, which will be exciting!
Since compute grows faster than the web, we think the future of pre-training lies in the algorithms that will best leverage ♾ compute We find simple recipes that improve the asymptote of compute scaling laws to be 5x data efficient, offering better perf w/ sufficient compute
14
67
11
611
104,270
Friea Berg retweeted
1/ Super excited to deepen our partnership with @Azure! Most real-world use cases end up being blocked on the data. Solve data-centric development with @SnorkelAI , then connect seamlessly to Azure AI for model development and serving: snorkel.ai/snorkel-ai-partne…
2
4
20
MyPOV - You know the #AI / #ML transformation has hit the mainstream when... a European / German (fair - high tech) company - presents in the US... #SplunkConf
1
2
"Travel is the cure to ignorance." Brilliant quote from @CarnivalCruise CEO at @Splunkconf #keynote. – at Florida, USA
1
1
We’re not regular threat hunters, we’re accelerated threat hunters with the help of our partner @Cisco . Check out how: splk.it/2LRv3KU
2
2
Cisco Firepower NGFW and Splunk Integration Demo - https://teapawt.org/t.co/qiCxGAoeka #techvideos
1
1
Have you seen the lineup for the first Talos Threat Research Summit? ciscolive.com/us/learn/progr… Join Matthew Valites (matthewvalites) of Splunk for a "SOC How-To". If you feel confused about how to proceed with building a SOC, this talk is for you.
Demo: Cisco ACI and Splunk – Audit Compliancy and Risk Analysis ing-titi.com/demo-cisco-aci-…
1
1
Splunk turns machine data into answers. Discover how Cisco and Splunk work together for malware analysis. Hear experts from Splunk and Cisco. Ask questions. Get answers. Register now: cs.co/6017Djonz
Get the resources you need to quickly build your own @Splunk apps and add-ons: https://teapawt.org/t.co/5cbUt2tUQR New virtual environments to start integrating with Splunk. #DevNet #MachineData
Now this is a Top #Sales Girl @Girlscouts @Splunk #Bigdata helped her sales both on-line and in person to to revenue generator. A lot to learn from this case study. Plus it will make you grin from ear to ear reading it! lnkd.in/daV8ajb
2
3
#GSNorCal Girl Scout CJ used this #tech tool to identify trends in her cookie business and inform her selling strategies to help her meet her goals. Now that's taking the #leadlikeaGirlScout! #entrepreneur @girlscouts teapawt.org/splunk/status/96858402…
What does it take to claim the title of @GSNorCal's top cookie seller? A lot of hard work, and some help from a secret weapon named Splunk. splk.it/2HRK8uE #Splunk4Good
1
5
Friea Berg retweeted
An amazing story of a young entrepreneur and her adventure to do an amazing thing.... With Girl Scout Cookies! lnkd.in/deMknKP
1
1
“To all the Cisco Resellers out there: Partnering with @splunk is the next evolution of growing your business.” @wackyjackie007, Business Development Manager, @Cisco
3
4
Friea Berg retweeted
We're excited to announce our long-standing partnership with @Cisco is expanding to include Cisco Network Assurance Engine. splk.it/2FDXusn
2
2