Friea Berg retweeted
We obtained early access to evaluate @spacexai's newest Grok 4.5 model on GDPval+: real professional deliverables (from a variety of economic sectors and occupations), graded against expert-authored rubrics. Grok 4.5: 29%. GPT 5.5: 22%. Claude Opus 4.8: 21%.
Friea Berg retweeted
We expect agents to act like senior engineers, but most benchmarks still evaluate them like interns.
Excited to introduce Senior SWE-Bench, an open-source and @harborframework-native benchmark that assesses agents as senior engineers on long-horizon tasks with realistically under-specified instructions.
We expect agents to build real features going on just a quick Slack message, nothing like the super technical instructions most benchmarks provide. Senior SWE-Bench fixes that.
Claude Opus 4.8 is the current leader at 24% high quality solves, but it took 117K tokens on average to get there. Claude Sonnet 5 looked like it was going to swoop in for the top spot, but we found it cheated on 26% of trials.
Friea Berg retweeted
Thanks @SnorkelAI for the great tasks and especially @fredsala, Tom Walshe, and Jeong Shin for the collaboration
Terminal-Bench 2.0 on the horizon 👀 + some other exciting releases!
We're excited to announce Snorkel's role as one of the top contributors to Terminal-Bench 2.0!
Terminal-Bench has quickly become the gold standard for evaluating AI agent capabilities in terminal environments—and we're helping build the next generation.
🔗 snorkel.ai/blog/evaluating-c…
Friea Berg retweeted
-2016 (classic era): focus on data efficiency
2017-2025 (pretraining era): focus on compute efficiency
2026-: focus on data efficiency (again)
The standard Transformer paradigm is optimized for compute efficiency. As we look at data efficiency, we'll see very different design decisions, which will be exciting!
Friea Berg retweeted
1/ Super excited to deepen our partnership with @Azure! Most real-world use cases end up being blocked on the data. Solve data-centric development with @SnorkelAI , then connect seamlessly to Azure AI for model development and serving: snorkel.ai/snorkel-ai-partne…
Friea Berg retweeted
MyPOV - You know the #AI / #ML transformation has hit the mainstream when... a European / German (fair - high tech) company - presents in the US... #SplunkConf
Friea Berg retweeted
"Travel is the cure to ignorance."
Brilliant quote from @CarnivalCruise CEO at @Splunkconf #keynote. – at Florida, USA
Friea Berg retweeted
We’re not regular threat hunters, we’re accelerated threat hunters with the help of our partner @Cisco . Check out how: splk.it/2LRv3KU
Friea Berg retweeted
Cisco Firepower NGFW and Splunk Integration Demo - https://teapawt.org/t.co/qiCxGAoeka #techvideos
Friea Berg retweeted
Have you seen the lineup for the first Talos Threat Research Summit?
ciscolive.com/us/learn/progr…
Join Matthew Valites (matthewvalites) of Splunk for a "SOC How-To". If you feel confused about how to proceed with building a SOC, this talk is for you.
Friea Berg retweeted
Demo: Cisco ACI and Splunk – Audit Compliancy and Risk Analysis ing-titi.com/demo-cisco-aci-…
Friea Berg retweeted
Splunk turns machine data into answers. Discover how Cisco and Splunk work together for malware analysis. Hear experts from Splunk and Cisco. Ask questions. Get answers. Register now: cs.co/6017Djonz
Friea Berg retweeted
Get the resources you need to quickly build your own @Splunk apps and add-ons: https://teapawt.org/t.co/5cbUt2tUQR
New virtual environments to start integrating with Splunk.
#DevNet #MachineData
Friea Berg retweeted
Now this is a Top #Sales Girl @Girlscouts @Splunk #Bigdata helped her sales both on-line and in person to to revenue generator. A lot to learn from this case study. Plus it will make you grin from ear to ear reading it! lnkd.in/daV8ajb
Friea Berg retweeted
#GSNorCal Girl Scout CJ used this #tech tool to identify trends in her cookie business and inform her selling strategies to help her meet her goals. Now that's taking the #leadlikeaGirlScout! #entrepreneur @girlscouts teapawt.org/splunk/status/96858402…
What does it take to claim the title of @GSNorCal's top cookie seller? A lot of hard work, and some help from a secret weapon named Splunk. splk.it/2HRK8uE #Splunk4Good
Friea Berg retweeted
An amazing story of a young entrepreneur and her adventure to do an amazing thing.... With Girl Scout Cookies! lnkd.in/deMknKP
Friea Berg retweeted
“To all the Cisco Resellers out there: Partnering with @splunk is the next evolution of growing your business.” @wackyjackie007, Business Development Manager, @Cisco
Friea Berg retweeted
We're excited to announce our long-standing partnership with @Cisco is expanding to include Cisco Network Assurance Engine. splk.it/2FDXusn



































