Gideon (@gideon_eb) header
Gideon (@gideon_eb) profile picture
Joined March 2015
Photo by Gideon (@gideon_eb)Photo by Gideon (@gideon_eb)Photo by Gideon (@gideon_eb)Photo by Gideon (@gideon_eb)Photo by Gideon (@gideon_eb)Photo by Gideon (@gideon_eb)Photo by Gideon (@gideon_eb)Photo by Gideon (@gideon_eb)Photo by Gideon (@gideon_eb)Photo by Gideon (@gideon_eb)
Had lots of questions about how we created the video for Bankarena.ai. I spun up a quick tool to help me edit it, it took about 40 minutes of back and forth to get it exactly where I wanted.
4
1
23
966
Had to get this out, some assets we created for Bankarena.ai
1
9
94
5,436
Gideon retweeted
Less than a third of tasks completed by the best models. AI agents still have quite a way to go.
We're launching Bank Arena: 52 long-running banking tasks across several banking apps. We gave frontier computer-use agents a bank to run, from recovering transfers to settling merchant payouts. The median task takes experts ~75 minutes to complete, and the highest-scoring models completed <31% of tasks. Here's what we found ↓
1
1
29
🔥🔥🔥
We're launching Bank Arena: 52 long-running banking tasks across several banking apps. We gave frontier computer-use agents a bank to run, from recovering transfers to settling merchant payouts. The median task takes experts ~75 minutes to complete, and the highest-scoring models completed <31% of tasks. Here's what we found ↓
1
2
3
1,105
Gideon retweeted
Nice 🔥🔥
We're launching Bank Arena: 52 long-running banking tasks across several banking apps. We gave frontier computer-use agents a bank to run, from recovering transfers to settling merchant payouts. The median task takes experts ~75 minutes to complete, and the highest-scoring models completed <31% of tasks. Here's what we found ↓
1
3
165
This was awesome to help work on. It’s obvious to us that making agentic financial operations more reliable is huge. Feel free to reach out, would love feedback on the benchmark!
We're launching Bank Arena: 52 long-running banking tasks across several banking apps. We gave frontier computer-use agents a bank to run, from recovering transfers to settling merchant payouts. The median task takes experts ~75 minutes to complete, and the highest-scoring models completed <31% of tasks. Here's what we found ↓
1
3
11
760
Leaderboard, task breakdowns, and recorded trajectories are live at bankarena.ai/. If you're training computer-use agents or building finance models, we'd love you to evaluate on Bank Arena - dm or [email protected]!
5
21
890
On the tasks all five models ran, full completion was: Gemini 4 Argon: 30.1% Claude Opus 5.5: 23.8% GPT-6 Astra: 15.0% GPT-6.1 Sol: 11.6% Grok 4.7: 5.4%
1
3
2
10
1,026
In 33 of 52 tasks, new information arrives after they've acted, forcing them to revisit earlier decisions. In one task: a customer's €85k transfer shows as canceled, so they send another. Then the first settles, the duplicate comes back, and a fraud signal means the first needs to be recalled. Some easy ways agents get this wrong: credit twice, recall the wrong transfer, or close the case early.
2
3
8
811
We built a banking environment, simulating real-world banking applications with exact UI and workflow fidelity: a real ledger, policy and evidence vault, work tracker, ticketing tool, and ops desk. Agents get screenshots and URLs, then click and type across payments, policies, work tracking, and customer tickets.
1
3
9
1,060
We're launching Bank Arena: 52 long-running banking tasks across several banking apps. We gave frontier computer-use agents a bank to run, from recovering transfers to settling merchant payouts. The median task takes experts ~75 minutes to complete, and the highest-scoring models completed <31% of tasks. Here's what we found ↓
19
56
5
189
8,006
Gideon retweeted
super stoked to announce that HumanLayer is joining forces with factory incredibly grateful to all our customers, investors, friends and family who cheered us on this crazy journey in the past 3 years read our in-depth take, why we're so excited, what happens to customers and humanlayer OSS, and more 👇
142
29
5
676
40,983
We built what you wished Figma could be. There's not a single design tool that does all of this. Launching the new @Dessn_ai 🌸👇
65
46
27
492
78,964
Finally, you can get real healthcare directly from your Claude, ChatGPT, GrokBot, Muse, or Instinct. Just tell them to use FutureClinic. Agents welcome. Healthcare will never be the same again. Backed by @ycombinator
48
81
31
536
93,245
Congrats @raphaelschaad - both a clear and prescient thinker, and helped us a bunch. Excited for the future.
We’re excited to welcome @vivianmshen and @raphaelschaad as YC’s newest General Partners! Vivian and Raphael first came to YC as founders. Vivian co-founded Juni Learning (W18), which teaches kids coding and math, and later founded Acely, an AI tutor for college prep. Raphael founded Cron (W20), the calendar app that became Notion Calendar. They built products used by millions of people, then returned to YC as Visiting Partners to help other founders. Now they're doing it full-time. ycombinator.com/blog/welcome…
2
6
985
Gideon retweeted
Today, we're finally launching FrameOS!!! Let's start with the why. Recording your iPhone leaves that red dot indicator in your entire video and this has been a massive problem for me. To add, I'm good on camera, so adding a camera feed + microphone involves juggling multiple editors....just to create a simple screen recording while I talk. Onto the what: FrameOS FrameOS is a simple tool for recording your screen. Connect your device, add a camera feed, and click record. It has all the editing features your used to: crop, resize, trim, and there's a lot more to come! What you can do with FrameOS? You can share feedback of your app with your product team, report a bug, or create a polished product demos of your investors - all without the red dot indicator. Link in the comment below ⬇️
15
6
4
70
9,214
We're hiring a Founding GTM Lead @RulebaseHQ in New York. Come join our extremely focused team. Our AI agents run customer operations for some of the fastest-growing financial services companies and public companies.
6
4
27
1,976