Chi Nguyen (@NguyenSquared) profile picture

Redwood Research (@redwood_ai) check out https://teapawt.org/t.co/Fd3TkFXWs5

Joined April 2020
Photo by Chi Nguyen (@NguyenSquared)Photo by Chi Nguyen (@NguyenSquared)Photo by Chi Nguyen (@NguyenSquared)Photo by Chi Nguyen (@NguyenSquared)Photo by Chi Nguyen (@NguyenSquared)Photo by Chi Nguyen (@NguyenSquared)Photo by Chi Nguyen (@NguyenSquared)Photo by Chi Nguyen (@NguyenSquared)
Chi Nguyen retweeted
METR & Redwood Research investigated agent behavior in the Hugging Face incident. We found agents developed a universal cheat for ExploitGym within 4 hours, then coordinated multi-day R&D efforts to trick the scorer into accepting cheats, including trying to tamper with logs.
175
1,072
596
6,023
4,417,662
How do LLMs reason about playing games against copies of themselves? 🪞We made the first LLM decision theory benchmark to find out. 🧵1/10
2
18
2
102
11,153
Chi Nguyen retweeted
How close are current AI agents to automating AI R&D? Our new ML research engineering benchmark (RE-Bench) addresses this question by directly comparing frontier models such as Claude 3.5 Sonnet and o1-preview with 50+ human experts on 7 challenging research engineering tasks.
14
169
83
827
446,333