
research scientist @googledeepmind; prev phd from UIUC @siebelschool
london
Joined March 2019
- Tweets101
- Following1.1K
- Followers1.4K
- Likes2K
Argon is as robust as it is capable! 🔒
Lots of discussion out there about our next model(!), so I wanted to give an early look as soon as possible. Introducing Gemini 4 Argon!
It shows frontier performance in complex workflows, cyber defense and software engineering. Teams are using it extensively at Google, from coding to quantum computing, great feedback.
Here’s a look at the benchmarks:
3
74
3,497
Chulin Xie retweeted
Announcing the ICLR 2027 Call for Workshops!
ICLR 2027 will feature two days of workshops in San Francisco, California, US.
Submit proposals to organize a workshop! 🧵
iclr.cc/Conferences/2027/Cal…
Chulin Xie retweeted
Heading to @icmlconf? Isomorphic Labs’ hiring managers will be in Seoul from July 6–11 meeting with ML Engineers, ML Research Engineers and ML Research Scientists.
If you're ready to build frontier AI to tackle some of the biggest challenges in science, check the comments to meet our team.
Chulin Xie retweeted
We are looking for PhDs and Postdocs!
So proud of my students on achieving so many amazing things during their "very first year".
I have been asked many times how I like being faculty, especially with funding cuts. My answer is always "it is the prefect job for me"! Still deep in the honeymoon phase.
The only reason is the students are so amazing, making my transition so much easier. One year in, they already collected paper awards, orals, spotlights, etc
What makes me proudest is they are vividly alive: curious, playful, confident in their own weird way, light up when talking about ideas, and never afraid to explore "the thing might fail".
Everyone is just… themselves. And somehow, that version of themselves keeps shipping amazing work.
In today's anxious academic world, this kind of aliveness is what I will try best to protect.
Maybe the best part of being an advisor is that every student is so different and unique lol
Interestingly, coming to second year, they've got their own passions, I can't just plug my ideas into their heads. So when I get excited about sth new, my first thought is: "Okay, time to find some fresh first-years who will be thrilled about this!"
MLL lab is 1 year old, we started right in Oct 2024. We are growing and looking for more phds to join us!
1. Why our lab? (1/2)
2. Why @northwesterncs? (2/2)
In 2025 alone: NU has 7 faculty as Sloan Fellows, plus a Nobel winner! Check more below
Chulin Xie retweeted
This is Gemini 3: our most intelligent model that helps you learn, build and plan anything.
It comes with state-of-the-art reasoning capabilities, world-leading multimodal understanding, and enables new agentic coding experiences. 🧵
Chulin Xie retweeted
Check out our latest work on blue-teaming code agent!
Led by @ChengquanGuo
@NieYuzhou @ChulinXie @WenboGuo4 @uiuc_aisecure
BlueCodeAgent is an end-to-end blue-teaming framework built to boost code security using automated red-teaming processes, data, and safety rules to guide LLMs’ defensive decisions. Dynamic testing reduces false positives in vulnerability detection: msft.it/6014tMvnr
Chulin Xie retweeted
Check out our latest work on red-teaming code agent!
Led by @ChengquanGuo
@ChulinXie @YuYang_i @ZRChen_AISafety @alxndrdavies @yaringal @dawnsongtweets @uiuc_aisecure
Code agents help streamline software development workflows, but may also introduce critical security risks. Learn how RedCodeAgent automates and improves “red-teaming” attack simulations to help uncover real-world threats that other methods overlook: msft.it/6013shouB
Chulin Xie retweeted
After six wonderful years at UIUC @siebelschool, I’m thrilled to announce that I will join the University of Toronto ECE @eceuoft as an assistant professor in July 2026. I’m actively looking for PhD students in fall 2026. Drop me an email if you are interested in working with me.
Chulin Xie retweeted
Introducing MCPMark, a collaboration with @EvalSysOrg and @lobehub!
We created a challenging benchmark to stress-test MCP use in comprehensive contexts.
- 127 high-quality data samples created by experts.
- GPT-5 takes the current lead and achieves a Pass@1 of 46.96% while the other models fall in the range of 10-30%.
- Diverse test cases on Notion, Github, Filesystem, Playwright (browser), and Postgres.
9🧵s ahead
Chulin Xie retweeted
🚨 Incredibly excited to share that I'm starting my research group focusing on AI safety and alignment at the ELLIS Institute Tübingen and Max Planck Institute for Intelligent Systems in September 2025! 🚨
Hiring. I'm looking for multiple PhD students: both those able to start in Fall 2025 (i.e., as soon as possible) and through centralized programs like CLS, IMPRS, and ELLIS (the deadlines are in November) to start in Spring–Fall 2026. I'm also searching for postdocs, master's thesis students, and research interns. Fill the Google form below if you're interested!
Research group. We will focus on developing algorithmic solutions to reduce harms from advanced general-purpose AI models. We're particularly interested in alignment of autonomous LLM agents, which are becoming increasingly capable and pose a variety of emerging risks. We're also interested in rigorous AI evaluations and informing the public about the risks and capabilities of frontier AI models. Additionally, we aim to advance our understanding of how AI models generalize, which is crucial for ensuring their steerability and reducing associated risks. For more information about research topics relevant to our group, please check the following documents:
- International AI Safety Report,
- An Approach to Technical AGI Safety and Security by DeepMind,
- Open Philanthropy’s 2025 RFP for Technical AI Safety Research.
Research style. We are not necessarily interested in getting X papers accepted at NeurIPS/ICML/ICLR. We are interested in making an impact: this can be papers (and NeurIPS/ICML/ICLR are great venues), but also open-source repositories, benchmarks, blog posts, even social media posts—literally anything that can be genuinely useful for other researchers and the general public.
Broader vision. Current machine learning methods are fundamentally different from what they used to be pre-2022. The Bitter Lesson summarized and predicted this shift very well back in 2019: "general methods that leverage computation are ultimately the most effective". Taking this into account, we are only interested in studying methods that are general and scale with intelligence and compute. Everything that helps to advance their safety and alignment with societal values is relevant to us. We believe getting this—some may call it "AGI"—right is one of the most important challenges of our time.
Join us on this journey!
Chulin Xie retweeted
Europe can lead AI research, and our plan with OpenEuroLLM is to build something amazing - not for profit, and while sharing insights at scale.
We have openings for **ML Research Engineers and Scientists** to work on OpenEuroLLM at the ELLIS Institute Tübingen.
ellis-openeurollm-apply.tue.…
Join our mission to strengthen AI research in Europe 🇪🇺
We are looking for several ML Research Engineers and Scientists to work on OpenEuroLLM at the ELLIS Institute Tübingen. If you're passionate about large-scale model training, multilingual evaluation and want to contribute to cutting-edge open-source AI, we'd love to hear from you!
📍Based in Tübingen - a vibrant hub for machine learning research with a strong collaborative ecosystem
📚 Focus: LLMs, distributed training, evaluation, AutoML
🇪🇺 Part of OpenEuroLLM - a consortium of 20 leading European research institutions, companies and EuroHPC centres to build the next-generation of open-source language models awarded many millions GPU hours on most-recent Euro HPC clusters.
What we offer:
🔒 The unique chance to develop the next generation of fully open European LLMs
🤗 A chance to be in the heart of the Cyber Valley and work at the ELLIS Institute with world known scientists headed by Bernhard Schölkopf
️☕ The best coffee you can think of
See more in the job post description Job Post: Building Open Source LLM for Europe: institute-tue.ellis.eu/en/jo…
Apply here: ellis-openeurollm-apply.tue.…
#AIJob#LLM #OpenSourceAI #ResearchEngineering #OpenEUROLLM #Hiring #MachineLearning #ArtificialIntelligence
Chulin Xie retweeted
I've struggled to announce this amidst so much dark & awful going on in the world, but with 1mo to go, I wanted to share that: (i) I finally graduated; (ii) In August, I'll begin as an assistant professor in the CS dept. of the National University of Singapore.
Chulin Xie retweeted
We build 𝗠𝗲𝗱𝗛𝗘𝗟𝗠✨: a comprehensive benchmark evaluating AI on realistic clinical tasks that healthcare professionals perform daily instead of just medical exams.👩⚕️⚕️
• Stanford HAI Blog: hai.stanford.edu/news/holist…
• Leaderboard: crfm.stanford.edu/helm/medhe…
1/🧵How do we know if AI is actually ready for healthcare? We built a benchmark, MedHELM, that tests LMs on real clinical tasks instead of just medical exams. #AIinHealthcare
Blog, GitHub, and link to leaderboard in thread!
Chulin Xie retweeted
Demystifying Long CoT Reasoning in LLMs
arxiv.org/pdf/2502.03373
Reasoning models like R1 / O1 / O3 have gained massive attention, but their training dynamics remain a mystery. We're taking a first deep dive into understanding long CoT reasoning in LLMs!
11 Major Takeaways👇(long threads)
Super excited about our ICLR workshop on synthetic data: "Will Synthetic Data Finally Solve the Data Access Problem?"
Submit your work by Feb 5 AoE and join us in Singapore 🎉: synthetic-data-iclr.github.i…
#ICLR2025 #SyntheticData
Chulin Xie retweeted
🚀 Image AR models (𝗩𝗔𝗥 & 𝗟𝗹𝗮𝗺𝗮𝗚𝗲𝗻) can be distilled to 𝗢𝗡𝗘 step (up to 𝟮𝟭𝟴𝘅 𝗳𝗮𝘀𝘁𝗲𝗿) for the first time!
See 𝑫𝒊𝒔𝒕𝒊𝒍𝒍𝒆𝒅 𝑫𝒆𝒄𝒐𝒅𝒊𝒏𝒈 ↓
𝗪𝗲𝗯𝘀𝗶𝘁𝗲: imagination-research.github.…
𝗣𝗮𝗽𝗲𝗿: arxiv.org/abs/2412.17153
huggingface.co/papers/2412.1…
(1/n)
💻 Are Code Agents Safe? #NeurIPS2024
In RedCode, we evaluate the risks of code execution and generation in 19 code agents within real system environments.
🗓️ Thu 12 Dec | 4:30 PM – 7:30 PM PST
📍: West Ballroom A-D #5300
🔗: redcode-agent.github.io
Stop by the RedCode poster (co-led with @ChengquanGuo and @xun_aq who are applying for PhD this year!) to chat with our coauthors about agents and AI safety!! 🚀
Code agents are great, but not risk-free in code execution and generation!
🎯 We propose RedCode, an evaluation platform to comprehensively evaluate code agents in terms of risky code execution and generation.
📅 Catch our #NeurIPS2024 poster session tomorrow (12/12) afternoon from 4:30pm to 7:00pm at West Ballroom, Poster #5300!
🧵
Chulin Xie retweeted
🎉 Deeply honored that our paper "Decoding Trust: Comprehensive Assessment of Trustworthiness in GPT Models” which was awarded Outstanding Paper at NeurIPS 2023, has just been awarded Best Scientific Cybersecurity Paper of 2024, in collaboration with @uiuc_aisecure @sanmikoyejo @wbx_life and other researchers @UofIllinois @Stanford @MSFTResearch @cais! Excited to help advance trustworthy AI!
Special thanks to @NSAGov for this recognition! #AI #Cybersecurity
nsa.gov/Press-Room/News-High…
Learn more: decodingTrust.github.io, towards building trustworthy AI!
Chulin Xie retweeted
(1/4) Excited to share RaVL, which is appearing this week at #NeurIPS2024! RaVL discovers and mitigates spurious correlations in fine-tuned vision-language models (VLMs).
📄 Paper: arxiv.org/abs/2411.04097
💻 GitHub: github.com/Stanford-AIMI/RaV…


































