Agents & Gemini API, MTS @GoogleDeepMind | prev: Tech Lead at @huggingface, AWS ML Hero 🤗 Sharing my own views and AI News 🧑🏻💻 https://xitter.cf/t.co/7IosdlO6RA
Nürnberg
Joined June 2019
- Tweets6.5K
- Following1.2K
- Followers125K
- Likes8.3K
Pinned Tweet
The Interactions API is now generally available. 🎉 The Interactions API is the simplest way to build with Gemini for humans and agents.
- One API for Gemini models and agents.
- Antigravity Agent with a isolated remote Linux sandbox.
- Image gen with Nano Banana; music with Lyria 3, soon video with Omni.
- `background=True` for async, long-running interactions.
- Multimodal Tool Use & Combination.
- Dedicated skills for coding agent.
Building something new inside Google isn't easy, but it's possible. We spent almost a year on this because we think developers and agents deserve an API that is intuitive, familiar and easy to learn and use and evolves with improving capabilities and new behaviors.
Give it a try. Feature requests, bugs, complaints all to me. 👇🏻
Hey, no AI posts today. Tough day to be an engineer.
If you are using Railway, LiteLLM, PHP, GitLab, Node (brotli) please check your setup.
Below some helpful links and a prompt for your agent. Check even if you think you aren't impacted.
Don't give up. We're in this together. Help each other out.
Advisories & checkers:
- Live CVE feed: github.com/advisories?query=…
- PHP2Shell checker & fix: php2shell.com/
- Node.js security releases: nodejs.org/en/blog/vulnerabi… (Brotli guide: patchtheplanet.org/brotli)
- LiteLLM 1.107.0 advisory: docs.litellm.ai/blog/securit…
- Railway disclosure: blog.railway.com/p/security-…
- GitLab 19.5.1 patch: docs.gitlab.com/releases/pat…
```
Run a read-only check on this repo, its containers, and my local environment for the Oct 21-22, 2026 security disclosures (ask before editing files):
1. Supply-chain & secrets (scanners miss these):
- LiteLLM 1.107.0: check all Python lockfiles, Docker tags (`latest`/`1.107.0`), and local `site-packages` + `/tmp` for `cook.pth`, `cook.py`, `litellm_init.pth`, `/tmp/.pc_once_*`, or `/tmp/remote_code_loader.lock`.
- Railway: check for `railway.*` configs or `RAILWAY_*` CI vars and list every secret/API key/DB URL referenced so I can rotate them at the source provider.
2. Runtimes & infra: check local versions, base images, and IaC for PHP (<8.5.12 / 8.4.27 / 8.3.36 / 8.2.35), Node/Bun Brotli decoding, self-hosted GitLab (<19.5.1, CVE-2026-110264), and eMudhra CA stores (`uv <0.11.7`, `certifi <2026.10.20`).
3. Direct & transitive deps: run available scanners (`osv-scanner`, `uvx pip-audit`, `npm/pnpm/bun audit`, `govulncheck ./...`) and check lockfiles against github.com/advisories
Return a compact table: Status (`ROTATE KEYS` / `PATCH` / `SAFE`) | Component | Location | Exact Fix Command.
```
The easiest way to try Gemini 4 Argon in an agentic environment is Gemini Managed Agents. A single API call gets you
- Python, Node.js, Git, and Bash.
- Full network access and control.
- Dedicate Credentials API.
- Filesystem to persist work.
- Background Support.
aistudio.google.com/docs/ant…
Can Agents improve their own harness on unseen tasks? The @GoogleResearch team released Harness², a framework that allows improve an harness around a frozen model.
How it works:
1️⃣ Agent runs the base harness on each task to record a baseline trajectory
2️⃣ Editor agent inspects the trajectory, drafts 2 candidate edits (SI, Skills, hooks,….), and runs both.
3️⃣ Composer agent diffs the new trajectory against the baseline, merges edits that fixed failures (within a cap), and runs the final harness.
4️⃣ Reflector agent logs verified lessons into file and saves the winning components to a library for future tasks to pull on demand.
Results:
- 💡 Gemini 3.5 Flash +8.4 on WorkBuddy-Bench and +7.5 on JobBench.
- 🛠️ Skills and scripts drive ~50% of edits; dropping skills costs 5.3 pts.
- 📚 Gemini 3.5 Flash improves on all 3 benchmarks when editing its own harness.
Paper: arxiv.org/abs/2610.14224
Code: github.com/google-research/h…
what's your early feedback on Gemini 4 Argon? where should we improve? we take your input seriously.
The new Gemma docs! gemma.ai/ 🥁🥁🥁
From capabilities, to fine-tuning guides, inference optimizations and educational content on how the models work.
All at central place!
Gave Gemini 4 Argon a photo of the Manhattan skyline asked it to recreate it as oil painting.
It wrote a multi-pass canvas renderer that starts with broad background strokes, blocks in the buildings and river, and finishes with fine specular highlights on the water.
Gemini 4 Argon is now live in the Gemini API and @GoogleAIStudio 🎉 What it has done at Google so far:
- A months-long Chrome refactor at ~4x the usual pace
- 35%+ more agentic code submissions
- Improved session creation in ADK by 40%
- 2.9x the throughput increases in SGLang for Gemma 4
With Gemini 4 you should spend most of your time writing a clear goal and a way to check the result. Through your hardest challenge and convince yourself: aistudio.google.com/learn/ge…
Also rolling out in @Antigravity (Google AI Ultra), and the @GeminiApp and AI Mode in Search (Google AI Pro and Ultra). Read more: blog.google/innovation-and-a…
Will be at @aiDotEngineer in NYC this week! 🔥
- Building a autonomous coworker | 10/14 2:55pm
- @GoogleDeepMind Booth | most of the time
Come by if you build agents, evals or have feedback about Gemini.
Add:
> can communicate technical concepts to none ai native engineers.
> pushes to keeps things simple and says no to features/behaviors
SynthID Detector (synthid.com) is now publicly available, supporting the Nano Banana 2.1, @OpenAI, @nvidia, Kakao, and soon @Apple. 🌐
Verify if an image, video, or audio file was generated:
1️⃣ Upload or paste your file at synthid.com
2️⃣ Scans for watermarks from Google or our partners (files are deleted right after)
