Voice agents get built three ways: cascaded (STT, LLM, TTS), turn-based speech-to-speech, and full-duplex, where the model listens and talks at the same time.
All three now run on LiveKit Inference: GPT-Live and GPT Realtime from @OpenAI, @grok Voice Think Fast from @xai, and Gemini Live from @GoogleDeepMind. One LiveKit Cloud key, one bill.
Takashi Futada retweeted
I created this doc about how you can use our new decision api and voice to do really cool stuff:
developers.openai.com/api/do…
your agent can do stuff *while* you are talking!
Jev で向いてること、向いてないことのリサーチ結果です。30+のユースケース付き。
github.com/mizchi/jev-playgr…
Jev is free on @Vercel AI Gateway until September 25.
Try it today with the form router template, where Jev can route form submissions for you.
vercel.com/kb/guide/jev-ai-s…
Jev Founder, Diogo Almeida (ex-OpenAI):
"The next era is not the Claude Code era. Claude Code is still part of the assistance era - Jev is the next step
Jev is x200 faster, x400 cheaper and has 0 hallucination. This is what comes after RLHF"
In 17 minutes he explains why every model you use has a human-shaped flaw baked into it and why Jev is better
worth more than a $500 Claude Code engineering course
watch today, then read how to actually boost yourself x100 with Jev in the post below
How to use Jev, and where it actually gives you the 100x:
setup takes 10 minutes:
1. join the waitlist, people are getting approved same day
🔗 typesafe.ai
2. install the official skill so your agent writes correct calls:
- npx skills add typesafe-ai/skills --skill typesafe-ai
on Claude Code it's two commands, the marketplace add on its own doesn't install anything:
- claude plugin marketplace add typesafe-ai/skills
- claude plugin install typesafe@typesafe-ai
3. create an API key in the dashboard
4. in your prompt just say: "use the TypeSafe skill"
now the part nobody is posting:
the 100x isn't the model, it's where you put it
you don't get it by swapping your LLM for Jev
you get it by deleting the calls that never needed a language model
open your agent and find every call that just picks something:
> which tool next
> is this spam
> is this chunk relevant
> does this need a human
> is this diff risky
none of those are writing tasks
they're if statements you outsourced to a frontier model
here's the upgrade, in order:
1. replace each one with a typed question
Choice picks from up to 255 options, Score places it on a 2-10 level scale, Noul returns a raw 0-1
2. batch them
questions in one call run in parallel and barely move the latency, and output tokens are free
so ask every question you might need, including the ones you'll throw away
3. threshold on confidence, not on the answer
under 0.5 escalate to a big model or a human
0.85+ before anything irreversible
4. never let it invent options
build the candidate list in code, from the DOM, the retriever, the tool trace
then let it pick
5. put it in the loop, not next to it
router picks the cheap model, gate checks the tool call before it runs, judge verifies the output after
that's where the heaviest calls in your agent are hiding
6. start with compaction tonight
score every tool call, drop the dead ones, keep the survivors verbatim instead of a lossy summary
lowest effort win available and you'll see it on tomorrow's bill
the honest part:
text only right now, no images, no audio
and on broad benchmarks it loses to frontier models
but somebody ran 18,514 emails through it zero-shot and got 98.33%
against a TF-IDF classifier trained on 14,800 labelled examples that got 98.39%
no training data, $1.12 total
it wins on narrow, well specified decisions
which is most of what your agent is actually doing all day
today gonna share use case how i integrated it to content creation and how i find winning meta ads now in a seconds...
Takashi Futada retweeted
My CppCon keynote went really well!
Fun times talking about new memory hierarchies and the best ways we can programmatically prepare for them in advance.
Your whole voice stack, free for a year on LiveKit.
$10K in Cloud credits + a year of Scale + $7K in partner inference credits ($1K each: @googlegemma, @DeepgramAI, @inworld , @rimelabs , @FishAudio, @AssemblyAI, @GradiumAI.)
One workspace. No provider keys.
Apply now: livekit.com/startups
Takashi Futada retweeted
I’m seeing teams at Vercel iterate just as fast on Zig, Go, Rust projects as TypeScript & Python ones.
The days of language or runtime choice based on human convenience are over. Agents are the new compilers.
They compile intent into fast software.
GPT-Live from @OpenAI is here, and we're excited to be a launch partner.
GPT-Live brings more nuance to voice AI: tone, timing, emotion, and intent. Telnyx carries 16 kHz audio to the model without app-side resampling, so more of the voice gets through.
Read the guide on Outbound AI Calling with GPT-Live + Telnyx Voice API telnyx.com/resources/outboun…
#VoiceAI #OpenAI #GPTLive
GPT-Live-1 @openaidevs is now supported in LiveKit Agents. It's full-duplex, so it listens and speaks at the same time instead of taking turns, and it hands reasoning and tool calls off to a backend model so a slow lookup doesn't leave your agent sitting in dead air.
Same `AgentSession` API. New plugin: `GPTLiveModel`.
Get started: docs.livekit.io/agents/model…
Takashi Futada retweeted
WARP is coming to LiveKit soon!
Replying to @OpenAI
Audio moves through a dedicated fast path, while deeper reasoning and tool use happen asynchronously.
We also reduced voice-session startup from six network round trips to one.
Introducing GPT-Realtime-2 in the API: our most intelligent voice model yet, bringing GPT-5-class reasoning to voice agents.
Voice agents are now real-time collaborators that can listen, reason, and solve complex problems as conversations unfold.
Now available in the API alongside streaming models GPT-Realtime-Translate and GPT-Realtime-Whisper — a new set of audio capabilities for the next generation of voice interfaces.
Takashi Futada retweeted
🐹 Go: Userspace TCP over UDP
Great post about the experiment:
• fully customizable congestion control & retransmits
• works across NAT/firewalls (UDP-friendly paths)
• easier observability, testing, and iteration.
pilotprotocol.network/blog/u…
#go #golang
Takashi Futada retweeted
🎉 BIG ANNOUNCEMENT
I am hosting a 2.5-hour workshop to build a "RustAI Chat" from scratch.
🗓️May 29, 3 pm CEST
We'll build a full-stack Rust AI app, using:
- Axum + SQLx
- RIG: agent orchestration
- RAG: document-grounded context
- MCP: agent interoperability
Info below.

ALT A promotional image for a live workshop titled "Build AI-Powered Applications in Rust: Mastering Rig and MCP for Real-World Tooling." The graphic features a portrait of Francesco Ciulla, Head of Developer Relations Engineer at Zerops. It includes the Packt logo and lists the event details: May 29th, 2026, from 9:00 AM EDT to 11:30 AM EDT. A "Book Now" button is prominently displayed.
Takashi Futada retweeted
Starting today you can use Codex in Claude Code 👀
/plugin marketplace add openai/codex-plugin-cc
Try it out today with:
/codex:review for a normal read-only Codex review
/codex:adversarial-review for a steerable challenge review
/codex:rescue to let codex rescue your code
Enjoy Codex-ing!
Takashi Futada retweeted
In our next Multimodal Agent workshop, we’re moving from seeing to remembering.
Join Ayo Adedeji and @anniewangtech to build a Graph RAG system using Spanner Graph, Vertex AI Memory Bank, and ADK.
From 3D visualizations to long-term memory—let’s build→goo.gle/4lVmtNo
Takashi Futada retweeted
Build a voice agent with Gemini 3 Flash Live and LiveKit to move from local setup to production with native speech-to-speech, smarter tool calling, and reduced speaker drift.
What’s covered:
🌟 Project setup and native audio capabilities
🌟 System prompt best practices and Google Search integration
🌟 Multilingual switching and function chaining
Watch the walk through: goo.gle/3NU6iTI

ALT A Google AI Studio thumbnail titled "Building LiveKit Agents with Gemini Live API" against a dark, star-speckled background. The image features a terminal window in the top right showing logs for running an agent script, and an inset of a smiling person. The Google AI Studio logo is positioned in the top left corner.

























