@pydantic
Account based inUnited States
About this account
- Account based in
- United States
- Connected via
- Web
Account-level information from X, not a live location or the device used for a specific post.
The Pydantic Stack: Logfire, Monty, Validation, AI, Evals, and AI Gateway
London
Joined August 2022
- Tweets2.9K
- Following176
- Followers21K
- Likes6K
Pinned Tweet
One Jev request, three scores: a policy label, a rubric level, and the probability the reply asks for a password, all recorded in Logfire.
Modeled cost of 1M evaluated replies: $62, vs $4,542 with Braintrust before data charges.
Blogpost pydantic.io/n4PWy
Pydantic retweeted
Thanks for the great folks at @pydantic for sponsoring my work on Apache DataFusion and Arrow! github.com/sponsors/neilconw…
Samuel used up his entire Fabel budget in a night, now he wants your validation that it was a good idea.
Mad plot twist - what if Monty could run JS and TS code, and even run and render React components!?
Just an experiment for now, but it works amazingly well.
This would be especially useful if you want agents to generate UI safely. Feedback welcome.
github.com/pydantic/monty/pu…
Pydantic retweeted
Already have agents? OpenAI Agents SDK, Strands, Google ADK and the Anthropic SDK get the same Airflow toolsets as the built-in @Pydantic AI operators.
Pydantic retweeted
Monty can pause agent-written code, turn it into bytes, and resume it later ⏸️
- dump() serializes the whole interpreter
- load_snapshot() resumes it in another process or machine
- Wait hours for a human approval with nothing running
pydantic.dev/docs/monty/conc…
Last call: Tomorrow our engineers sit down with @dosu_ai on keeping internal agents’ company knowledge current:
- How to evaluate an internal agent
- When a person should review its work
- What agents should remember, and memory drift
Oct 20 at 8:30am PT/11:30am ET.
Register now: pydantic.io/JH6VJ
What's the most useful feature here?
What do you want/need next?
Monty v1.2.0 from @pydantic is released.
Massive lease (as ever) with some very important features.
github.com/pydantic/monty/re…
Biggest features:
Pydantic retweeted
Pydantic AI's CodeMode can start your tools before the model finishes writing the code ⚡
- CodeMode(speculate=['get_weather'])
- A call with literal keyword arguments starts once its line streams in
- In my test, 3 slow lookups went from 8.7s to 4.7s
pydantic.dev/docs/ai/harness…
Pydantic retweeted
This is why reducing your dependency on corporate entities is so important. Own your own harness. Own your own hardware. Own your privacy.
Why not build on top of @pydantic AI?
pydantic.dev/pydantic-ai
As agents started opening and reviewing more of our PRs, we moved our CI to @RunsOnRunsOn.
We also built a RunsOn integration to watch it in Pydantic Logfire. @RunsOnRunsOn users get dashboards for queue times, Spot interruptions, cost per job, and runner sizing.
pydantic.io/oKz6x
The @pydantic team switched Logfire's CI to RunsOn on Sept 1.
August, on GitHub, Depot and Ubicloud runners: $18.2k.
September, on RunsOn: $5.7k, license and every AWS cost included.
And they ran 31% more runner minutes in September. 🧵
Pydantic retweeted
Along the way, they built a RunsOn integration in Logfire: dashboards for queue times, Spot interruptions, cost per job, and runner CPU and memory.
A few lines of Terraform:
runs-on.com/blog/runs-on-pyd…
Pydantic retweeted
I'm looking for my next role 👀
TS SDKs, DX, agent tooling. remote/hybrid from Boston.
if you've enjoyed ArkType, Standard Schema or my TypeScript perf work, a repost would mean a ton 🙏
ssalbdivad.com
Pydantic retweeted
Trace Claude with @pydantic Logfire ;)
Pydantic retweeted
Monty is a Python interpreter in Rust, built to run code written by AI 🦀
- Starts in under 1ms vs ~1500ms for a sandbox service
- No filesystem, env or network, just the functions you pass
- In Pydantic AI, CodeMode() runs your agent's tools through it
github.com/pydantic/monty
Pydantic retweeted
took a little longer than planned but @pydantic ai has day-1 support for argon! and all the new cool stuff it brings
github.com/pydantic/pydantic…
Pydantic retweeted
Play with the new Google release with Pydantic AI ;)
Pydantic AI now supports Gemini 4 Argon, with long decode.
One Argon request stops at 32K output tokens (64K streamed). Set a bigger output budget and Pydantic AI follows Google's continuation token for you: one agent run, one combined response.
pydantic.io/ifgZJ
Pydantic AI now supports Gemini 4 Argon, with long decode.
One Argon request stops at 32K output tokens (64K streamed). Set a bigger output budget and Pydantic AI follows Google's continuation token for you: one agent run, one combined response.
pydantic.io/ifgZJ
Strong argument from Samuel on why Graphs are a bad idea, and why Pydantic Monty and @temporalio are a better option.
Pydantic retweeted
This is huge as a user since 0.x
Pydantic AI now turns on prompt caching with one capability.
Anthropic and Bedrock cache nothing unless the request asks. The Caching capability asks for you: tool definitions, instructions and the conversation, one setting instead of each provider's.
pydantic.io/uJC8d