AWS Bedrock – data retention mode "none": Docs: "Zero data retention. No request or response data is written to durable storage by AWS" Blog: "We may store and review flagged content ... even when mode is none" Only one of these can be correct.

1/ Breakthrough: First production KV cache offloading implementation under confidential computing (CC). Same gain as without CC. NVIDIA B300s, CC on: throughput: +141% time to first token: 39 s → 1.5 s GPU to host copies: 4 GB/s → 50 GB/s

Our SF billboard

The spectrum of privacy in AI

In 12 weeks, we built a research facility that is run entirely by AI. AI designs, executes, and observes experiments end-to-end across biology, chemistry, and materials science. We’re introducing SciUniverse: a benchmark that measures AI’s ability to do real-world scientific research.

Looks like today may be a record day for token volume % of open models on Vercel AI Gateway: 🟦 Open 78.4% 🟨 Closed 21.6% While spend 💲 usually tells a different story, #3 and #4 today are Moonshot AI & DeepSeek. Adding Z⁠.ai, their combined spend surpasses OpenAI (#2). (Do note that's the spend for inference of the model across providers (mostly in the US), not revenue going directly to the open weight labs.)