
Databases. See also @AlexMillerDB@fosstodon.org or @alexmillerdb.bsky.app
Joined May 2014
- Tweets1K
- Following211
- Followers3K
- Likes411
Our next South Bay Systems meetup is on May 26! This time, we're covering one of my favorite topics: databases, and how to use them to make better architectural decisions and build reliable systems.
We have two great talks lined up:
- "Building a Distributed Persistent Queue on FoundationDB": @HimankChaudhary will walk through how the queuing infrastructure at @TigrisData was designed and implemented.
- "Decisions, Principles, and Lessons from a Year of Teaching MySQL New Tricks": Steve Schirripa will share lessons and challenges around extending relational database systems at @VillageSQL.
Food and drinks will be provided courtesy of our hosts at @PingCAP. Registration link below.
Our next South Bay Systems meetup will be on March 31. We've got two awesome deep-dive talks:
- @ssougou will present deconstructing consensus and its application to Multigres
- @stuhood will talk about how modern full-text search is evolving toward columnar systems (and the tricky optimization challenges)
Food and beverages will be provided, courtesy of our hosts, @Snowflake
Come hang out with the systems crowd 👇
Alex Miller retweeted
WebAssembly is Cool! (finally!) - The South Bay Systems talk series is back on Oct 2nd.
Jakob will talk about the history and novel use cases of WebAssembly. Perfect timing too: Wasm 3.0 just released, and it is turning 10 this year. From browsers to embedded systems and beyond, the ecosystem has come a long way.
Huge thanks to @Yugabyte for hosting! Registration link below.
Alex Miller retweeted
Had our biggest South Bay Systems meetup yet last night! Thanks to everyone who came and joined the vibrant discussion. Big thanks to @databricks for hosting!
@andy_pavlo from CMU gave a deep dive into the 50-year history of database tuning, his work applying AI/ML to the problem, and where he sees auto-tuning headed next (agentic reasoning, of course).
Some key takeaways:
- Tuning a database holistically is much better than tuning one knob at a time.
- Reusing prior tuning experiences improves both speed and effectiveness.
- Reasoning agent + specialized algorithms is the path forward to achieving autonomous databases.
Fun fact: Andy brought me into the world of databases and has inspired me in many ways. We worked together 9 years ago on a database project, and that started my DB research journey. South Bay Systems itself began after Alex, Yingjun, and I met at Andy's talk in SF last year.
It's amazing to see how the community and our organizer team have grown since then. Big shoutout to our awesome organizers: @AlexMillerDB
, @YingjunWu, @__vishwanath__, Oussama Saoudi, Benjamin Owad, WenFei He, Allison Wang
Alex Miller retweeted
The South Bay Systems meetup is back on July 22!
We're excited to welcome @jacopotagliabue (co-founder and CTO of Bauplan) for a talk on Speedrunning the Lakehouse: Shipping a FaaS that Looks Like a Database (and Vice Versa).
Jacopo will share his experience in building a FaaS-style lakehouse from the ground up using object storage and open formats. He'll cover fast function deployments, multi-language transactions backed by formal correctness proofs, and the importance of user-facing APIs for real-world adoption.
Come for cutting-edge systems insights, stay for food, drinks, and great conversations!
This meetup is generously sponsored by @Aiplus__ , The Multiverse, and @DBOS_Inc . Food and drinks will be provided.
Registration link below 👇
Alex Miller retweeted
A month after building that construction SaaS prototype, I found myself working on something completely different: reimagining distributed programming paradigms in Java.
Context: Building Wavefront taught me the value of solid infrastructure foundations. We chose FoundationDB as our key-value store, and over the years I became fascinated by what made it so remarkably reliable. The answer wasn't just the ACID guarantees or the distributed architecture - it was Flow, their internal actor framework that enables single-threaded, cooperative multitasking with deterministic simulation.
Flow lets you write code like this:
ACTOR Future<int> processRequest() {
state int value = wait(readDatabase());
wait(delay(1.0)); // Non-blocking delay
return value * 2;
}
Sequential-looking code that's actually asynchronous. No callbacks, no complex threading, just cooperative yielding with full determinism for testing.
The Java Reality: Meanwhile, we're still wrestling with CompletableFuture chains that look like this:
service.getData()
.thenCompose(data -> processData(data))
.thenCompose(result -> saveResult(result))
.whenComplete((value, error) -> handleCompletion(value, error));
Reactive streams offer power but complexity. Virtual threads from Project Loom are impressive, yet they lack task prioritization and the deterministic execution that makes distributed system testing tractable.
Enter JavaFlow: I spent the last few months reimagining Flow's core ideas in idiomatic Java, leveraging JDK 21's continuations. The goal: cooperative multitasking with deterministic simulation, but without requiring a custom compiler.
FlowFuture<String> result = startActor(() -> {
String data = await(fetchData());
await(delay(1.0)); // Cooperative yield for 1 second
return processData(data);
});
What's implemented: actors, cooperative scheduling, timers, async file I/O, and an RPC framework. All operations integrate seamlessly with the event loop, maintaining deterministic execution. The key insight from FoundationDB holds: when you can simulate your entire distributed system in a single thread with controllable time, you can test scenarios that would be impossible in production.
I put Claude Code through its paces on this project. Still requires significant supervision, but Opus 4 shows meaningful improvements. The trajectory is promising.
Why this matters: Modern distributed systems are inherently asynchronous, yet our programming models often fight against this reality. JavaFlow attempts to bridge that gap - maintaining the performance benefits of event-driven systems while preserving the readability of sequential code.
The project is on Maven Central (io.github.panghy:javaflow) and fully open source: github.com/panghy/javaflow
This is experimental work - I don't yet know if it solves real problems or remains an interesting academic exercise.
#DistributedSystems #AsyncProgramming #Java #FoundationDB #EIR #TechInnovation
Alex Miller retweeted
Working with several seed/series A infra startups (databases, storage, distributed systems, foundational AI infra) hiring across core engineering and GTM. Small teams (<20), high-agency IC roles. DM me if interested or you have referrals!
Alex Miller retweeted
I enjoyed @AlexMillerDB's "Decomposing Transaction Systems" blog so much I had to write up how I'd decompose Aurora DSQL in a new blog post.
Alex Miller retweeted
Thank you all for joining us at the first South Bay Systems meetup! It was wonderful to meet everyone, and a special thanks to @Yugabyte for hosting the event.
Talk Recap: @JohnOusterhout presented his latest work, "It's Time to Replace TCP In the Datacenter". He walked us through the fundamental issues with TCP (and its variants like DCTCP) in datacenter environments, outlined important features a better protocol should have, and shared insights from implementing the Homa Linux module. If you missed it, we recorded the talk and will share the link soon.
📣 Call for Talks: We're planning the next meetups and looking for engineering-focused talks, no product pitches. If you have experience in building, debugging, testing, or maintaining systems, we'd love to hear from you! Submit your talk proposal (link in the QR code and the comment below).
Have suggestions or questions? Interested in hosting and sponsoring food/drinks? Feel free to reach out to me, @AlexMillerDB , or @YingjunWu.
Looking forward to the next one!
Alex Miller retweeted
We're excited to announce that South Bay Systems will be having its first talk!
@JohnOusterhout will present "It's Time to Replace TCP in the Datacenter". It will be on March 11th, 6pm to 8pm, generously hosted by @Yugabyte at their Sunnyvale office.
Register at lu.ma/vcwd7npw
Abstract: Although TCP is a tremendously successful transport protocol that has survived 40 years of dramatic technology changes, virtually every aspect of its design is wrong for the datacenter. This talk will discuss the problems with TCP, ranging from its use of connections and streams to its mechanisms for reliable delivery and congestion control. If we are to make significant headway against the "datacenter tax" we must move most datacenter traffic to a new and fundamentally different protocol. I will then discuss how the Homa transport protocol solves all of the problems of TCP and suggest a migration strategy for bringing Homa into widespread usage.
If you're interested, here is a related paper: arxiv.org/abs/2210.00714
Alex Miller retweeted
Help me build a list of online tech book clubs and online paper reading groups?
Comment with what your group does and how someone can join? RT for reach.
Alex Miller retweeted
Had our first South Bay Systems coffee chat today in downtown Sunnyvale (forgot to take pics)! Thanks everyone for showing up. It was amazing to meet you all and chat about anything databases and distributed systems.
We’re planning our talk series! If you have a venue or want to present your cool projects, please reach out to us @AlexMillerDB @YingjunWu
Webpage (inspired by our friends from SF systems and @eatonphil): southbaysystems.xyz/
Alex Miller retweeted
Ben Collins is going back to his roots!
He will be speaking at @Adobe HQ for the @FoundationDB meetup this month. You don't want to miss this.
Link in the comments.
Alex Miller retweeted
Clay codes are a newish erasure coding scheme with some nice properties: They make for a systematic MDS erasure code, like Reed-Solomon, that can recover the loss of one chunk of data with much less bandwidth and disk I/O than the worst case you get with typical MDS codes.
Alex Miller retweeted
Today we announce a brand new conference for software reliability.
200 seats. 10 featured speakers. 6 lightning talks. 5 panelists. 2 days. 1 masterclass. All during DC's cherry blossoms.
We call it BugBash.
bugbash.antithesis.com/
Alex Miller retweeted
Here's a fascinating story of how researchers used Bloom filters cleverly to make SQLite 10x faster.
I'll also explain some database internals and how databases implement joins.
Let's dive in!
Alex Miller retweeted
Last month on Write that blog! …
- “Zero Disk Architecture” by @iavins
- “Blogging Through the Decades” by @bcantrill
- “Revisiting the Outbox Pattern” by @gunnarmorling (@Decodableco )
“Userland Disk I/O” by @AlexMillerDB
“Disaggregated Storage - A Brief Introduction” by @iavins
“We’re Leaving Kubernetes” by @csweichel and @aledbf (@gitpod)
“Analytics-Optimized Concurrent Transactions” by @mraasveldt and Hannes Mühleisen (@duckdb)
writethat.blog/?year=2024&mo…
Alex Miller retweeted
.@AlexMillerDB's mental model for: where did I actually send that data
Alex Miller retweeted
The Vertical Paxos paper describes some of the challenges of using consensus for data replication and concedes that consensus is often used only for configuration, with other mechanisms for replicating the data itself. The intro, at least, is worth reading microsoft.com/en-us/research…



























