Delta Lake is an open-source storage framework that enables building a Lakehouse architecture for Spark, Flink, Trino, Hive, Scala, Java, Rust, Python, & more!

San Francisco, CA
Joined April 2019
Join us tomorrow, Oct 13 at 9 AM PT for the Delta Lake Community Meetup! 🎉 On the agenda: 🔹 Parquet FILE data type protocol support 🔹 Concurrent identity column generation RFC 🔹 delta-rs integration with Unity Catalog Delta APIs 🔗 RSVP: luma.com/w6gqy0ul #DeltaLake #OpenSource
1
3
442
Delta Lake retweeted
Packed house for the @openlakehouseai Meetup earlier this week at @databricks. @lukekim joined Shawn Chang, Haoyan Geng, and Lisa Cao for a wide-ranging discussion on the current state of the data and AI landscape, and how data infrastructure needs to evolve to support the next wave of enterprise adoption. The future is open! Thanks to Databricks, Scott Haines , and Yufa Li for bringing together the community.
2
8
456
Delta Lake retweeted
Excited to get together with the Seattle-area open source community tonight at the Open Lakehouse + AI Meetup. Speaker lineup: 1) Felix Cheung, @nvidia: 'Modern Analytics at GPU Speed: Accelerating Spark, @DeltaLakeOSS, @ApacheIceberg, and Spark Connect' 2) Micah Kornfield, @databricks: 'A Unified Future for Delta and Apache Iceberg" 3) Spice Founder @lukekim, Shawn Chang of @awscloud, and Haoyan Geng of Databricks: 'Connecting the Open Lakehouse and AI Ecosystem' More info and registration: hubs.ly/Q04zxCzQ0
1
1
4
608
📣 Join us for the next Delta Lake Community Meetup on October 13! We’re diving deep into recent protocol updates, ecosystem integrations, and community RFCs shaping the future of open data lakes. Come learn about the latest developments and connect with the community! 📅 Tuesday, Oct 13 🕖 9AM PT RSVP 👉 luma.com/w6gqy0ul #opensource #deltalake #oss
2
506
Hi all! Thanks for tuning in. Have questions? Let us know 👇 👇
1
166
Join us next Tuesday for the Delta Lake Community Meetup! 🎉 Stephen Carman (@databricks) will cover Deletion Vector support in Change Data Feed using Kernel, Tyler Croy (Buoyant Data) will share key features and enhancements in delta-rs 1.0. Bring your questions for a live Q&A with the maintainers. 🗓️ Tuesday, Sept 8 🕒 9:00 AM PT Register 👉 luma.com/delta-7kbm #DeltaLake #OpenSource #OpenLakehouse
2
8
1,229
3 weeks out: Open Lakehouse + AI Meetup is coming to Paris! 🇫🇷 Agenda: 🔹 @unitycatalog_io (You Can Go Your Own Way....Go Your Own Way) 🔹 @omnigent_ai — A Meta Harness for AI Agents 🔹 AI Agents at Every Scale: Personal, Team, and Data Workflows Then networking, light bites & swag. 📅 Wed, Sept 23 | 6:00–9:30 PM CEST 📍 La Fondation | Paris, FR 🎟️Register: usergroups.databricks.com/ev… #OpenLakehouse #AI
1
4
7
811
Delta Lake 4.4.0 is out! 🙌 It simplifies engine integrations for catalog-managed tables via Delta Kernel and the UC Delta APIs. Delta Spark now defaults to Spark 4.2. Identity columns in CREATE TABLE. Flink primary-key upserts. 🔗 Learn more: delta.io/blog/2026-08-20-sim… #DeltaLake #ApacheSpark #OpenSource
3
19
1,601
Mark your calendars! 🗓 The Delta Lake Community Meetup is back on Tuesday, September 8 at 9:00 AM PT. Here’s what we’re covering: 🔹Delection Vectors Support in CDF using Kernel – Stephen Carman (@Databricks) breaks down technical updates & key challenge fixes 🔹delta-rs 1.0 – Tyler Croy (Buoyant Data) highlights the latest features and major updates RSVP 👇 luma.com/delta-7kbm #deltalake #opensource #oss
1
10
623
delta-explain: Making Delta Lake File Pruning Visible, and Testable in CI xitter.cf/i/broadcasts/1jGXgBjOv…
1
4
490
Hey all! Thanks for being here - what questions do you have? Drop them in the comments below. 👇
240
1 week away ⏳ delta-explain: Making Delta Lake File Pruning Visible, and Testable in CI See how Delta Lake file pruning is attributed to partition pruning and data skipping from transaction-log metadata, then turn that analysis into a CI contract before regressions hit production. 📅 Aug 18 | 9AM PT (virtual) 🎟️ Register: luma.com/delta-odhl #DeltaLake #OpenSource
1
1
4
776
Open Lakehouse + AI is coming to Paris! 🇫🇷 Join the open source and data engineering community for an evening on open lakehouse and AI architectures. A great fit if you care about how open table formats, catalogs, and AI systems fit together. 📅 Wednesday, Sept 23 | 6:00–9:30 PM CEST 📍 La Fondation, Paris 🎟️ Register now → usergroups.databricks.com/e/… #DeltaLake #Omnigent #OpenLakehouse #UnityCatalog
1
2
6
510
📣 Join us for the next Open Lakehouse + AI Meetup! On the agenda: 🔹 Modern Analytics at GPU Speed: Accelerating Spark, Delta Lake, Iceberg, and Spark Connect 🔹 A Unified Future for Delta Lake and Apache Iceberg 🔹 Panel: Connecting the Open Lakehouse and AI Ecosystem 🔹 Networking with light bites 🗓️ Wed, October 7 📍 Bellevue | @databricks office 🎟️ Register: luma.com/open-qljr #OpenLakehouse #DeltaLake #ApacheIceberg #ApacheSpark
1
2
1
8
978
Join us August 18 for delta-explain: Making Delta Lake File Pruning Visible, and Testable in CI! 📣 We’ll cover a small open-source CLI on delta-kernel-rs that makes pruning visible, measurable, and assertable: 🔹 Partition pruning and data skipping, explained per file 🔹 Analysis from transaction-log metadata, with no query execution 🔹 A live demo and CI gate with a threshold and exit code 🔗Register: luma.com/delta-odhl #DeltaLake #OpenSource #DataEngineering
432
Introducing the UC Delta API in Unity Catalog 0.5 👇 🔹 Versioned, discoverable, atomic REST surface. 🔹 Native Delta wire format and intent-based commits. 🔹 Run it locally with Spark or DuckDB. Read the full post: unitycatalog.io/blogs/unity-… #UnityCatalog #DeltaLake
1
3
297
Join us for the next Delta Lake Community Meetup, where we'll discuss the latest in the Delta ecosystem! 👇 🔹 Delta Kernel Logical Plans and new logical-plan-based APIs 🔹 UC Managed Tables and new UC Delta APIs 💬 Live speaker Q&A 📅 August 11 🕘 9 AM PT 🔗 RSVP: luma.com/event/evt-WoZ2NBOIf… #DeltaLake #OpenSource #UnityCatalog
1
6
477