Open Source Data | https://teapawt.org/t.co/TFYgbz5UXa
Denver, CO
Joined December 2013
- Tweets302
- Following89
- Followers599
- Likes234
Sean Lopp retweeted
yesterday evening i gave a presentation to founders, investors, and the ai community at @aixventureshq on how to think about ai application development. it was well received so i'm going to reproduce it in full here on x the everything app (which is also now a slide deck app).
Sean Lopp retweeted
Join us at the AI Solution Showcase Expo for Sean Lopp’s @lopp_sean talk, The Unreasonable Effectiveness of an Asset Graph.
Get your free or paid pass today.
hubs.li/Q02sfY8-0
#ODSCEast #DataScience #AI #MachineLearning
Sean Lopp retweeted
I just dropped this hot new track at #positconf2023
Snoop vs Biggie battle on the subject of R vs Python
(With a little help from AI)
Sean Lopp retweeted
Here's an incomplete list of things we never talk about when we talk about LLMs and AI vickiboykis.com/2023/07/18/w…
Another really useful post that I'm late to the party on. As a startup employee you sometimes get to see PnL, but its usually very mysterious. This article unpacks these statements well: lethain.com/profit-and-loss-…
Late to discover this post but k8s+batch mashup is a common theme in my computing career. One reason I'm excited about @dagster is because it actually does make orchestration w/ k8s better: betterprogramming.pub/kubern…
Sean Lopp retweeted
Level up from running basic ELT/ETL jobs to managing a data platform for your analytics workloads!
With Dagster, you can develop locally and deploy to prod with confidence.
Join us tomorrow (May 10) for the benefits and practice of orchestrating data analytics.
Sean Lopp retweeted
The latest edition of the Data Unplugged podcast features data engineer Vinnie Dalpiccol, who shares his experience adopting and building on Dagster.
Watch the video on LinkedIn:
linkedin.com/feed/update/urn…
Sean Lopp retweeted
Partitions are a big deal in data engineering and don't get talked about enough.
More than half of Dagster users partition their data.
A 🧵 on the "what" and "why" of partitions and data pipelines:
The @dagster 1.2.0 release is 🔥
- an orchestrator that deeply knows and models your data partitions 📅
- new resource configuration that is ooh so 🐍
dagster.io/blog/dagster-1-2-…
Sean Lopp retweeted
Join us live today as we demo the new dagster-airflow tooling that makes migrating off @ApacheAirflow and onto Dagster a breeze.
We kick off at 9 AM PST | 12 noon EST | 5PM GMT
youtube.com/watch?v=YDO400lQ…
"Teams are excited to build workflows in Dagster, and they're tired of doing it in Airflow"
Join @dagster Wednesday to learn more!
📆 dagster.io/events/dagster-ai…
One of my favorite books with our young family is "If you give a mouse a cookie". Unfortunately, I think there is a data engineering version of the story: "If you test in production" 😢
youtube.com/watch?v=L5kTxCM-…
🎇➡️😱 Getting paged on-call is the worst, especially during the holidays. @dagster decreases errors and alerts:
1⃣ one-line retry polices reattempt function calls
2⃣ entire runs can be reattempted from the point of failure
3⃣ stakeholder alerts on SLAs
youtu.be/A6WtkMwe4VQ
😁 I’m very excited for this release. @getdbt meets SLA-driven schedules!
1. Create a new model 🧑💻
2. Assign a freshness SLA to the result based on your stakeholders ⏱
3. The end. No worrying about jobs, cron strings, or dags. 🎉
dbt is central to many Dagster projects, so it’s no surprise that we have focused on making @getdbt models easy to integrate into Dagster pipelines to centralize observability and run metadata.
And now we are adding Declarative Scheduling for dbt!
Sean Lopp retweeted
New in @dagster 1.1.7: time-lagged and rolling-window partition dependencies!
Day N's partition can depend on day N-1's partition in an upstream data asset
