retiagod (@retiagod) header
retiagod (@retiagod) profile picture

📄💬 RPTFM 🧠 DocuMental ● 💻 Data, Python, Rust, Go ● 🤖 Automation, API ● 💪 Gym Believer ● https://teapawt.org/t.co/pvuYuavUCv

🇮🇩 | remote
Joined January 2020
Photo by retiagod (@retiagod)Photo by retiagod (@retiagod)Photo by retiagod (@retiagod)Photo by retiagod (@retiagod)Photo by retiagod (@retiagod)Photo by retiagod (@retiagod)Photo by retiagod (@retiagod)Photo by retiagod (@retiagod)Photo by retiagod (@retiagod)Photo by retiagod (@retiagod)
RPTFM DE Quizzes -Read & Prompt The Fucking Manual- Data Engineer Daily Quizzes for a better pit stop from your doomscrolling
1
1
1
1
94
retiagod retweeted
INVESTIGADORES CHINOS ACABAN DE FIRMAR EL CERTIFICADO DE DEFUNCIÓN DE LA PROGRAMACIÓN El paper se titula: “El fin de la ingeniería de software” La idea central es que escribir código está completamente acabado como habilidad. Tu cerebro solo puede retener cierta cantidad de estado y de dependencias antes de chocar contra un muro. Un agente no tiene ese techo, y su capacidad no deja de crecer con el compute. Así que el humano deja de ser quien escribe el código. Te conviertes en el arquitecto de la intención, el que dirige a los agentes y audita el resultado. El código pasa a ser lo desechable, y el criterio pasa a ser el trabajo. Precisamente por eso te dejo abajo esta guía sobre cómo construir tu propio sistema de agentes desde cero. Abajo también tienes el paper completo en el que se basa todo esto ↓
214
1,284
107
8,293
1,014,608
retiagod retweeted
480
20,188
696
91,920
4,353,934
7. Downstream analytics teams frequently run queries on hourly batch exports and report missing data because they query files while the ingestion job is still actively writing. Which pattern resolves this race condition by signaling when the complete payload is safely written?
abcd
0%a
0%b
0%c
0%d
0 votes • Final results
1
1
1
9
-a specific threshold is reached. Which pattern is implemented?
abcd
0%a
0%b
0%c
0%d
0 votes • Final results
2
1
10
retiagod retweeted
7. Downstream analytics teams frequently run queries on hourly batch exports and report missing data because they query files while the ingestion job is still actively writing. Which pattern resolves this race condition by signaling when the complete payload is safely written?
abcd
0%a
0%b
0%c
0%d
0 votes • Final results
1
1
1
9
Fast Metadata Cleaner
Replying to @retiagod
-Which idempotency pattern does this describe?
abcd
0%a
0%b
0%c
0%d
0 votes • Final results
10
Full Loader
Replying to @retiagod
4. A data ingestion pipeline must load a slowly evolving reference dataset of 500,000 records from a third-party source. The source system lacks update timestamps, sequence IDs, or modified flags to indicate which records have changed. Which ingestion pattern is required?
abcd
0%a
0%b
0%c
0%d
0 votes • Final results
8
Gold Layer
Replying to @retiagod
3. An analytics team needs to expose aggregated key performance indicators (KPIs) and dimensional star schemas to business intelligence tools. In which Medallion architecture layer should these data products be published?
abcd
0%a
0%b
0%c
0%d
0 votes • Final results
10
Dead-Letter
Replying to @retiagod
Which pattern solves this problem?
abcd
0%a
0%b
0%c
0%d
0 votes • Final results
15
Bronze Layer, Silver Layer
Replying to @retiagod
-which layer should store this raw, unaltered dataset complete with its data quality flaws, and which subsequent layer is tasked with storing cleansed and enriched events?
abcd
0%a
0%b
0%c
0%d
0 votes • Final results
9
Have you LARPing as a Data Engineer yet?
RPTFM DE Quizzes -Read & Prompt The Fucking Manual- Data Engineer Daily Quizzes for a better pit stop from your doomscrolling
7
retiagod retweeted
6. A real-time stream processing job joins user event Stream A with contextual Stream B. Due to network latency, Stream A arrives 10 minutes ahead of Stream B. To maximize join accuracy while bounded by memory limits, the application buffers unmatched events from Stream A until-
1
1
1
14
retiagod retweeted
5. A team maintains a batch process that writes weekly web visit records. To ensure safe backfilling and idempotency during retries, the orchestrator clears target weekly tables using fast `TRUNCATE` or `DROP` metadata operations before executing the write.-
1
1
1
12
retiagod retweeted
4. A data ingestion pipeline must load a slowly evolving reference dataset of 500,000 records from a third-party source. The source system lacks update timestamps, sequence IDs, or modified flags to indicate which records have changed. Which ingestion pattern is required?
abcd
0%a
0%b
0%c
0%d
0 votes • Final results
2
1
1
1
26
retiagod retweeted
3. An analytics team needs to expose aggregated key performance indicators (KPIs) and dimensional star schemas to business intelligence tools. In which Medallion architecture layer should these data products be published?
abcd
0%a
0%b
0%c
0%d
0 votes • Final results
2
1
1
1
36
-Which idempotency pattern does this describe?
abcd
0%a
0%b
0%c
0%d
0 votes • Final results
2
1
1
23
4. A data ingestion pipeline must load a slowly evolving reference dataset of 500,000 records from a third-party source. The source system lacks update timestamps, sequence IDs, or modified flags to indicate which records have changed. Which ingestion pattern is required?
abcd
0%a
0%b
0%c
0%d
0 votes • Final results
2
1
1
1
26
3. An analytics team needs to expose aggregated key performance indicators (KPIs) and dimensional star schemas to business intelligence tools. In which Medallion architecture layer should these data products be published?
abcd
0%a
0%b
0%c
0%d
0 votes • Final results
2
1
1
1
36