BigHugger
sk Skill · Unknown-333

writing-idempotent-transformations

Write data transformations and loads that produce the same result no matter how many times they run — using MERGE/upsert, deterministic partition overwrites, deduplication, and stable keys. Use when a retry could duplicate data, a job is not safe to re-run, a pipeline needs exactly-once effects, or loads must be backfill-safe.

installs 8w
0
30-day movement
starts with the next reading
Related entries
1
Connections
0
sqlPython
Host repository
Unknown-333/awesome-data-engineering-skills
Host stars
18
Host language
Python