Data Engineering Hub
GitHub Toggle Dark/Light/Auto mode Toggle Dark/Light/Auto mode Toggle Dark/Light/Auto mode
  1. Data Engineering Hub
  2. /
  3. Data Engineering Hub
  4. /
  5. Concepts
  6. /
  7. concepts
  8. /
  9. Idempotence

Idempotence

Idempotence in the context of data engineering means that if you execute a data pipeline multiple times with the same input, the output will stay the same.

Idempotence Advantages

  • Keeps data duplicate-free
  • Can remove stale data
  • Saves on storage and cost
gdoc_arrow_left_alt Data Lake Denormalization gdoc_arrow_right_alt