Durable Execution with Apache Airflow
Durable execution refers to workflow and code execution in which, when a process is interrupted, it resumes from its last completed step. Apache Airflow has offered durable execution surrounding tasks since its beginning. Now in Airflow 3.3, the new task state store feature offers durability for code execution within Airflow tasks. You can learn more about durable execution and the task state store with the following resources: - https://www.astronomer.io/blog/durable-execution-with-apache-airflow - https://www.astronomer.io/docs/learn/airflow-task-state-store