How does DAG deletion work? #21864
-
I've been trying to understand DAG deletion, in particular how much gets removed. I have a few questions that I'm chasing, if anyone can give me a hand:
|
Beta Was this translation helpful? Give feedback.
Replies: 3 comments 6 replies
-
The DAGs have several states when it comes to being "not running". DAGs can be paused, deactivated Dag can be paused via UI when it is present in the Dag can be deactivated (do not confuse it with You can't see the deactivated DAGs in the UI - you can sometimes see the historical runs, but when you try to You can also delete the DAG metadata from the metadata database using UI or API, but it does not This all means that if you want to actually delete a DAG and its all historical metadata, you need to do
This information was missing in our docs, so I am adding it now. |
Beta Was this translation helpful? Give feedback.
-
I have a problem, i deleted a dag from the UI and now i can't recover it, i did try adding new line, changing the dag id, changing the file name, i checked the dag folder and the dag file is present, how can i recover the dag ? I didn't find any documentation about this. |
Beta Was this translation helpful? Give feedback.
The DAGs have several states when it comes to being "not running". DAGs can be paused, deactivated
and finally all metadata for the DAG can be deleted.
Dag can be paused via UI when it is present in the
DAGS_FOLDER
, and scheduler stored it inthe database, but the user chose to disable it via the UI. The "pause" and "unpause" actions are available
via UI and API. Paused DAG is not scheduled by the Scheduler, but you can trigger them via UI for
manual runs. In the UI, you can see Paused DAGs (in
Paused
tab). The DAGs that are un-pausedcan be found in the
Active
tab.Dag can be deactivated (do not confuse it with
Active
tag in the UI by removing them from theDAGS_FOLDER
. When scheduler pa…