Tasks manager

[silviodc]

Hello I haven't seen frameworks like Celery https://docs.celeryproject.org/en/stable/index.html
Or spring https://spring.io/projects/spring-cloud-dataflow#overview

In my personal experience I had to create many batch pipelines, using these. Now with airflow I'm planning to move some. But still there are some legacy code I can't change :) so knowledge to maintain them are necessary.

[alexandraabbas]

Hey @silviodc - yes, Airflow abstracts these tools se we don't need to interact with them directly. I also had to learn more about Celery when configuring Airflow in production. I'll consider adding these next time, thanks a lot!