For more information, see Architecture Overview. It is available at All these services allow you to run Airflow with CeleryExecutor. docker compose up flower.įlower - The flower app for monitoring the environment. docker compose -profile flower up, or by explicitly specifying it on the command line e.g. Optionally, you can enable flower by adding -profile flower option, e.g. Redis - The redis - broker that forwards messages from scheduler to worker.

Īirflow-worker - The worker that executes the tasks given by the scheduler.Īirflow-triggerer - The triggerer runs an event loop for deferrable tasks.Īirflow-init - The initialization service.

Task instances once their dependencies are complete.Īirflow-webserver - The webserver is available at This file contains several service definitions:Īirflow-scheduler - The scheduler monitors all tasks and DAGs, then triggers the

Environment variables supported by Docker Compose.

ModuleNotFoundError: No module named 'XYZ'.

Special case - adding dependencies via requirements.txt file.

Export dynamic environment variables available for operators to use.

(Optional) Adding IDE auto-completion support.Customize view of Apache from Airflow web UI.Customizing DAG Scheduling with Timetables.Add tags to DAGs and use it for filtering in the UI.

Docker rhel 7