I am trying to get DockerOperator work with Airflow on my Mac. I am running Airflow based on Puckel with small modifications. Dockerfile build as puckel-airflow-with-docker-inside: FROM puckel/docker-airflow:latest USER root RUN groupadd --gid 999 docker && usermod -aG docker airflow…
I try to implement Apache Airflow with the CeleryExecutor. For the database I use Postgres, for the celery message queue I use Redis. When using LocalExecutor everything works fine, but when I set the CeleryExecutor in the airflow.cfg and want…
I am trying to setup remote logging in Airflow stable/airflow helm chart on v1.10.9 I am using Kubernetes executor and puckel/docker-airflow image. here's my values.yaml file. airflow: image: repository: airflow-docker-local tag: 1.10.9 executor: Kubernetes service: type: LoadBalancer config: AIRFLOW__KUBERNETES__WORKER_CONTAINER_REPOSITORY: airflow-docker-local…
Airflow scheduler process crashes if we start turning on the DAG and Trigger DAG from Airflow web-server. Airflow Version - **v1.10.4 Redis server v=5.0.7 executor = CeleryExecutor broker_url = 'redis://:password@redis-host:2287/0' sql_alchemy_conn = postgresql+psycopg2://user:password@host/dbname result_backend = 'db+postgresql://user:password@host/dbname' Crashes with Below Error…
I was installing apache-airflow in my centOS 8. Only pip3 works in my environment. I did something with the environment variable which created two config files for airflow. I am not able to find another config file to delete it.…