I am new to Docker so I have followed the official guide here for running Airflow with it-https://airflow.apache.org/docs/apache-airflow/stable/start/docker.html
When I start Airflow all services with ‘docker-compose up’ in Ubuntu, I get "ERROR – Triggerer’s async thread was blocked for … seconds, likely by a badly-written trigger. Set PYTHONASYNCIODEBUG=1 to get more information on overrunning coroutines."
Any idea how to fix this issue is appreciated.
Thanks,
2
Answers
This can be fixed by allocating more resources as mentioned here, by default docker allocates 2gb of memory and 4gb is needed.
You can follow this link for mac and link for Windows on how to change your resource allocation.
Also check your
docker-compose
version, you can do so by runningdocker-compose --version
.It’s not direct related with my case. I had this issue in the Kubernetes.
I found many these error in the sentry. i also increase trigger’s memory request 1536MiB and it had better much. (only daily 10 error) I think it depends on your usage. but if you have this issue on k8S, it’s valuable to test.