i am trying to run the celery -A project worker -l info. But each time it returns an error like init got unexpected error. Kindly Help. Thanks in advance. my settings file: CELERY_BROKER_URL = 'redis://localhost:6379' CELERY_RESULT_BACKEND = 'redis://localhost:6379' CELERY_ACCEPT_CONTENT =…
I want to set-up liveness and readiness probes for Celery worker pods. Since these worker pods doesn't have a specific port associated to them I am finding it difficult. Main Django app nginx server was easier to set-up. I am…
I was wondering how I can use Celery workers to handle file uploads. So I tried implementing it on a simple class. I overrided the create class in my ModelViewSet. But apparently Django's default json encoder does not serialize ImageFields…
I am building a web-app using django channels. I also have a task function which i run periodically ( every 30s) using celery beat. This task function sends data to my web-socket every 30s. Now, if a consumer joins my…
Goal: Possibility to run asyncio coroutines. Correct celery behavior on exceptions and task retries. Possibility to use aioredis lock. So, how to run async tasks properly to achieve the goal? What is RuntimeError: await wasn't used with future (below), how…
I am using Celery to parallelize the execution of a Python function calling a third-party API. This API imposes to wait for at least 3 seconds between each call. Is there a way to specify a Message Broker (RabbitMQ or…
I have a working redis sentinel. I can connect to it with python code and ping it without issue (code below). However when I try to connect my celery application to this redis sentinel, I get back no master found…
Trying to start Celery first time but issues error as below, i have installed redis and its starting fine , but still somehow django seems to have issues with it , File "<frozen importlib._bootstrap_external>", line 848, in exec_module File "<frozen…
As the title says, i want to setup Airflow that would run on a cluster (1 master, 2 nodes) using Docker swarm. Current setup: Right now i have Airflow setup that uses the CeleryExecutor that is running on single EC2.…
I am building a project based on Django and one of my intentions is to have a telegram bot which is receiving information from a Telegram group. I was able to implement the bot to send messages in Telegram, no…