I am new to Celery. I want to run demo_task in parallel, but it runs tasks sequentially instead of in parallel. Please let me know if I did something wrong. import time from celery import Celery from celery import chain,…
I have a Django app setup with some scheduled tasks. The app is deployed on Heroku with Redis. The task runs if invoked synchronously in the console, or locally when I also have redis and celery running. However, the scheduled…
I'm having an issue setting up celery to work with my flask app. I've used a barebones app to test the configuration and have found that my celery worker is started but not picking up any of the tasks like…
i am trying to run the celery -A project worker -l info. But each time it returns an error like init got unexpected error. Kindly Help. Thanks in advance. my settings file: CELERY_BROKER_URL = 'redis://localhost:6379' CELERY_RESULT_BACKEND = 'redis://localhost:6379' CELERY_ACCEPT_CONTENT =…
I want to set-up liveness and readiness probes for Celery worker pods. Since these worker pods doesn't have a specific port associated to them I am finding it difficult. Main Django app nginx server was easier to set-up. I am…
I was wondering how I can use Celery workers to handle file uploads. So I tried implementing it on a simple class. I overrided the create class in my ModelViewSet. But apparently Django's default json encoder does not serialize ImageFields…
I am building a web-app using django channels. I also have a task function which i run periodically ( every 30s) using celery beat. This task function sends data to my web-socket every 30s. Now, if a consumer joins my…
Goal: Possibility to run asyncio coroutines. Correct celery behavior on exceptions and task retries. Possibility to use aioredis lock. So, how to run async tasks properly to achieve the goal? What is RuntimeError: await wasn't used with future (below), how…
I am using Celery to parallelize the execution of a Python function calling a third-party API. This API imposes to wait for at least 3 seconds between each call. Is there a way to specify a Message Broker (RabbitMQ or…
I have a working redis sentinel. I can connect to it with python code and ping it without issue (code below). However when I try to connect my celery application to this redis sentinel, I get back no master found…