I need some help, My setup is Django, Postgres, Celery, Redis – all dockerized. Besides regular user-related features, the app should scrape info in the background mode. What I need is to launch the scraping function manually from management command…
As i was going through the Celery implementation from the Celery documentation, celery -A tasks worker --loglevel=INFO gave output unexpected that from the documentation, File "d:101_all_projectscelery-testingvenvlibsite-packagesceleryplatforms.py", line 9, in import grp ModuleNotFoundError: No module named 'grp' Is this because i…
I'm attempting to have an asynchronous task kicked off in a Flask route, and use JS to poll the task status location and retrieve the result when it is complete. The task shows as "PENDING" and doesn't ever succeeded or…
I am trying to run a simple workflow using celery and using this documentation. I am using chain to sequentially run the tasks, with following workflow Extract a file, tokenize it and load JSON dumps of sentence tokens of a…
I have a following project directory: azima: __init.py main.py tasks.py monitor.py tasks.py from .main import app @app.task def add(x, y): return x + y @app.task def mul(x, y): return x * y @app.task def xsum(numbers): return sum(numbers) main.py from celery…
I want to use Сelere with Redis as backend, I'll have a process that create tasks, stores ids and then runs again and checks statuses. How to clear results and statuses that I don't need anymore, could I restrict time…
I am trying to create a an API endpoint that will start a classification task asynchronously in a Django backend and I want to be able to retrieve the result later on. This is what I have done so far:…
I'm using Django and Celery with RabbitMQ as the message broker. While developing in Windows I installed RabbitMQ and configured Celery inside Django like this: celery.py import os from celery import Celery os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'main.settings') app = Celery('DjangoExample') app.config_from_object('django.conf:settings', namespace='CELERY') app.autodiscover_tasks()…
I'm using autodiscover in my celery.py file for gathering tasks. Which up until a recently picked all of the app.tasks.py up, I'm not sure why but my config.tasks.py function are no longer being picked up, but all the other apps…
This is a more general question on how the solution could be designed. The goal is to have an API which would take some a text or a list of texts, process it and return transformed ones. How should I…