Skip to content Skip to sidebar Skip to footer
Showing posts with the label Celery

Scrapy And Celery `update_state`

I have the following setup (Docker): Celery linked to Flask setup which runs the Scrapy spider Fla… Read more Scrapy And Celery `update_state`

Does The Number Of Celeryd Processes Depend On The --concurrency Setting?

We are running Celery behind Supervisor and start it with celeryd --events --loglevel=INFO --concur… Read more Does The Number Of Celeryd Processes Depend On The --concurrency Setting?

How To Run Airflow With Celeryexecutor On A Custom Docker Image

I am adding airflow to a web application that manually adds a directory containing business logic t… Read more How To Run Airflow With Celeryexecutor On A Custom Docker Image

Rabbitmq Queued Messages Keep Increasing

We have a Windows based Celery/RabbitMQ server that executes long-running python tasks out-of-proce… Read more Rabbitmq Queued Messages Keep Increasing

Call Django Celery Task By Name

I need to call a celery task (in tasks.py) from models.py, the only problem is, tasks.py imports mo… Read more Call Django Celery Task By Name

Initializing A Worker With Arguments Using Celery

I'm having issues finding something that seems like it would be relatively simple to me. I'… Read more Initializing A Worker With Arguments Using Celery

What Is The Best Option For A (python 3) Task Queue On Windows Now That Celery 4 Has Dropped Windows Support?

We run a Flask site under IIS on Windows, and for out-of-process tasks we use Celery. Celery has gi… Read more What Is The Best Option For A (python 3) Task Queue On Windows Now That Celery 4 Has Dropped Windows Support?

Need To Restart Python While Applying Celery Config

That's a small story... I had this error: AttributeError: 'DisabledBackend' object has… Read more Need To Restart Python While Applying Celery Config