Skip to content Skip to sidebar Skip to footer
Showing posts with the label Celery

Scrapy And Celery `update_state`

I have the following setup (Docker): Celery linked to Flask setup which runs the Scrapy spider Fla… Read more Scrapy And Celery `update_state`

Does The Number Of Celeryd Processes Depend On The --concurrency Setting?

We are running Celery behind Supervisor and start it with celeryd --events --loglevel=INFO --concur… Read more Does The Number Of Celeryd Processes Depend On The --concurrency Setting?

How To Run Airflow With Celeryexecutor On A Custom Docker Image

I am adding airflow to a web application that manually adds a directory containing business logic t… Read more How To Run Airflow With Celeryexecutor On A Custom Docker Image

Rabbitmq Queued Messages Keep Increasing

We have a Windows based Celery/RabbitMQ server that executes long-running python tasks out-of-proce… Read more Rabbitmq Queued Messages Keep Increasing

Call Django Celery Task By Name

I need to call a celery task (in tasks.py) from models.py, the only problem is, tasks.py imports mo… Read more Call Django Celery Task By Name

Initializing A Worker With Arguments Using Celery

I'm having issues finding something that seems like it would be relatively simple to me. I'… Read more Initializing A Worker With Arguments Using Celery