celery runs very slowly on my laptop
tests/integration/test_distributed_processing/test_multithreaded_vs_singlethreaded fails on my laptop because celery/RabbitMQ is running very slowly. There seems to be some hang up when the celery head node communicates with subprocesses that causes significant slowdown. In particular, I've found that the birth cycle gets hung up in communication between
mauscelery.mausprocess.process_birth but it looks like individual spill processing is also proceeding slowly.
I checked for this in control room branch in MLCR and things look okay - so it could be a feature of my laptop or the release branch.
Updated by Rogers, Chris over 8 years ago
Reading a diff of the code, it looks like there are no significant changes in the source code that could cause a massive slowdown.
Control room branch
- pymongo 2.3
- kombu 2.1.8
- celery 3.0.15
- pymongo 2.4.2
- kombu 2.5.6
- amqp 1.0.8
- billiard 18.104.22.168