celery monitoring

[giocalitri]

We need to set up monitoring for celery to be were of:

1. problems
2. performances of the celery overall
   for instance how long tasks sit in the queue before running? How long the refresh cache tasks take to complete?

[pdpinch]

Regarding problems, it seems like we get some visibility through celery. What more do we need? New Relic?

Would New Relic answer the performance question (#2)?

How urgent do you think this is?

[giocalitri]

Sorry, what I mean is the performance of the tasks in the celery ecosystem, meaning if our celery instance is capable to process enough tasks and it is not flooded.