celery beat taking more time to push task to workers

[ananthasreeram]

Summary:

Include a brief description of the problem here, and fill out the version info below.

• Celery Version: 5,27
• Celery-Beat Version: 2.3.0

Exact steps to reproduce the issue:

1. I have created 1000 crontab schedules in an interval of 5 mins with same celery task and verified timestamp, It took me 12-18(some time more then this ) seconds to push task to workers
2. I can see there is no time consistency in sending task
3. Is there any way to configure, to send 1k task in 1 sec ? will celery beat will support this?
4. In my production I have 10k schedules with 5 mins interval but beat is taking more time to push workers
5. I have more worker to process tasks but beat is taking more time to push task
6. Currently beat is runs synchronously and I can see called one by one with apply_sync , Is it possible to change code to async process because if beat is pushing one by one to workers and it will push wrong time to workers as compared with schedule time
   Example:
   10k schedules need to push every 5 mins interval but beat taking 3 mins to push task to workers(configured more workers for processing)
   Is there any way to improve beat performance?, Pls help me

[ananthasreeram]

@mbaechtold @tarkatronic @mbaechtold @tarkatronic @ask , Pls help me in above case, we have completed implementation with celery but due to this we have blocked

[ananthasreeram]

Thanks

[ananthasreeram]

Hi,

any consideration's