GCPBatchTaskRunner making a lot of requests to GetJob endpoint

[japerry911]

Describe the issue

I have 5 concurrent jobs running for about 40-50 minutes, and I am seeing 28k requests to google.cloud.batch.v1.BatchService.GetJob.

Here is requests per second screenshot over last hour:

Here is total requests picture:

---

My thoughts are that there could be a setting to set 'poll between' time or potentially just lessen the requests overall.

Let me know if you need more context/have any questions.

Thank you Kestra team 🙏 !

Environment

• Kestra Version: 0.16.6
• Operating System (OS/Docker/Kubernetes): Docker / GCP VM
• Java Version (if you don't run kestra in Docker): n/a

[loicmathieu]

Thanks for opening the issue.
We're using a constant polling of 100ms which can be a little too low for cloud task runners like GcpBatch that are anyway long to start.

We will discuss internally what to do to improve this.