InfluxDB 2.3 -> 2.7 : Slow start time caused by number of checks

[g1n93r]

InfluxDB 2.3 -> 2.7 : Slow start time caused by number of checks

The issue

I recently migrated from Docker image influx:2.3 to influx:2.7.

I never had issue with the start time of 2.3. After migrating to 2.7, start time would increase from a couple seconds (2-3 seconds) to more than 10 minutes.

After investigation, I found out that the start time in 2.7 is directly proportional to number of Checks which is not the case in 2.3

Step to reproduce

1. Add many checks (>100)
2. Wait a couple hours. (Problem does not arise immediately after check creation)
3. Restart Influx container
4. Notice the slow start time
5. Remove all checks
6. Restart Influx container
7. Notice almost immediate start time

*note: by start time I mean the time between the container creation and Influx tcp-listener start