Azure / karpenter-provider-azure / 22709151243

94%

main: 94%

Pull #1467

github

feat: add LIST-based machine cache to reduce GET Machine API calls

At 1K-node scale, individual GET Machine calls from drift checks and
reconciliation cause severe throttling (6,594 GET 429s at 17-29s latency
each in Telescope run 55575). This cache converts O(N) individual GET
calls into O(1) cached lookups by caching LIST Machine results.

Design:
- List() populates the cache (replaces all entries)
- Get() consults cache first; falls through to API on miss/stale
- Mutating ops (Create, Update, Delete) invalidate affected entries
- TTL-based expiry (30s default) ensures bounded staleness
- Thread-safe with sync.RWMutex
- Zero TTL disables caching for testing

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

42 of 42 new or added lines in 1 file covered. (100.0%)

58687 of 62263 relevant lines covered (94.26%)

0.96 hits per line