Alan-Jowett / CoPilot-For-Consensus / 20736861620
81%

DEFAULT BRANCH: main
Ran
Jobs 0
Files 0
Run time –
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
20736861620

push

github

web-flow 
optimize: Reduce Container Apps resource allocations for cost efficiency (#767)

Minimize CPU and memory allocations across all services to reduce operational
costs while maintaining functionality. Services are lightweight event processors
or REST APIs that don't require high resource allocation.

Resource changes:
- Reporting: 0.5 CPU / 1Gi → 0.25 CPU / 0.5Gi
- Ingestion: 0.5 CPU / 1Gi → 0.25 CPU / 0.5Gi
- Parsing: 0.5 CPU / 1Gi → 0.25 CPU / 0.5Gi
- Chunking: 0.5 CPU / 1Gi → 0.25 CPU / 0.5Gi
- Embedding: 1 CPU / 2Gi → 0.25 CPU / 0.5Gi (vector ops are compute-intensive but batch-async)
- Orchestrator: 0.5 CPU / 1Gi → 0.5 CPU / 0.5Gi (memory reduced, CPU retained for LLM calls)
- Summarization: 0.5 CPU / 1Gi → 0.5 CPU / 0.5Gi (memory reduced, CPU retained for LLM calls)
- Gateway: 0.5 CPU / 1Gi → 0.25 CPU / 0.5Gi
- Auth: Already 0.25 CPU / 0.5Gi (no change needed)
- UI: Already 0.25 CPU / 0.5Gi (no change needed)

Cost Impact:
- Per service: ~70% reduction in resource cost per replica
- Example: 10 services × 0.25 CPU at \.04/CPU-hour ≈ 60% monthly cost reduction
- Scales with replica count: larger deployments see greater absolute savings

Justification:
- Most services process a single message/request at a time
- No memory-intensive caching or state
- Containerization overhead > actual memory needed
- Embedding service: async batch processing, not real-time intensive
- Orchestrator/Summarization: LLM calls are I/O-bound, not CPU-bound

Monitoring:
- Deploy to dev environment first
- Monitor for OOM kills (unlikely at these workloads)
- Monitor CPU throttling and request latency
- Adjust if performance degradation observed
- Candidates for Azure Functions migration (issue #765) if cost still high

Signed-off-by: GitHub Copilot <copilot@github.com>
Co-authored-by: GitHub Copilot <copilot@github.com>
Source Files on build 20736861620
Detailed source file information is not available for this build.