splunk / splunk-operator / 21163672626
86%
main: 87%

LAST BUILD BRANCH: e2e-new-test-framework
DEFAULT BRANCH: main
Ran
Jobs 1
Files 47
Run time 1s
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
21163672626

Pull #1665

circleci

Vivek Reddy 
Add next-gen E2E test framework with PlantUML visualization and observability

This commit adds a comprehensive, declarative E2E test framework for Splunk
Operator with built-in observability, PlantUML visualization, and advanced
features for test organization and debugging.

Major Features:
===============

1. PlantUML Auto-generation
   - Generates 4 types of visual diagrams automatically:
     * topology.plantuml - Component architecture with relationships
     * run-summary.plantuml - Test run statistics
     * failure-analysis.plantuml - Failure patterns by error type
     * test-sequence-<name>.plantuml - Step-by-step execution flow
   - Color-coded by test status (green=pass, red=fail)
   - Automatic generation when -graph flag is enabled (default)

2. Graph Enrichment and Query
   - Enhanced Neo4j graph with version metadata, topology info, cluster details
   - Cypher query tool (e2e-query) for interactive graph exploration
   - Incremental graph writes for real-time visibility

3. Data Cache System
   - Dataset caching for faster test execution
   - S3/GCS/Azure object store support
   - Reduces test runtime for data-intensive tests

4. Matrix Test Generator
   - Generate test combinations across multiple dimensions
   - Topology x Image Version x Configuration matrices
   - Parallel test execution support

5. New Test Specs (419 total test cases)
   - appframework_cloud.yaml - S3-based app deployment
   - monitoring_console_advanced.yaml - Advanced MC configurations
   - resilience_and_performance.yaml - Chaos engineering tests
   - secret_advanced.yaml - Advanced secret management
   - simple_smoke.yaml - Fast smoke tests
   - smoke_fast.yaml - Optimized smoke test suite

6. Observability Stack Deployment
   - Complete K8s manifests for Neo4j, OTel Collector, Prometheus, Grafana
   - Deployment scripts for quick setup
   - Test runner job for CI/CD integration

Implementation Details:
======================

Core Framework:
- e2e/framework/... (continued)
Pull Request #1665: [Draft]: Add Next-Gen E2E Test Framework with Observability and Visualization

10730 of 12422 relevant lines covered (86.38%)

28.57 hits per line

Jobs
ID Job ID Ran Files Coverage
1 21163672626.1 47
86.38
 CircleCI Job
Source Files on build 21163672626