supabase / etl / 41604760774

81%

Build Type

push

github

Committed by web-flow

Commit Message

ci: Sync CI metrics hourly (#1172)

* feat(xtask): Add CI metrics collector

Add `cargo x ci-metrics migrate|sync`, which collects GitHub Actions
runs, jobs, benchmark manifests and code-scanning metadata into a
Postgres `ci` schema, with read-only `ci_report` views for Grafana.

Syncs are level-triggered: each run compares wanted per-day coverage
with stored state, so outages and crashes heal on the next sync. Writes
are idempotent upserts keyed on GitHub ids; jobs only move forward and
artifacts are untrusted, size-capped input.

Move the GitHub REST transport into a shared module so
`benchmark-compare` and the collector use one client.

* feat(xtask): Ingest benchmark backfill results

Benchmark backfills upload `benchmark-backfill-*` artifacts, which the
collector skipped, so backfilled history never reached the database.
Accept both prefixes; the manifest trigger tells the runs apart.

Parse the manifest commit time as RFC 3339 and store it in UTC, and
expose it on `ci_report.benchmark_metric` so backfilled points plot at
the measured commit's time.

* feat(xtask): Add CI report views for dashboards

Move logic the dashboard repeated in panel SQL into `ci_report` views:
`workflow` labels (CodeQL default setup and workflow share a name),
`flaky_job`, `pr_time_to_green`, and a `scheduled_daily` that matches
the health panel. Fold the benchmark commit-time column into the
initial migration, since neither migration has shipped.

Add a build script so edited migrations are re-embedded: Cargo does
not track `sqlx::migrate!` inputs on stable Rust.

* ci: Sync CI metrics hourly

Run `cargo x ci-metrics sync` every hour at :37, away from the other
schedules, from `main` only. The database URL lives in the `ci-metrics`
environment; the job gets read-only GitHub permissions.

Commit Supabase's public root CA and point the collector at it through
`CI_METRICS_SSL_ROOT_CERT`, so the trusted CA is reviewable rather than
hidden in a secret. The collector now ref... (continued)

Coverage Stats

27 of 32 new or added lines in 1 file covered. (84.38%)

29 existing lines in 5 files now uncovered.

60731 of 75382 relevant lines covered (80.56%)

27292.67 hits per line