• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

mxschmitt / playwright-go / 28354266090
79%
main: 79%

Build:
Build:
LAST BUILD BRANCH: ci/rerun-flaky-tests-gotestsum
DEFAULT BRANCH: main
Ran 29 Jun 2026 07:03AM UTC
Jobs 9
Files 62
Run time 1min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

29 Jun 2026 06:56AM UTC coverage: 79.004%. Remained the same
28354266090

Pull #621

github

mxschmitt
ci: re-run flaky tests via gotestsum while surfacing them on flakiness.io

Browser-side timing flakes (e.g. firefox/macOS viewport first-paint races,
webkit cross-process document.cookie lag) occasionally fail the suite even
though the tests are correct. Upstream microsoft/playwright absorbs these with
`retries: 3`; our CI had no retry, so a single transient flake reddened a job.

Run the suite through gotestsum --rerun-fails: it re-runs ONLY the failed
tests, exits 0 if each passes within the budget, and writes every attempt to
--jsonfile. Piping that into `flakiness-go --stdin` records each attempt as a
distinct RunAttempt, so a fail-then-pass is uploaded to flakiness.io as *flaky*
(visible) rather than hidden — unlike an in-process retry, which would emit a
single passing attempt and mask the flake.

A test that fails every attempt still fails the job (gotestsum exits non-zero,
captured as the gate since `flakiness-go --stdin` always exits 0), and
--rerun-fails-max-failures aborts the rerun on a broad breakage that isn't
'flaky'. Verified end-to-end locally; details in
mxschmitt/flakiness-go#2.
Pull Request #621: ci: re-run flaky tests via gotestsum while surfacing them on flakiness.io

8756 of 11083 relevant lines covered (79.0%)

7068.05 hits per line

Jobs
ID Job ID Ran Files Coverage
1 windows-latest-firefox - 28354266090.1 29 Jun 2026 07:08AM UTC 62
77.28
GitHub Action Run
2 macos-latest-webkit - 28354266090.2 29 Jun 2026 07:05AM UTC 62
76.62
GitHub Action Run
3 ubuntu-latest-chromium - 28354266090.3 29 Jun 2026 07:03AM UTC 62
78.72
GitHub Action Run
4 ubuntu-latest-webkit - 28354266090.4 29 Jun 2026 07:05AM UTC 62
77.07
GitHub Action Run
5 windows-latest-chromium - 28354266090.5 29 Jun 2026 07:06AM UTC 62
78.67
GitHub Action Run
6 ubuntu-latest-firefox - 28354266090.6 29 Jun 2026 07:07AM UTC 62
77.28
GitHub Action Run
7 macos-latest-chromium - 28354266090.7 29 Jun 2026 07:03AM UTC 62
78.7
GitHub Action Run
8 windows-latest-webkit - 28354266090.8 29 Jun 2026 07:05AM UTC 62
77.13
GitHub Action Run
9 macos-latest-firefox - 28354266090.9 29 Jun 2026 07:07AM UTC 62
77.31
GitHub Action Run
Source Files on build 28354266090
  • Tree
  • List 62
  • Changed 18
  • Source Changed 0
  • Coverage Changed 18
Coverage ∆ File Lines Relevant Covered Missed Hits/Line
  • Back to Repo
  • Pull Request #621
  • PR Base - main (#28262230971)
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2026 Coveralls, Inc