NVIDIA / nodewright

84%

LAST BUILD ON BRANCH main

branch: SELECT

CHANGE BRANCH

x

Sync Branches

• No branch selected
• agent-go-operator-agent-221
• agent/remove-kube-rbac-proxy
• backport/agent-v7.0.x-708-713-720
• backport/v0.19.x-771
• backport/v0.19.x-773
• bugfix/version-compare-empty-string-panic
• chart-release
• cherry-pick-chart
• cherrypick
• chore+chart-agent-v7.0.0
• chore/377-addlicense
• chore/backport-783-release-v0.20.x
• chore/changelog-v0.19.1
• chore/chart-v0.19.1
• chore/chart-v0.20.0
• chore/controller-gen-v0.22-regen
• chore/docs-chart-nodewright-prose
• chore/go-1.26.5
• chore/k8s-1.36.2-bump
• chore/k8s-tests-nodewright-rename
• chore/k8s-tests-readme-nodewright-prose
• chore/oss-readiness
• chore/update-chart
• chore/update-golang-patch
• ci/docker-hub-mirror
• ci/exclude-generated-from-coverage
• ci/publish-chart-ghcr
• ci/retry-transient-network-fetches
• codex/issue-433-envtest-suite
• codex/issue-443-uninstall-job-retention
• codex/issue-477-owned-pod-scope
• codex/issue-478-job-tests
• codex/issue-555-helm-webhook-race
• codex/issue-604-track-reboots
• codex/prune-ignored-batch-nodes
• dependabot/github_actions/actions/cache-6
• dependabot/github_actions/actions/checkout-7
• dependabot/github_actions/actions/download-artifact-8
• dependabot/github_actions/actions/setup-go-7
• dependabot/github_actions/actions/upload-artifact-7
• dependabot/github_actions/actions/upload-artifact-7.0.1
• dependabot/github_actions/azure/setup-helm-5
• dependabot/github_actions/coverallsapp/github-action-2.3.8
• dependabot/github_actions/github/codeql-action/init-4.37.4
• dependabot/github_actions/helm/kind-action-1.15.0
• dependabot/github_actions/helm/kind-action-1.15.1
• dependabot/go_modules/operator/github.com/go-logr/logr-1.4.4
• dependabot/go_modules/operator/github.com/google/cel-go-0.29.0
• dependabot/go_modules/operator/github.com/onsi/ginkgo/v2-2.32.0
• dependabot/go_modules/operator/github.com/onsi/ginkgo/v2-2.32.1
• dependabot/go_modules/operator/github.com/onsi/gomega-1.42.1
• dependabot/go_modules/operator/github.com/prometheus/client_golang-1.24.0
• dependabot/go_modules/operator/github.com/prometheus/client_golang-1.24.1
• dependabot/go_modules/operator/github.com/sethvargo/go-envconfig-1.4.0
• dependabot/go_modules/operator/github.com/sethvargo/go-envconfig-1.4.3
• dependabot/go_modules/operator/github.com/spf13/pflag-1.0.10
• dependabot/go_modules/operator/github.com/stretchr/testify-1.12.1
• dependabot/go_modules/operator/go.opentelemetry.io/otel/exporters/otlp/otlptrace-1.45.0
• dependabot/go_modules/operator/go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc-1.45.0
• dependabot/go_modules/operator/go.opentelemetry.io/otel/sdk-1.43.0
• dependabot/go_modules/operator/go.opentelemetry.io/otel/sdk-1.45.0
• dependabot/go_modules/operator/go.uber.org/zap-1.28.0
• dependabot/go_modules/operator/golang-x-022d82f60c
• dependabot/go_modules/operator/golang-x-f4f1f3a0f0
• dependabot/go_modules/operator/google.golang.org/grpc-1.82.1
• dependabot/go_modules/operator/google.golang.org/grpc-1.83.1
• dependabot/go_modules/operator/google.golang.org/grpc-1.83.2
• dependabot/go_modules/operator/kubernetes-44e4af7f7b
• dependabot/go_modules/operator/kubernetes-c00f186a85
• docs/374-stale-annotation-refs
• docs/agent-image-path
• docs/jobs-migration-stale-refs
• docs/migration-window-v0.21
• docs/release-validation-suite
• efe/cli-kubeconfig-tests
• efe/fix-cli-node-status
• efe/fix-drain-blocked-error-state
• efe/fix-inflight-batch-capacity
• efe/fix-printgraph-errors
• efe/fix-record-restarts-best-effort
• efe/fix-serial-interrupt-wait
• efe/fix-stale-failure-status
• feat+per-platform-sbom-vex
• feat/382-job-node-keyed-queue
• feat/436-nodewright-namespace
• feat/439-runtime-required-taint-key
• feat/541-drain-blocked-condition
• feat/817-chart-taint-schema
• feat/agent-go-cutover-222
• feat/cli-update-state
• feat/ctlptl-local-registry
• feat/metrics-rename
• feat/oras-operator-artifact-pods
• feat/oras-package-artifacts
• feat/skyhook-ready-condition
• feat/uninstall-enhancement-collapsed
• feat/webhook-bootstrap-lease
• feature/package-as-jobs
• fix-agent-go-sigterm-672
• fix-chart-bump
• fix-issue-588
• fix/306-surface-image-pull-failures
• fix/403-event-text-rename
• fix/403-text-rename
• fix/428-433-failed-attempts-and-handoff
• fix/440-chart-hardcoded-names
• fix/447-preserve-foreign-taints
• fix/451-finalizer-merge-patch
• fix/456-dp-webhook-cache-race
• fix/495-release-notes-promotion
• fix/538-notices-stdlib-ignore
• fix/580-observed-generation-delete
• fix/587-sticky-batch-starvation
• fix/603-taint-blocked-flap
• fix/631-rc-latest-tag
• fix/632-eviction-throttle
• fix/633-stale-erroring-after-reboot
• fix/675-agent-image-guard
• fix/702-autotaint-annotation-key
• fix/704-autotaint-failure-isolation
• fix/715-719-drain-blocked-followups
• fix/729-chart-notice
• fix/731-admission-rejections-restarts
• fix/738-crashloop-interrupt
• fix/739-erroring-entry-genuine
• fix/759-external-cordon
• fix/770-interrupt-memory
• fix/776-config-update-reset-gate
• fix/776-inflight-config-completion
• fix/776-own-interrupt-owed
• fix/776-reset-clears-config-updates
• fix/790-atomic-cert-key-writes
• fix/791-cert-write-error
• fix/838-ci-gate
• fix/api-rename
• fix/chart
• fix/chart-pdb-replicas-type-mismatch
• fix/chart-selector-migration
• fix/check-upsert-error-interrupt
• fix/cli-version-examples
• fix/cordon-before-drain-533
• fix/cordon-ownership
• fix/core-e2e-flakiness-cleanup-timeout-catch
• fix/dag-strands-dependency-free-package
• fix/deploymentpolicy-webhook-cache-delete
• fix/distroless-registry-resolution
• fix/docs-restructure
• fix/downgrade-after-uninstall-cleanup
• fix/drain-blocked-condition-542
• fix/drain-exempt-package-pods-by-label
• fix/drain-waits-for-terminating-534
• fix/flaky-config-sync-gate-test
• fix/fully-qualify-kubectl-image
• fix/issue-224-release-attestations
• fix/issue-238-k8s-test-versions
• fix/issue-259-drain-config
• fix/issue-500
• fix/makefile_namechange
• fix/operator-events-rbac
• fix/package-image-port-parsing
• fix/per-node-uninstall-cycle
• fix/quantity-semantic-compare
• fix/reap-old-logs-retry-budget
• fix/reject-inline-image-digest
• fix/rollback-webhook-bootstrap-lease
• fix/runtime-required-cordon-conflict
• fix/scope-package-pod-watch
• fix/skip-issue
• fix/uninstall-cancel-cleanup-timeout
• fix/update-changelog-generation
• jobs-migration/300-annotation-helpers
• jobs-migration/301-job-builders
• jobs-migration/302-job-controller
• jobs-migration/302b-job-reconcile
• jobs-migration/302c-job-reconcile
• jobs-migration/303a-swap
• jobs-migration/303b-pause-suspend
• jobs-migration/304-e2e-jobs
• jobs-migration/305-release-notes
• jobs-migration/372-chart-job-env-options
• jobs-migration/373-timeout-retry
• jobs-migration/397-flaky-metrics-timeout
• jobs-migration/411-disable-no-resume
• jobs-migration/411-nodestate-lost-update
• jobs-migration/426-interrupt-resurrect
• jobs-migration/430-docs-surfaces
• main
• release-bump-chart
• release-chart
• renovate/ginkgo
• renovate/github.com-arttor-helmify-0.x
• renovate/github.com-boumenot-gocover-cobertura-1.x
• renovate/github.com-mikefarah-yq-v4-4.x
• renovate/github.com-onsi-gomega-1.x
• renovate/github.com-prometheus-client_golang-1.x
• renovate/github.com-prometheus-client_model-0.x
• renovate/github.com-sethvargo-go-envconfig-2.x
• renovate/github.com-vektra-mockery-v3-3.x
• renovate/go-toolchain
• renovate/golang-x
• renovate/golang.org-x-vuln-1.x
• renovate/golangci-golangci-lint-2.x
• renovate/helm-helm-4.x
• renovate/kubernetes
• renovate/sigs.k8s.io-controller-tools-0.x
• renovate/sigs.k8s.io-kustomize-kustomize-v5-5.x
• renovate/tilt-dev-ctlptl-0.x
• rsarvaiya/backport-v0.15-controller-anti-affinity
• rsarvaiya/controller-replica-anti-affinity
• rsarvaiya/fix-stale-antiaffinity-comment
• runtime-required-cordon
• tdaugherty/operator-picker-reboot-tolerations
• tdaugherty/operator-pprof-endpoint
• tdaugherty/operator-reboot-write-resilience
• tdaugherty/operator-reduce-reconcile-allocations
• tdaugherty/operator-status-merge-patches
• test-gate-operator-agent-assertions-680
• test-service-interrupt-e2e-679
• test/776-config-reset-clears-jobs
• test/nodewright-upgrade-migration
• test/sigterm-grace-assertion-and-agent-notes
• test/unit-coverage-pure-logic
• update-ci-signing
• update-docs
• update-docs-chart
• worktree-chore+go-bump
• worktree-chore+update-golang
• worktree-ci-test-pools
• worktree-config-bug
• worktree-configmap-clobber-bug
• worktree-feat+auto-taint-on-reboot-tracking
• worktree-investigate-reapply-reboot
• worktree-workqueue-experinment

Build # 39859263756

Build Type

push

github

Committed by web-flow

Commit Message

fix(operator): isolate reboot bookkeeping failures (#854)

A rejected reboot write must not stop unrelated rollouts or let workloads
schedule before packages are reapplied. Preserve the taint and retry state
without leaking failed writes through later status saves.

Keep cleanup holds scoped to the affected NodeWright and node, preserve
disabled-NodeWright progress, and avoid repeated resets while ensuring a
reboot starts a fresh drain deadline.

Closes #851

Signed-off-by: Taylor Daugherty <tdaugherty@nvidia.com>

Coverage Stats

125 of 129 new or added lines in 2 files covered. (96.9%)

10202 of 12166 relevant lines covered (83.86%)

7.61 hits per line