kubeflow / sdk

86%

main: 86%

LAST BUILD ON BRANCH feat/spark-notebooks-635

branch: SELECT

CHANGE BRANCH

x

Sync Branches

• No branch selected
• 0.1.0
• 0.1.0rc1
• 0.2.0
• 0.2.1
• 0.3.0
• 0.4-readme
• E2E-improve
• E2E-workflow-tutorial
• KEP-281
• KEP-285
• add-adopters-md
• add-coverage-badge
• add-dependabot
• add-git-cliff
• add-kfp-kubeflow-client
• add-kubeflow-hub-owners-file
• add-labels-annotations-support#87
• add-mcp-docs
• add-ok-to-test-workflow
• add-pre-commit-ci
• add-proposal-title
• add-runtime-kind-support
• add-sdk-docs-workflow
• add-spark-to-roadmap
• agent.md
• ai-policy
• allow-trainjob-naming
• auto-release
• backend-public
• bump-release-0.4.0
• bump-spark
• bump-trainer-2.1
• bump-trainer-2.3
• bump-trainer-api
• cache
• check
• cherry-pick-103-to-release-0.1
• cherry-pick-154-to-release-0.2
• cherry-pick-157-to-release-0.2
• cherry-pick-162-to-release-0.2
• cherry-pick-166-to-release-0.2
• cherry-pick-168-to-release-0.2
• cherry-pick-177-to-release-0.2
• cherry-pick-319-to-release-0.4
• cherry-pick-406-to-release-0.4
• cherry-pick-426-to-release-0.4
• cherry-pick-427-to-release-0.4
• cherry-pick-527-to-release-0.4
• cherry-pick-k8s-pin-release-0.4
• chore/fix-update-overrides-header-loss
• chore/fix-welcome-workflow
• chore/replace-pyspark-connect-781
• ci-permissions
• claude-md
• copilot-review
• copilot/add-feast-to-kubeflow-sdk
• coveralls-parallel
• custom-trainer-container
• cve-fix-urllib
• cve-workflow
• dependabot/github_actions/actions-24edcfd16d
• dependabot/github_actions/actions-83bd6e4a5a
• dependabot/github_actions/actions-9a9d1462bb
• dependabot/github_actions/actions-9bddd90c58
• dependabot/github_actions/actions-b20fae3664
• dependabot/github_actions/actions/checkout-6
• dependabot/github_actions/actions/checkout-7
• dependabot/github_actions/actions/download-artifact-6
• dependabot/github_actions/actions/download-artifact-7
• dependabot/github_actions/actions/download-artifact-8
• dependabot/github_actions/actions/github-script-8
• dependabot/github_actions/actions/github-script-9
• dependabot/github_actions/actions/setup-python-6
• dependabot/github_actions/actions/setup-python-7
• dependabot/github_actions/actions/stale-10
• dependabot/github_actions/actions/upload-artifact-6
• dependabot/github_actions/actions/upload-artifact-7
• dependabot/github_actions/amannn/action-semantic-pull-request-6.1.1
• dependabot/github_actions/astral-sh/setup-uv-7
• dependabot/github_actions/peter-evans/create-pull-request-8
• dependabot/github_actions/softprops/action-gh-release-2
• dependabot/github_actions/softprops/action-gh-release-3
• dependabot/uv/kubernetes-35.0.0
• dependabot/uv/kubernetes-36.0.0
• dependabot/uv/pyspark-connect--4.1.1
• dependabot/uv/pytest-8.4.2
• dependabot/uv/pytest-9.0.2
• dependabot/uv/python-minor-1812016990
• dependabot/uv/python-minor-1de9a2ddab
• dependabot/uv/python-minor-2008970092
• dependabot/uv/python-minor-4ddbf8e6ec
• dependabot/uv/python-minor-5039de901b
• dependabot/uv/python-minor-5288a0767a
• dependabot/uv/python-minor-5cdf07d101
• dependabot/uv/python-minor-61619d321f
• dependabot/uv/python-minor-6992db0600
• dependabot/uv/python-minor-886ccf62b3
• dependabot/uv/python-minor-887caeb744
• dependabot/uv/python-minor-9e16fb77e0
• dependabot/uv/python-minor-a656a3a4ac
• dependabot/uv/python-minor-b81f01546e
• dependabot/uv/python-minor-b968e2b98b
• dependabot/uv/python-minor-df86ee5833
• dependabot/uv/python-minor-f70e0541ac
• dependabot/uv/python-minor-fdeb95912b
• dependabot/uv/python-minor-fdf78648e3
• dev-testing
• diagram-spark
• dict-unpack
• doc/update-list-runtimes
• docker-backend
• docs-trainer-runtimepatch
• docs/API-reference
• docs/initializers-guide
• docs/issue-737-spark-examples-readme
• docs/local-development
• docs/local-development-guide
• docs/sdk-doc-improvements
• docs/spark
• docs/update-agents-trainer-section
• drop-py39-support
• e2e-readme
• examples/iceberg-minio
• export-custom-trainer-container
• feat-connect-timeout
• feat-spark-connect-namespace-rbac
• feat/171-add-initializer-support-container-backend
• feat/active-deadline-seconds
• feat/add-job-exists-380
• feat/add-mig-device-support
• feat/add-torchtune-loss-functions-v2
• feat/container-gpu-passthrough
• feat/docs-trainer-options-runtimepatch
• feat/dynamic-allocation
• feat/initializers/s3
• feat/issue-475-upload-artifact-utility
• feat/kep-spark-client
• feat/logging-system-v2
• feat/lora-support
• feat/move-shared-test-helpers
• feat/optimizationjob-native-backend
• feat/parallel-initializers-290
• feat/shell-lint-ci
• feat/spark-notebooks-635
• feat/sparkclient-mvp
• feat/trainjobtemplate-train-optimize
• feat/wait-for-pod-logs
• feature-funjob
• feature/customtrainer-python-file
• feature/structured-logging
• feature/submit-job
• feature/support-multiple-pip-index-urls-clean
• fix-317-get-job-logs-strict
• fix-550-polling-interval-validation
• fix-cluster-runtime-fallback
• fix-copy-get-packages
• fix-e2e
• fix-events-parse
• fix-falsy-configs
• fix-first-time-ci
• fix-follow-logs
• fix-gcliff-config
• fix-git-cliff-patch-release
• fix-gitcliff
• fix-image-runtime
• fix-issue-566
• fix-issue-663
• fix-memory-kubernetes-to-spark
• fix-pep-668
• fix-pip-install
• fix-pip-user-issue
• fix-readthedocs
• fix-release-script
• fix-s3-initializer
• fix-spark-467
• fix-spark-746
• fix-spark-docs-736
• fix-test-e2e
• fix-trainjob-leak
• fix/container-polling-interval-validation
• fix/container-status-unknown
• fix/deduplicate-trainjob-pods
• fix/docs-nav-broken-links
• fix/filter-duplicate-pods-in-get-job
• fix/hf-model-storage-uri
• fix/hub-register-model-storage-params
• fix/import-trainer
• fix/job-status-fallback
• fix/kubernetes-log-streaming-compatibility
• fix/local-job-status-338
• fix/localjob-race-condition-356
• fix/localprocess-log-streaming
• fix/namespace-trainingruntime-list
• fix/pin-kubernetes-client-v36-regressions
• fix/pipelines-kfp-release
• fix/polling-interval-validation
• fix/race-condition-localjob-chdir
• fix/remove-torch-num-proc-per-node
• fix/rename-needs-triage-label
• fix/spark-connect-default-sa-fallback
• fix/spark-connect-service-name-fallback
• fix/spark-connect-state-model
• fix/spark-connect-state-unknown-cleanup
• fix/spark-connect-url-hostname-validation
• fix/spark-docs-broken-rst-link
• fix/spark-example-backend-config-arg
• fix/spark-lint-enforcement-and-type-hardening
• fix/spark-remove-pod-template-override
• fix/spark-utils-cpu-validation
• fix/trainer-remove-hf-storage-uri-validation
• fix/trainer-stop-iteration-container-lookup
• flaky-test-fix
• from-exception
• get-best-results
• get-job-logs-opt
• get-job-logs-refactor
• get-runtime-packages
• hatchling-package
• hpo-new-apis
• hpo-proposal
• hpo-support
• hub-ty
• image-issue
• improve-logging
• improve-system-namespace-error-message
• install-as-user
• issue-638-shared-script-template
• kep-107-typed-enums
• kep-125
• kep-125-update
• kubeflow-hub-api
• kubeflow-hub-approver-jonburdo
• kubernetes-backend
• latest-news
• local-exec-proposal
• local-exec-readme
• localprocess-backend-test
• lockfile-workflow
• loop/kubeflow__001
• main
• makefile
• model-registry-0.3.6
• move-dev-to-deps
• move-keps
• move-pyproject
• muhammadjunaid8047/275
• nominate-kramaranya
• optimiser-testing
• optimizer-container
• options-api
• options-submit_job
• osamaahmed17/195
• osamaahmed17/203
• osamaahmed17/227
• osv-scanner
• patch-1
• patch-10
• patch-4
• patch-8
• podman-backend
• pr-01
• pr-02
• pr-03
• pr-05
• pr-06
• pr-197
• pr-titles-check
• pr3487/sdk-writable-script-path
• prepare-release-0.4.1
• prepare-release-0.5
• prepare-release-0.5.0rc0
• prerelease-update
• prow-release-doc
• pyasn1-cve
• rc-release
• refactor/rename-sparkconnect-driver-pod-name
• refactor/spark-pypi-models
• refactor/spark-remove-manual-type-validation
• refactor/spark-tests-273
• release-0.3
• remove-accelerator-type
• remove-pip-user-from-local
• remove-spark-job-default-service-account
• remove-trivy-action
• remove-validate
• roadmap
• roadmap-2026
• ruff-config
• runtime-framework-labels
• runtime-patches
• sdk-fix
• sdk-website
• security-nightly-updates
• set-api-deps-versions
• skip-release-on-forks
• spark-conf-feature
• spark-diagram
• spark-docs
• spark-docs-examples
• spark-e2e-robustness
• spark_test
• sparkclient-long-running-job-submission
• support_npu_label
• test/add-builtin-trainer-utils-coverage
• test/spark-client-coverage
• tier1-agents-scaffolding
• tpu-multislice-util
• trainer-backend-version-clean
• training-backends
• training-progression
• unit-test
• update-approvers
• update-contrib
• update-e2e
• update-pyspark-dependency
• update-readme
• update-readme-hpo
• update-reviewers
• update-roadmap
• update-sdk-diagram
• upgrade-code-style-for-python3.10
• upgrade-to-python3.10
• upgrade-uv-lock-model-registry-0.3.9
• urllib3-update
• use-uv-dependabot
• validate-lockfile-workflow
• wait-for-job-api
• welcome-ci
• wf-ok-to-test

Build # 35433120921

Build Type

Pull #796

github

Committed by web-flow

Commit Message

Merge 5c438e007 into 3febcd737

Pull Request Pull Request #796: feat(spark): convert Spark batch job lifecycle examples to Jupyter notebooks

Coverage Stats

6342 of 7417 relevant lines covered (85.51%)

1.71 hits per line