uc-cdis / gen3-workflow

84%

master: 85%

LAST BUILD ON BRANCH 0.3.0

branch: 0.3.0

CHANGE BRANCH

x

Reset

Sync Branches

• 0.3.0
• 0.1.0
• 0.2.0
• 0.3.1
• 2026.02
• 2026.03
• 2026.04
• 2026.05
• 2026.06
• 2026.07
• 2026.08
• ClientDisconnect-499
• authz-refactor
• cache-bucket
• chore/add_aws_utils_unit_test
• chore/add_awshelper_yaml_kind_setup
• chore/add_delete_object_s3
• chore/add_gh_action_integration_tests
• chore/add_helm_deployment_doc
• chore/create_iam_role_for_worker_pods
• chore/create_karpenter_resources
• chore/delete_bucket_false
• chore/delete_storage_bucket
• chore/fix_metrics_endpoint
• chore/fix_user_bucket_path
• chore/kind-setup
• chore/kubeapi_endpoints
• chore/remove_eks_cluster_dependency
• chore/remove_wool_add_req_lint_check
• chore/skip_poetry_install_at_launch
• chore/skip_poetry_install_upon_launch
• chore/test_docker_build
• chore/update_kind_ci
• debug-chunk
• debug-logs
• debug-token
• debug/add_s3_logs
• debug/client_disconnect
• debug/test_wf_branch
• delete-objects-versions
• dependabot/pip/alembic-1.14.1
• dependabot/pip/alembic-1.15.1
• dependabot/pip/alembic-1.15.2
• dependabot/pip/authutils-6.2.6
• dependabot/pip/authutils-7.2.7
• dependabot/pip/boto3-1.35.92
• dependabot/pip/boto3-1.35.97
• dependabot/pip/boto3-1.36.11
• dependabot/pip/boto3-1.36.16
• dependabot/pip/boto3-1.36.2
• dependabot/pip/boto3-1.36.21
• dependabot/pip/boto3-1.36.6
• dependabot/pip/boto3-1.37.13
• dependabot/pip/boto3-1.37.18
• dependabot/pip/boto3-1.37.23
• dependabot/pip/boto3-1.37.4
• dependabot/pip/boto3-1.37.9
• dependabot/pip/boto3-1.42.97
• dependabot/pip/botocore-1.42.97
• dependabot/pip/botocore-1.43.20
• dependabot/pip/botocore-1.43.24
• dependabot/pip/botocore-1.43.29
• dependabot/pip/botocore-1.43.34
• dependabot/pip/botocore-1.43.36
• dependabot/pip/botocore-1.43.40
• dependabot/pip/botocore-1.43.46
• dependabot/pip/botocore-1.43.51
• dependabot/pip/botocore-1.43.56
• dependabot/pip/fastapi-0.115.11
• dependabot/pip/fastapi-0.115.12
• dependabot/pip/fastapi-0.115.7
• dependabot/pip/fastapi-0.115.8
• dependabot/pip/fastapi-0.136.1
• dependabot/pip/fastapi-0.136.3
• dependabot/pip/fastapi-0.137.1
• dependabot/pip/fastapi-0.138.0
• dependabot/pip/fastapi-0.138.2
• dependabot/pip/fastapi-0.139.0
• dependabot/pip/fastapi-0.139.2
• dependabot/pip/fastapi-0.140.6
• dependabot/pip/gunicorn-25.3.0
• dependabot/pip/gunicorn-26.0.0
• dependabot/pip/moto-5.0.26
• dependabot/pip/moto-5.0.27
• dependabot/pip/moto-5.0.28
• dependabot/pip/moto-5.1.1
• dependabot/pip/moto-5.2.0
• dependabot/pip/moto-5.2.1
• dependabot/pip/moto-5.2.2
• dependabot/pip/pip-8981c3388c
• dependabot/pip/pip-c30c77f42d
• dependabot/pip/pytest-8.3.5
• dependabot/pip/pytest-9.1.1
• dependabot/pip/pytest-asyncio-0.25.2
• dependabot/pip/pytest-asyncio-0.25.3
• dependabot/pip/pytest-asyncio-0.26.0
• dependabot/pip/sqlalchemy-2.0.37
• dependabot/pip/sqlalchemy-2.0.38
• dependabot/pip/sqlalchemy-2.0.39
• dependabot/pip/sqlalchemy-2.0.40
• dependabot/pip/starlette-1.1.0
• dependabot/pip/starlette-1.2.1
• dependabot/pip/starlette-1.3.1
• dependabot/pip/uvicorn-0.46.0
• dependabot/pip/uvicorn-0.47.0
• dependabot/pip/uvicorn-0.48.0
• dependabot/pip/uvicorn-0.49.0
• dependabot/pip/uvicorn-0.50.2
• docs/user_facing_doc
• feat/3.13
• feat/_IMAGE_PULL_POLICY
• feat/add_prometheus
• feat/encrypt-and-lifecycle-pol
• feat/plugin-support
• feat/s3-bearer
• feat/s3-endpoint
• feat/s3-endpoint2
• feat/s3Files
• fix-400
• fix-chunks
• fix-minio-nextflow
• fix-setup-storage-authz
• fix/chunk
• fix/iam_policy_document
• fix/linting
• fix/not-JSON-serializable
• fix/pre-filter-task-list
• fix/s3-calls
• fix/s3Files_hotfixes
• fix/support_other_bucket_regions
• fix/verify_before_bucket_create
• free-space
• integration202602
• integration202603
• integration202604
• integration202605
• integration202606
• integration202607
• integration202608
• integration_tests_on_kind
• master
• misc-improvements
• misc-improvements-clean
• multipart-support
• no-reload
• nss10-patch-1
• nss10-patch-2
• nss10-patch-3
• paulineribeyre-patch-1
• perf
• range-header
• retry-OperationAborted
• retry-s3
• stable
• support-kind
• tes-errs
• test-minio-go
• test/add_kms_info
• test/allow_mock_auth
• test/dummy_pr_to_test_netpols
• test/plugin-support-with-logs
• test/print-headers
• ui
• update-deps
• update/authutils_8
• wait-for-bucket

Build # 30568947099

Build Type

push

github

Committed by web-flow

Commit Message

Add Amazon S3Files support for Gen3Workflow (#170)

*Enable bucket versioning
* Update EKS security group filter to use EKS group name
* Create dynamic IAM role for S3Files
* Add STORAGE_TYPE config variable, add documentation for s3files
* Make S3Files a configurable setup
* Make mount target provisioning a bgTask + Update docs
* Re-organize aws_utils into aws.bucket, aws.aws_utils, aws.clients.
* Add unit tests for S3Files
* Make security group field configurable and add docs on how to fetch them

Coverage Stats

972 of 1152 relevant lines covered (84.38%)

0.84 hits per line