ghga-de / ghga-connector

79%

LAST BUILD ON BRANCH main

branch: main

CHANGE BRANCH

x

Reset

Sync Branches

• main
• 0.1.0
• 0.1.1
• 0.1.2
• 0.1.3
• 0.1.4
• 0.2.10
• 0.2.11
• 0.2.12
• 0.2.2
• 0.2.3
• 0.2.4
• 0.2.5
• 0.2.6
• 0.2.9
• 0.3.0
• 0.3.1
• 0.3.10
• 0.3.11
• 0.3.12
• 0.3.13
• 0.3.14
• 0.3.2
• 0.3.3
• 0.3.5
• 0.3.6
• 0.3.7
• 0.3.8
• 0.3.9
• 1.0.0
• 1.1.0
• 1.1.1
• 1.1.2
• 1.2.1
• 1.3.0
• 1.4.0
• 1.4.1
• 1.4.2
• 1.5.0
• 1.5.1
• 1.6.0
• 1.7.0
• 1.7.1
• 1.7.2
• 1.7.3
• 1.8.0
• akyumurkov-patch-1
• bugfix/switch_upload_to_pycurl_requests
• debug/hishel_logging
• dev
• expect_decrypt_wpa_token_GIS-49
• feature/905_suggestions
• feature/abstract_logger_GDEV-904
• feature/add_dockerfile_GDEV-1435
• feature/async-cli-with-wrapper
• feature/batch_download_information_GDEV-1818
• feature/batchprocessing_GDEV-1819
• feature/big_refactor/flatten_cli
• feature/big_refactor/low_impact_high_LOC_refactoring
• feature/big_refactor/misc_refactoring
• feature/big_refactor/param_pruning
• feature/big_refactor/refactor_config
• feature/big_refactor/untangle_classes
• feature/big_refactor_GSI-1859
• feature/bump_commons
• feature/caching_GSI-1235
• feature/check_if_file_encrypted_GDEV-1703
• feature/cleanup-urls-from-wkvs
• feature/configurable_user_agent
• feature/decryption_command_GSI-85
• feature/default_wkvs_api_url_GSI-287
• feature/dl_in_progress_names_GDEV-1820
• feature/dl_progress_bar_GSI-664
• feature/downloaded_file_checks_GSI-46
• feature/encrypt_file_GDEV-1705
• feature/file_post_iterators_GDEV-899
• feature/fix_gaps_in_messages_GSI-304
• feature/fix_github_actions_GDEV-880
• feature/global_config_GDEV-1020
• feature/hexkit_v4_GSI-1343
• feature/hide_upload_functionality_GSI-237
• feature/httpyexception_ids_GDEV-1014
• feature/implement_parallelization_GDEV-1712
• feature/improve-decrypt-command
• feature/improve-file-stager
• feature/improve-prompt-for-token
• feature/make_user_friendly_GSI-236
• feature/multiple_file_download_GDEV-1571
• feature/prepare_release_GSI-189
• feature/refactor_to_new_api_GDEV-898
• feature/relax-hexkit-requirement
• feature/remove_chassis_lib_GSI-193
• feature/remove_requests_dep
• feature/request_session_GDEV-1405
• feature/requests_to_httpx_GSI-191
• feature/retry_logic_decorator_GDEV-901
• feature/separate_core_and_cli_GDEV-905
• feature/small_improvements_GDEV-1017
• feature/test_multiple_py_versions
• feature/timeout-and-errors-GSI-537
• feature/transmit_public_key_GDEV-1501
• feature/transport_based_retry_ratelimiting
• feature/up_down_context_GDEV_900
• feature/update-dependencies
• feature/update-dependencies-GIM-450
• feature/update-dependencies-GIM-673
• feature/update-dependency-version-gsc
• feature/update-pypi-worklow
• feature/update-readme-0.3.x
• feature/update-template
• feature/update-timeout-in-previous-version
• feature/update_template_GSI-225
• feature/upload_path_GSI-1860
• feature/use_mock_router_GSI-326
• feature/use_pytest_httpxmock_GSI-192
• feature/windows_macos_runners
• feauture/change_exponential_backoff
• fine_grained_exception_handling_GDEV-902
• fix/chassis_lib_dependency
• fix/check_url_timeout
• fix/crossplatform_dependency_issues
• fix/dcs-endpoint-for-getting-envelopes
• fix/download_issues_GSI-231
• fix/download_retry_logic
• fix/downloading-small-files
• fix/encrypted_private_key_passphrase
• fix/fetching-work-order-token
• fix/fix_tests_part_size
• fix/improve_donwload_experience
• fix/memory_issues
• fix/patch_multipart
• fix/pubkey_field
• fix/pypi
• fix/pypi_publish
• fix/pypi_publish_action
• fix/range_header_download_GDEV-882
• fix/remove_redirect_logic_GDEV-1647
• fix/retry_logic_enhancement
• fix/retry_logic_presigned_url
• fix/s3_dependency_issues
• fix/saner_package_exports
• fix/setuptools_version
• fix/update-from-template
• fix/update_dependencies_GDEV-1568
• handover_documentation_GSI-165
• multipart_download_GDEV-752
• multipart_upload_GDEV-754
• pycurl_to_requests_GDEV-897
• reactoring_continue_GSI-245
• refactoring_GSI-245
• release-0.3.x
• replace_dummy_wps_call_GSI-50
• retrieve_work_order_tokens_GSI-51
• sefeature/send_pubkey_GDEV-1571
• sugg2_GDEV-752
• suggestions/GDEV-901
• template_migration_GSI-384
• template_update
• test_jitter
• update_lock_files
• update_mypy
• update_pypi_GSI-294
• update_template_files
• upload_refactoring_GSI-265
• v1
• v1.4.1

Build # 19494939692

Build Type

push

github

Committed by web-flow

Commit Message

Upload Path (GSI-1860) (#122)

* Commit initial changes to upload path

* Tweaks to code and add some tests

* Add basic tests for upload

* Provide a clean way to perform batch uploads

* Move encrypted file size calc to Encryptor class

* Rename function for accuracy

* Adapt UploadClient for new transport

* Fix encrypted_is_empty() & document + refactor process_file()

* Strip paths

Co-authored-by: Thomas Zajac <thomas-jakob.zajac@uni-tuebingen.de>

* Condense 401 and 403 in match case with same actions for each

Co-authored-by: Thomas Zajac <thomas-jakob.zajac@uni-tuebingen.de>

* Remove stray print in test_cli.py

* Fix Bearer token string in UploadClient calls

* Simplify and consolidate the three top-level file upload errors

* Update src/ghga_connector/exceptions.py

Co-authored-by: Thomas Zajac <thomas-jakob.zajac@uni-tuebingen.de>

* Convert BatchUploader into a function and restrict config parameters

* Add file path debug log

* Resolve file path to uploaded files

* Improve global config access for testing patching

* Simply checksum access by making members public

* Make FileUpload deletion error also subclass _FileUploadError and include a reason

---------

Co-authored-by: Thomas Zajac <thomas-jakob.zajac@uni-tuebingen.de>

Run Details

355 of 434 new or added lines in 15 files covered. (81.8%)

20 existing lines in 6 files now uncovered.

1126 of 1421 relevant lines covered (79.24%)

0.79 hits per line