ICRAR / daliuge

68%

master: 79%

LAST BUILD ON BRANCH features/liu-16

branch: features/liu-16

CHANGE BRANCH

x

Reset

• features/liu-16
• 2022-03-doxygen-fixes
• 406
• LIU-103
• LIU-116-docker-drops
• LIU-116-dockerservice-drops
• LIU-116-enddrop
• LIU-116-service-drops
• LIU-117-plasmaflight
• LIU-128
• LIU-186
• LIU-198
• LIU-213
• LIU-213-doxygen
• LIU-216
• LIU-251
• LIU-251-app-params
• LIU-251-extra
• LIU-251-pyfunc-simplify
• LIU-251-rebase
• LIU-253
• LIU-276
• LIU-280
• LIU-284
• LIU-285
• LIU-303
• LIU-306
• LIU-318
• LIU-368
• LIU-368-AddServicesToAllowPersistence
• LIU-375_SupportInputNamedPortsForFile
• LIU-382
• LIU-383
• LIU-383_DangerousDefaults
• LIU-385
• LIU-385_SubGraphDrops
• LIU-388_UpdatePGGenTests
• LIU-392
• LIU-395
• LIU-396
• LIU-396-Tests
• LIU-402
• LIU-403
• LIU-404
• LIU-406
• LIU-407
• LIU-408
• LIU-412
• LIU-413
• LIU-416
• LIU-417
• LIU-42
• LIU-420
• LIU-423
• LIU-427
• LIU-438
• LIU-439
• LIU-444
• LIU-448
• LIU-65
• LIU-67
• LIU-68
• LIU-74
• LIU-82
• LIU-86
• LIU-93
• LIU-96
• LIU390-RemovePlasmaAndPyArrow
• Makefile_fix
• OoD-Cld
• S3drop
• TerminateGraphOnRequest-8.3
• YAN-351_Installation
• YAN-678
• YAN-708
• YAN-853
• YAN-858
• YAN-882-gather
• YAN-882-plasmaflight
• YAN-913
• YAN-913-async-exec
• YAN-913-casacore
• YAN-913-casacore-testing
• YAN-913-rebase
• YAN-913-streaming
• YAN-969-docs
• additions
• adjust-build-replicate
• argparse
• autodoc_fix
• avahi-trans-fix
• bash-port-values
• bugfix-unpartitioned-graph-labels
• cgray_dependencies
• create-missing-workdir
• cuda_deploy
• cwl-27-fixes
• daliuge-187
• dead-code
• debug-py27-error
• delayed
• delayed_fixes
• dependabot/pip/daliuge-common/pydantic-1.10.13
• devall-docker
• docker_fix
• docs-cleanup
• docs_fix-missing-install
• docs_update
• documentation-fix
• doxygentest
• eagle-1137
• eagle-1184
• eagle-1194
• eagle-121
• eagle-1231
• eagle-1231-2
• eagle-1269
• eagle-211
• eagle-273
• eagle-350
• eagle-402
• eagle-505
• eagle-535
• eagle-550
• eagle-614
• eagle-651
• eagle-828
• eagle-869
• eagle-869-2
• eagle-979
• eagle-991
• eagle-991-2
• eagle-pi-schema-update
• engine-web-ui
• feature/export-cwl
• feature/graph-updater-4
• feature/lgweb-post-lg
• feature/node-attributes
• fix-3.9-crashes
• fix-broken-expansion
• fix-dlg-submit
• fix-indexerror
• fix_cors_issue
• fix_positional_arguments
• fix_readme_and_docs
• fix_server_genpgt_nodelist
• github-actions
• graph-enabler
• graph_fixes
• inspection
• latest-fixes
• lazy-logging-formatting
• lg-fill
• lg-refactor
• lg-web-echart
• lg-web-ui
• lg_web-graph-downloads
• liu-101
• liu-102
• liu-104
• liu-111
• liu-120
• liu-121
• liu-123
• liu-124
• liu-125
• liu-126
• liu-150
• liu-153
• liu-155
• liu-163
• liu-168
• liu-169
• liu-169-2
• liu-171
• liu-173
• liu-184
• liu-186-2
• liu-186-post-changes
• liu-189
• liu-193
• liu-194
• liu-195
• liu-205
• liu-207
• liu-216
• liu-220
• liu-221
• liu-222
• liu-226
• liu-227
• liu-228
• liu-232
• liu-233
• liu-234
• liu-235
• liu-236
• liu-247
• liu-248
• liu-249
• liu-256
• liu-257
• liu-261
• liu-262-data-component-default-ports
• liu-264
• liu-265
• liu-272
• liu-277
• liu-28
• liu-281
• liu-282
• liu-284-log-uncaught-exceptions
• liu-286
• liu-29
• liu-290
• liu-291
• liu-294
• liu-296
• liu-304
• liu-308-persist-flag
• liu-314
• liu-322-top-level-catch
• liu-332
• liu-338
• liu-343
• liu-343-mkn
• liu-345
• liu-348
• liu-349
• liu-353
• liu-354
• liu-355
• liu-361
• liu-365
• liu-367
• liu-377
• liu-418
• liu-449
• liu-51
• liu-53-docker-working-dir
• liu-66
• liu-67
• liu-68
• liu-87
• liu-90
• lui-189
• mab-ood-cld
• manager-termination
• master
• mergeIssues
• messaging-consolidation
• messaging-consolidation-take2
• move-io
• mpi_fixes
• ms-mpi
• multiproc-drop-apps
• multiproc-drop-apps-julian
• name_fix
• named-ports
• new-slim
• ngasLite_mods
• nm-web-fix
• node-experiments
• ood-cld
• openapi
• openapi-tests-fix
• patch-daemon-tests
• pg-generator-refactor
• pin-pyarrow
• plasma
• plasmaflight-fixes
• popArg-refactor
• pre-0.6.1
• pyfunc_code
• python3-only
• pyzmq-lock
• ray_test
• rbunney_mpi_fixes
• remove-logspam-from-testrunner
• remove_parset_duplicates
• removing-lgweb
• reprocleanup
• ryan_mpi_fixes
• separate-packages
• session_status_html_update
• simple-translator
• skip-mp-tests
• skip-zmq-resubscriptions
• slurm-remote
• speedup-remove-unmet-dependencies
• split-translator
• streaming-consumer-fix
• summit-latest
• test_daemon_issues
• travis-fix
• travis-fixes
• triggering-fix
• update-posargs-graphenabler
• v0.5.0
• v0.5.1
• v0.5.2
• v0.5.3
• v0.6.0
• v0.6.1
• v0.6.3
• v0.7.0
• v1.0.0
• v2.0.0
• v2.0.1
• v2.1.0
• v2.2.0
• v2.2.1
• v2.3.0
• v2.4.0
• v3.0.0
• v4.0.0
• v4.0.1
• v4.3.0
• v4.4.0
• v4.4.1
• v4.5.0
• v4.6.0
• v4.7.0
• v4.7.1
• v4.7.2
• v4.7.3
• v4.8.0
• validate-graphs
• warnings-off
• yaml-dependency-fixes
• yan-1048-remove-memory-leaks
• yan-1069
• yan-1070
• yan-17
• yan-334
• yan-424
• yan-425
• yan-539
• yan-667
• yan-759
• yan-763
• yan-763-docs
• yan-764
• yan-800
• yan-800-2
• yan-812
• yan-812-2
• yan-839
• yan-846
• yan-850
• yan-852
• yan-854
• yan-859
• yan-891
• yan-893
• yan-894
• yan-895
• yan-899-always-validate-lgs
• yan-919
• yan-922
• yan-927
• yan-931
• yan-945
• yan-959
• yan-968
• yan-968-rtobar
• yan-970
• yan-973
• yan-973-nifty-testing
• yan-973-rebase
• yan-974
• yan-975
• yan-976-constrain-resource-overusage
• yan-981-improve-dlg-logging
• yan-999
• yan919-docspatch-1

Build # 116

Build Type

push

travis-ci

Committed by rtobar

Commit Message

LIU-16 Restructuring FileDrop's path calculation

The way we were previously calculating the final path to which a
FileDrop was pointing to were not consistent enough, and also left room
for improvements. In particular, the directory where files were
deposited lived under /tmp, could not be changed at all, and users did
not know its location.

This has been reworked now. If relative paths are given in the
filepath/dirname preferences then they are relative to: a) the current
working directory (which can be changed via the -w command-line option
of the node manager process) and b) the session ID. This makes each file
unique even across graph executions, and easier to find for users. We
still respect absolute paths though, in case users need to point to a
very particular location.

This logic applies also to the DirectoryContainer class. Thus I
separated the (new and existing) common bits into a new PathBasedDrop
class which is inherited by both the DirectoryContainer and FileDrop
classes.

Signed-off-by: Rodrigo Tobar <rtobar@icrar.org>

Run Details

51 of 51 new or added lines in 2 files covered. (100.0%)

5873 of 8699 relevant lines covered (67.51%)

2.69 hits per line