MITLibraries / marimo-cdps-dashboard / 25558200153

14%

Build Type

push

github

Committed by web-flow

Commit Message

In 1730 date comparison (#12)

* Add digitized bag UUIDs and update dependencies

* Add list of previously digitized bag UUIDs to replace an env var containing the bagnames. This allows stakeholders to manage any changes to the list while preventing exposure of potentially sensitive data.

* Add create_dataframe_for_date function

* Add create_dataframe_for_date function to simplify the flow of the notebook
* Add get_parquet_uris_from_symlinks, create_parquet_dataframes, process_inventory_data, and transform_cdps_data submethods to be called by create_dataframe_from_date
* Add status spinner during collection of S3 inventory data
* Update comments for accuracy

* Update rename_bucket function to add dissemination and submission buckets

* Add date comparison functionality

Why these changes are being introduced:
*  Stakeholders requested the ability to compare the inventory data from a date range for reporting purposes

How this addresses that need:
* Add file_count_change_by_field and storage_change_by_field functions
* Update labels for brevity and consistency
* Add comparison date range selector, inventory date verification, and dataframe creation
* Add stakeholder-requested statistics and tables for changes associated with the selected date range

Side effects of this change:
* None

Relevant ticket(s):
* https://mitlibraries.atlassian.net/browse/IN-1730

* Stakeholder-requested changes

* Update change > difference for variables, labels, and comments
* Add _calculate_difference_by_field function and update file_count_difference_by_field and storage_difference_by_field
* Add mo.stop if the selected start date is after the selected end date
* Add start and end data to summary stats

* Updates based on discussion in PR #12

* Add start_df and end_df variables to simplify app flow
* Update file_count_difference_by_field and storage_difference_by_field to to use start_df and end_df
* Add mo.stop if start and end date are equal

* More updates based on... (continued)

Coverage Stats

28 of 211 new or added lines in 1 file covered. (13.27%)

6 existing lines in 1 file now uncovered.

58 of 406 relevant lines covered (14.29%)

0.14 hits per line