ACCESS-Community-Hub / PyEarthTools / 17421160537

push

github

Major refactor of the station data accessor (#147)

* Change get_all_station_ids method to work with new zarr structure
* Update filesystem method to work with simplified file structure
* Add functionality to loop over station rnges for downloads
* Make downloading and extraction even more idempotent. 
* Improve conversion efficency
* Tidy station list
* Improve notebook descriptions
* Update Drop transform for more robust handling
* Update download notebook to show good output
* Update conversion to zarr notebook to show good output
* Add docstrings
* Improve error message for numpy conversion process
* Update pre-processing to remove redundant station_id variable causing numpy issues, also squeeze lat, lon and elev here instead of pipeline
* Update notebook to plot confusion matrix with matplotlib and adjust pipeline
* Put in some commentary about the dropping of coordinates with the Drop operator

* Skip radar projection tests if radar data is unavailable (unrelated to main feature)

---------

Co-authored-by: Joel Miller <joel.miller@cazldf00004Y.spice.sc.metoffice.gov.uk>
Co-authored-by: Tennessee Leeuwenburg <tennessee.leeuwenburg@bom.gov.au>

1003 of 2073 branches covered (48.38%)

Branch coverage included in aggregate %.

0 of 11 new or added lines in 4 files covered. (0.0%)

9480 of 15108 relevant lines covered (62.75%)

1.88 hits per line