pydata / xarray / 7607
96%

DEFAULT BRANCH: master
Ran
Jobs 9
Files 111
Run time 16min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
7607

push

travis-ci

shoyer 
Appending to zarr store (#2706)

* Initial version of appending to zarr store

* Added docs

* Resolve PEP8 incompliances

* Added write and append test for mode 'a'

* Merged repaired master

* Resolved pep8 issue

* Put target store encoding in appended variable

* Rewrite test with appending along time dimension

* Add chunk_size parameter for rechunking appended coordinate

* Add chunk_dim test

* Add type check and tests for it.

In append mode storing any datatype apart from number
subtypes and fixed size strings raises and error.

* Add documentation

* Add test for compute=False and commented it out

* Remove python 3.7 string formatting

* Fix PEP8 incompliance

* Add missing whitespaces

* allowed for compute=False when appending to a zarr store

* Fixed empty array data error

When using create_append_test_data we used np.arange(...), which was incidently also
the default value of the zarr array when fill_value is set to None. So appending to the data
with compute=False and then expecting an error when asserting the source and target to be the same
failed the tests. Using random data passes the tests

* flake8 fixes

* removed chunk_dim argument to to_zarr function

* implemented requested changes

* Update xarray/backends/api.py

Co-Authored-By: Stephan Hoyer <shoyer@gmail.com>

* added contributors and example of using append to zarr

* fixed docs fail

* fixed docs

* removed unnecessary condition

* attempt at clean string encoding and variable length strings

* implemented suggestions

* * append_dim does not need to be specified if creating a new array with Dataset.to_zarr(store, mode='a')
* cleand up to_zarr append mode tests

* raise ValueError when append_dim is not a valid dimension

* flake8 fix

* removed unused comment

* * raise error when appending with encoding provided for existing variable
* add test for encoding consistency when appending
* imple... (continued)

30211 of 31277 relevant lines covered (96.59%)

5.34 hits per line

Jobs
ID Job ID Ran Files Coverage
1 7607.1 (CONDA_ENV=py35-min) 111
66.62
 Travis Job 7607.1
2 7607.2 (CONDA_ENV=py36) 111
95.68
 Travis Job 7607.2
3 7607.3 (CONDA_ENV=py37) 111
94.73
 Travis Job 7607.3
4 7607.4 (CONDA_ENV=py36-dask-dev) 111
94.25
 Travis Job 7607.4
5 7607.5 (CONDA_ENV=py36-rasterio) 111
92.81
 Travis Job 7607.5
7 7607.7 (CONDA_ENV=lint) 0
Travis Job 7607.7
8 7607.8 (CONDA_ENV=py36-hypothesis) 0
Travis Job 7607.8
11 7607.11 (CONDA_ENV=py36-zarr-dev) 111
89.69
 Travis Job 7607.11
12 7607.12 (CONDA_ENV=typing) 0
Travis Job 7607.12
Source Files on build 7607