thanos / ExZarr

65%

main: 76%

LAST BUILD ON BRANCH Complete_Zarr_v3_Metadata_Handling

branch: Complete_Zarr_v3_Metadata_Handling

CHANGE BRANCH

x

Reset

Sync Branches

• Complete_Zarr_v3_Metadata_Handling
• Additional_Data_Types
• Array_Operations
• Chunking_and_Group
• Concurrent_RW_Support
• Documentation_and_Examples
• Google_Cloud_Storage_backend
• S3_storage_backend
• doc_cleanup
• docs_fix
• github_setup
• main
• new_documentaion
• new_notebooks
• nx_integration
• performance_and_benchmarks
• release_v1.0.0
• v0.3.0
• v2_and_v3_formats_conversions
• zarr3_extras
• zarr_v3
• zarr_v3_metadata_support

Build # 608a06b3cb08046d976cdd7d004548104599f7e0-PR-131

Build Type

Pull #131

github

Committed by thanos

Commit Message

closed #129
New Functions Added to lib/ex_zarr/metadata_v3.ex

  1. to_json/1 - Converts MetadataV3 struct to JSON string
    - Leverages existing Jason.Encoder implementation
    - Returns {:ok, json_string} or {:error, reason}
    - Properly handles all v3 features
  2. from_json/1 - Parses JSON (string or map) to MetadataV3 struct
    - Handles both JSON strings and decoded maps
    - Converts lists to tuples for shape/chunk_shape
    - Parses string node_type ("array", "group") to atoms
    - Returns {:ok, metadata} or {:error, reason}
  3. Helper parsing functions (238 lines total):
    - parse_metadata_map/1 - Main parsing logic
    - parse_node_type/1 - Converts string to atom
    - parse_shape/1 - Converts lists to tuples
    - parse_chunk_grid/1 - Handles regular and irregular grids
    - parse_chunk_grid_config/2 - Grid-specific parsing
    - parse_codecs/1 - Parses codec pipeline
    - parse_codec/1 - Individual codec parsing
    - parse_codec_configuration/2 - Codec-specific config (especially sharding)

  Comprehensive Test Suite Added to test/ex_zarr/metadata_v3_test.exs

  Added 54 new tests (547 lines) covering:

  1. JSON Encoding (to_json/1) - 5 tests
    - Basic array metadata
    - Group metadata
    - Dimension names
    - Sharding codec with nested configurations
    - Storage transformers (transpose, quantize, bitround)
  2. JSON Decoding (from_json/1) - 10 tests
    - Parsing from JSON string
    - Parsing from map
    - Group metadata
    - Dimension names
    - Sharding codec with nested configurations
    - Storage transformers
    - Round-trip encoding/decoding
    - Error handling (invalid JSON, missing fields, invalid input types)
  3. Zarr-Python File Compatibility - 5 tests
    - Write/read zarr.json file
    - Sharded array metadata
    - Group metadata
    - Irregular chunk grid parsing
    - Full round-trip file I/O

   Features Fully Supported

  The implementation handles all Zarr v3 features:

  -  Regular chunk g... (continued)

Pull Request Pull Request #131: closed #129

Run Details

40 of 63 new or added lines in 1 file covered. (63.49%)

1806 of 2770 relevant lines covered (65.2%)

1118.24 hits per line