JuliaIO / Zarr.jl / 24858642566

90%

Build Type

push

github

Committed by web-flow

Commit Message

feat: Enable sharding_indexed codec for Zarr v3 (#241)

* feat: Enable sharding_indexed codec for Zarr v3

Restructure type declarations so V3Pipeline is visible to the codec
module, then wire up the sharding_indexed codec end-to-end.

Infrastructure:
- Add src/types.jl with Compressor, AbstractCodecPipeline, V2Pipeline,
  V3Pipeline, and forward declarations of pipeline_encode/pipeline_decode!
- Update src/Zarr.jl to include types.jl early (before metadata3.jl and
  Codecs), removing the inline AbstractCodecPipeline declaration
- Remove Compressor abstract type from Compressors/Compressors.jl
  (now in types.jl)
- Remove V2Pipeline/V3Pipeline struct definitions from pipeline.jl
  (now in types.jl); pipeline.jl retains only method definitions

Sharding codec (src/Codecs/V3/V3.jl):
- Import V3Pipeline, pipeline_encode, pipeline_decode! from parent module
- ShardingCodec now stores V3Pipeline for codecs and index_codecs,
  reusing the existing codec pipeline infrastructure for both inner
  chunk and index encode/decode
- Add _codecs_to_v3pipeline: parse flat codec list into V3Pipeline
- Add _pipeline_to_codec_list: flatten V3Pipeline for JSON serialization
- Add JSON.lower for all V3 codec types (BytesCodec, TransposeCodec,
  GzipV3Codec, BloscV3Codec, ZstdV3Codec, CRC32cV3Codec)
- Add getCodec(d::Dict) dispatcher for inner codec deserialization
- Update getCodec(ShardingCodec) to reverse chunk_shape from C-order
  to Julia column-major and build V3Pipeline values
- encode_shard_index/decode_shard_index use pipeline_encode/pipeline_decode!
- zencode!/zdecode! use pipeline_encode/pipeline_decode! for inner chunks
- Add codec_encode/codec_decode for ShardingCodec to plug into the
  outer V3Pipeline
- Remove apply_codec_chain/reverse_codec_chain (replaced by pipeline functions)

Metadata (src/metadata3.jl):
- Parse sharding_indexed codec instead of throwing ArgumentError
- lower3 serializes ShardingCodec via JSON.lower
- Improve error message for missing a... (continued)

Coverage Stats

170 of 176 new or added lines in 5 files covered. (96.59%)

12 existing lines in 3 files now uncovered.

1569 of 1746 relevant lines covered (89.86%)

21263.03 hits per line