halostatue / minitar / 17420372323 / 1

93%

master: 82%

push

github

chore: Support large files in tarballs

This adds support for two extensions on size, which unlocks the limit of
8GB on traditional file entry header. This improves interoperability for
very large tarballs.

- base-256 encoded size:
  https://www.gnu.org/software/tar/manual/html_node/Extensions.html

- PaxHeader size attribute:
  https://pubs.opengroup.org/onlinepubs/9799919799/utilities/pax.html#tagfcjh_1

As traditional octal encoding has a limit of approx 8GB, when a tarball
contains a entry where its content larger than 8GB, minitar fails to
read any following entries due to size mismatch (which causes stream
misalignment).

base-256 encoded size appears in GNU tar created tarballs (normal
`tar cf ... ...`), and @sorah confirmed PaxHeader appears in Google
Takeout tarballs.

Signed-off-by: Austin Ziegler <austin@zieglers.ca>

316 of 486 branches covered (65.02%)

1062 of 1254 relevant lines covered (84.69%)

55.31 hits per line