ml6team / fondant / 6037768453

91%

push

github

Standarize fsspec file access (#397)

PR that standarizes ffspec file access to use the `Abstractfilesystem`
class for all filesystem related functionalities.

Previously we were using the `Abstractfilesystem` and custom functions
`fs_open()` to read/write/list the manifest(s). This caused some issue
since `fs_open` expects the protocol of the file system to be present in
the URL. However, files returns by `Abstractfilesystem().ls` returned a
normal file system url. When passed to `fs_open()` it causes it to fail
to read the file properly.

Still some issues with using glob patterns. More details here:
https://github.com/ml6team/fondant/issues/368

8 of 11 new or added lines in 2 files covered. (72.73%)

1120 of 1206 relevant lines covered (92.87%)

3.71 hits per line