frictionlessdata / tableschema-js

90%

master: 90%

LAST BUILD ON BRANCH autodetect-csv-delimiter

branch: autodetect-csv-delimiter

CHANGE BRANCH

x

Reset

• autodetect-csv-delimiter
• 1.0.0-alpha.15
• 1.0.0-alpha.3
• 1.0.0-alpha.6
• 181/update-axios
• api-update
• better-error-messages
• composit-pk
• constraints-bug
• csv-parse-errors
• date-format
• date-time-bug-138
• docs2
• fix-csv-parsing
• fix-date-pattern-format-70
• fix-es6-error-library
• fix-string-type
• fk-improved
• fk-support
• force-cast-update
• improved-infer
• infer-bug
• infer-patterns
• infinite-numbers-115
• invalid-constraints-error
• main
• master
• moment-2.18
• moment-warning
• normalize-errors
• null-types-constraints-spec-v1
• profiles-spec-v1
• read-order-bug
• require_protocol_scheme_in_urls
• roll-patch-1
• roll-patch-2
• sniffer-fallback
• stream-as-source
• table-constructor-options
• travis-karma
• update-dependencies
• upgrade-momentjs
• v0.2.3
• v0.2.x
• v1.0.0
• v1.0.0-alpha.1
• v1.0.0-alpha.10
• v1.0.0-alpha.16
• v1.0.0-alpha.17
• v1.0.0-alpha.18
• v1.0.0-alpha.19
• v1.0.0-alpha.2
• v1.0.0-alpha.20
• v1.0.0-alpha.21
• v1.0.0-alpha.22
• v1.0.0-alpha.4
• v1.0.0-alpha.5
• v1.0.0-alpha.7
• v1.0.0-alpha.8
• v1.0.1
• v1.1.0
• v1.1.1
• v1.10.0
• v1.10.1
• v1.10.2
• v1.11.0
• v1.11.1
• v1.11.2
• v1.11.3
• v1.11.4
• v1.11.5
• v1.12.0
• v1.12.1
• v1.12.2
• v1.12.3
• v1.12.4
• v1.2.0
• v1.2.1
• v1.3.0
• v1.4.0
• v1.4.1
• v1.4.2
• v1.5.0
• v1.5.1
• v1.6.0
• v1.7.0
• v1.8.0
• v1.9.0
• v1.9.1
• v1.9.2
• v1.9.3
• v1.9.4
• v1.9.5
• v1.9.6
• v1.9.7
• validate-uuid-binary-topojson

Build # 478

Build Type

push

travis-ci

Committed by vitorbaptista

Commit Message

Autodetect CSV delimiter

This uses `csv-sniffer` to autodetect the CSV delimiter. It does so by adding a
`PassThrough()` stream that reads the first chunk of data, infers the
delimiter, and configures the existing CSV parser.

I hoped to be able to do this without creating a dependency between the CSV
delimiter extraction and the CSV parser, but was unable to because the pipeline
needs to be configured before reading, otherwise the CSV parser won't get the
first chunk.

I also tried adding a test to ensure that if an explicit delimiter is passed,
it'll be used, but failed because for some reason I couldn't catch an error
thrown by `csv-parser`. Didn't matter that the code was inside a try/catch
block, the error was still raised.

Run Details

444 of 522 branches covered (85.06%)

Branch coverage included in aggregate %.

807 of 868 relevant lines covered (92.97%)

2003.62 hits per line