apache / parquet-cpp / 388 / 1

Ran 21 Feb 2016 03:31AM UTC

Files 76

Run time 3s

Badge

Embed ▾

Committed 21 Feb 2016 03:26AM UTC coverage: 92.318% (-0.2%) from 92.526%

Job # 388.1

Build Type

push

travis-ci

Committed by

julienledem

Commit Message

PARQUET-533: Add a Buffer abstraction, refactor input/output classes to be simpler using Buffers

I have also removed all RowGroupReader and ColumnReader caching until we have an idea of how the caching will help users while also keeping memory-use under control.

The goal with this patch is to encapsulate the "data pointer and size" concept and lightly abstract away buffer ownership. The particular motivation is being able to deal with both normal files (bytes arriving via `fread`) and memory-mapped files (copying of bytes into new memory not required). It also helps do away with a bunch of functions that write output into a `std::vector<uint8_t>` now in favor of the `OwnedMutableBuffer`. Feedback welcome; plenty more work that can be done here.

Requires PARQUET-457. Will rebase once that's merged.

Author: Wes McKinney <wesm@apache.org>

Closes #59 from wesm/PARQUET-533 and squashes the following commits:

a39a4bc [Wes McKinney] Add Buffer abstraction, refactor input/output interface classes to use it where relevant. Output Buffer from InMemoryOutputStream. Stop caching ColumnReader objects

Run Details

2704 of 2929 relevant lines covered (92.32%)

10484.24 hits per line

apache / parquet-cpp / 388 / 1

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 388.1

apache / parquet-cpp / 388 / 1

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 388.1

README BADGES
x