• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

apache / parquet-cpp / 733

Build:
DEFAULT BRANCH: master
Ran 03 Aug 2016 12:36AM UTC
Jobs 2
Files 108
Run time 44s
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

pending completion
733

push

travis-ci

Wes McKinney
PARQUET-671: performance improvements for rle/bit-packed decoding

Testing on my own data shows an order-of-magnitude improvement.

I separated the commits for clarity, each one gives an imcremental improvement.

The motivation for the last commit (allowing NULL for def_levels/rep_level) is a workaround for Spark  which doesn't seem to be able to generate columns without def_level, even when a column is specified as "not nullable".

Author: Eric Daniel <edaniel@comscore.com>

Closes #140 from edani/decode-perf and squashes the following commits:

eec0855 [Eric Daniel] Ran "make format"
0568de6 [Eric Daniel] Only check num. of repetition levels when def_levels is set
5f54e1c [Eric Daniel] Added benchmarks for dictionary decoding
087945b [Eric Daniel] Style fixes from code review
906be73 [Eric Daniel] Allow the reader to skip rep/def decoding
04b7391 [Eric Daniel] Fast bit unpacking
bda5d84 [Eric Daniel] The bit reader can decode in batches
3f10378 [Eric Daniel] Improve decoding of repeated values in the dict encoding

3255 of 3255 new or added lines in 8 files covered. (100.0%)

7962 of 8197 relevant lines covered (97.13%)

11712.74 hits per line

New Missed Lines in Diff

Lines Coverage ∆ File
1
100.0
src/parquet/encodings/plain-encoding.h
5
100.0
src/parquet/util/bpacking.h
5
100.0
src/parquet/util/rle-encoding.h
Jobs
ID Job ID Ran Files Coverage
1 733.1 03 Aug 2016 12:37AM UTC 0
97.13
Travis Job 733.1
2 733.2 03 Aug 2016 12:36AM UTC 0
0.0
Travis Job 733.2
Source Files on build 733
Detailed source file information is not available for this build.
  • Back to Repo
  • Travis Build #733
  • 38f0ffd5 on github
  • Prev Build on master (#729)
  • Next Build on master (#735)
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2026 Coveralls, Inc