thriftrw / thriftrw-python / 614
74%
master: 92%

LAST BUILD BRANCH: python-3.4
DEFAULT BRANCH: master
Ran
Jobs 1
Files 53
Run time 3s
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
614

push

travis-ci

web-flow 
Streaming read optimization. (#136)

This PR refactors deserialization to read directly from memory. That is, the serialization/deserialization path used to allocate intermediate representations called "Values" before doing a second pass that converted the values into primitive python objects. This process introduces considerable overhead however. By removing this layer and deserializing directly into python objects, we can dramatically improve performance.

Benchmarks:

Before:

--------------------------------------------------------------------- benchmark: 8 tests ---------------------------------------------------------------------
Name (time in us)                                      Min           Max          Mean      StdDev        Median          IQR  Outliers(*)  Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------
test_binary_loads[nested_structs]              16,474.0086   33,906.9366   20,297.8651  5,972.9826   17,036.4380   2,691.3881        11;11      48           1
test_binary_loads[primitive_containers]       352,126.8368  374,081.8501  363,660.1448  8,221.5467  362,915.9927  10,945.7970          2;0       5           1
After:

--------------------------------------------------------------------- benchmark: 8 tests ---------------------------------------------------------------------
Name (time in us)                                      Min           Max          Mean      StdDev        Median          IQR  Outliers(*)  Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------
test_binary_loads[nested_structs]              10,932.9224   29,603.0045   12,143.8092  2,779.9176   11,502.9812    415.9808          3;9      87           1
test_binary_loads[primitive_containers]      ... (continued)

2191 of 2947 relevant lines covered (74.35%)

0.74 hits per line

Jobs
ID Job ID Ran Files Coverage
5 614.5 (TOX_ENV=cover) 0
74.35
 Travis Job 614.5
Source Files on build 614
Detailed source file information is not available for this build.