thriftrw / thriftrw-python / 616
92%

DEFAULT BRANCH: master
Ran
Jobs 1
Files 53
Run time 16s
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
616

push

travis-ci

clin88 
Use streaming API to encode and decode values. In addition, optimize validation. (#120)

This PR refactors serialization and deserialization to avoid an intermediate representation. That is, the serialization/deserialization path used to allocate "Values" before doing a second pass that converted the values into primitive python objects. This process introduces considerable overhead however. By removing this layer and deserializing directly into python objects, we can dramatically improve performance.

Benchmarks:

Before:

--------------------------------------------------------------------- benchmark: 8 tests ---------------------------------------------------------------------
Name (time in us)                                      Min           Max          Mean      StdDev        Median          IQR  Outliers(*)  Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------
test_binary_loads[nested_structs]              16,474.0086   33,906.9366   20,297.8651  5,972.9826   17,036.4380   2,691.3881        11;11      48           1
test_binary_loads[primitive_containers]       352,126.8368  374,081.8501  363,660.1448  8,221.5467  362,915.9927  10,945.7970          2;0       5           1
After:

--------------------------------------------------------------------- benchmark: 8 tests ---------------------------------------------------------------------
Name (time in us)                                      Min           Max          Mean      StdDev        Median          IQR  Outliers(*)  Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------
test_binary_loads[nested_structs]              10,932.9224   29,603.0045   12,143.8092  2,779.9176   11,502.9812    415.9808          3;9      87           1
test_binary_loads[primitive_containers]       103,006.1245  111,021.9955  106,945.2498  2,231.4418  106,887.1021  2,384.5434          2;0       9           1

2184 of 2947 relevant lines covered (74.11%)

0.74 hits per line

Jobs
ID Job ID Ran Files Coverage
5 616.5 (TOX_ENV=cover) 0
74.11
 Travis Job 616.5
Source Files on build 616
Detailed source file information is not available for this build.