ICRAR / ijson / 294
100%
master: 100%

LAST BUILD BRANCH: release-3.2.0
DEFAULT BRANCH: master
Ran
Jobs 11
Files 14
Run time 27s
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
294

push

travis-ci-com

rtobar 
Avoid decref'ing the sink argument

In #34 memory leaks were reported on the yajl2_c backend that happened
at generator construction time. After investigation, we discovered one
of these in the "chain" utility method, which leaked the temporary
coroutines it chained together. The fix in a8159e4 (first present in
3.1.2) attempted to fix this particular problem, along with the rest of
the identified memory leaks.

The fix for the "chain" method was not correct though: the condition we
used to identify whether the internal "coro" variable had to be decref'd
was incorrect, and led to our code incorrect decref'ing the "sink"
parameter given by the caller, which was meant to be left untouched.
This opened the door to potential issues when the caller decref'd its
reference to "sink".

The problem was not immediately obvious, as depending on the program's
activity, memory allocator and other factors, the memory used by the
destroyed "sink" object could still be valid. In fact our unit tests
never caught this error, and this problem was only reported to us about
a year after 3.1.2 was released by users who saw this problem only after
creating and destroying ijson.parser objects thousands of times.

To reproduce this issue locally I wrote a small script that created a
list of N ijson.parser generators, and then depleted them in order. Only
when running with N=10k I was able to get a failure every 2 or 3
executions.  After applying this patch I saw no failures, so I'm fairly
confident the issue is gone.

This problem was reported originally in #66, which this commit should
fix.

Signed-off-by: Rodrigo Tobar <rtobar@icrar.org>

893 of 894 relevant lines covered (99.89%)

8.49 hits per line

Jobs
ID Job ID Ran Files Coverage
1 294.1 (CIBW_SKIP="cp27-win*" CIBW_TEST_REQUIRES=pytest cffi= CIBW_BEFORE_ALL="bash -c 'cmake --help || yum install -y cmake; cd \"{project}\"; sh .github/tools/install_yajl.sh'" CIBW_TEST_COMMAND="bash -c 'cd \"{project}\"; pytest -vv'" CIBW_ENVIRONMENT_WINDOWS="IJSON_EMBED_YAJL=1" TWINE_USERNAME=__token__ YAJL_VERSION=1.0.12) 13
78.0
 Travis Job 294.1
2 294.2 (CIBW_SKIP="cp27-win*" CIBW_TEST_REQUIRES=pytest cffi= CIBW_BEFORE_ALL="bash -c 'cmake --help || yum install -y cmake; cd \"{project}\"; sh .github/tools/install_yajl.sh'" CIBW_TEST_COMMAND="bash -c 'cd \"{project}\"; pytest -vv'" CIBW_ENVIRONMENT_WINDOWS="IJSON_EMBED_YAJL=1" TWINE_USERNAME=__token__) 13
92.35
 Travis Job 294.2
3 294.3 (CIBW_SKIP="cp27-win*" CIBW_TEST_REQUIRES=pytest cffi= CIBW_BEFORE_ALL="bash -c 'cmake --help || yum install -y cmake; cd \"{project}\"; sh .github/tools/install_yajl.sh'" CIBW_TEST_COMMAND="bash -c 'cd \"{project}\"; pytest -vv'" CIBW_ENVIRONMENT_WINDOWS="IJSON_EMBED_YAJL=1" TWINE_USERNAME=__token__ YAJL_VERSION=1.0.9) 13
78.12
 Travis Job 294.3
4 294.4 (CIBW_SKIP="cp27-win*" CIBW_TEST_REQUIRES=pytest cffi= CIBW_BEFORE_ALL="bash -c 'cmake --help || yum install -y cmake; cd \"{project}\"; sh .github/tools/install_yajl.sh'" CIBW_TEST_COMMAND="bash -c 'cd \"{project}\"; pytest -vv'" CIBW_ENVIRONMENT_WINDOWS="IJSON_EMBED_YAJL=1" TWINE_USERNAME=__token__) 13
92.12
 Travis Job 294.4
5 294.5 (CIBW_SKIP="cp27-win*" CIBW_TEST_REQUIRES=pytest cffi= CIBW_BEFORE_ALL="bash -c 'cmake --help || yum install -y cmake; cd \"{project}\"; sh .github/tools/install_yajl.sh'" CIBW_TEST_COMMAND="bash -c 'cd \"{project}\"; pytest -vv'" CIBW_ENVIRONMENT_WINDOWS="IJSON_EMBED_YAJL=1" TWINE_USERNAME=__token__ UPLOAD_C_COVERAGE=yes) 60
99.68
 Travis Job 294.5
6 294.6 (CIBW_SKIP="cp27-win*" CIBW_TEST_REQUIRES=pytest cffi= CIBW_BEFORE_ALL="bash -c 'cmake --help || yum install -y cmake; cd \"{project}\"; sh .github/tools/install_yajl.sh'" CIBW_TEST_COMMAND="bash -c 'cd \"{project}\"; pytest -vv'" CIBW_ENVIRONMENT_WINDOWS="IJSON_EMBED_YAJL=1" TWINE_USERNAME=__token__ YAJL_VERSION=cant_find_it) 14
74.72
 Travis Job 294.6
7 294.7 (CIBW_SKIP="cp27-win*" CIBW_TEST_REQUIRES=pytest cffi= CIBW_BEFORE_ALL="bash -c 'cmake --help || yum install -y cmake; cd \"{project}\"; sh .github/tools/install_yajl.sh'" CIBW_TEST_COMMAND="bash -c 'cd \"{project}\"; pytest -vv'" CIBW_ENVIRONMENT_WINDOWS="IJSON_EMBED_YAJL=1" TWINE_USERNAME=__token__) 14
95.03
 Travis Job 294.7
8 294.8 (CIBW_SKIP="cp27-win*" CIBW_TEST_REQUIRES=pytest cffi= CIBW_BEFORE_ALL="bash -c 'cmake --help || yum install -y cmake; cd \"{project}\"; sh .github/tools/install_yajl.sh'" CIBW_TEST_COMMAND="bash -c 'cd \"{project}\"; pytest -vv'" CIBW_ENVIRONMENT_WINDOWS="IJSON_EMBED_YAJL=1" TWINE_USERNAME=__token__) 14
95.03
 Travis Job 294.8
9 294.9 (CIBW_SKIP="cp27-win*" CIBW_TEST_REQUIRES=pytest cffi= CIBW_BEFORE_ALL="bash -c 'cmake --help || yum install -y cmake; cd \"{project}\"; sh .github/tools/install_yajl.sh'" CIBW_TEST_COMMAND="bash -c 'cd \"{project}\"; pytest -vv'" CIBW_ENVIRONMENT_WINDOWS="IJSON_EMBED_YAJL=1" TWINE_USERNAME=__token__ YAJL_VERSION=none) 14
74.39
 Travis Job 294.9
10 294.10 (CIBW_SKIP="cp27-win*" CIBW_TEST_REQUIRES=pytest cffi= CIBW_BEFORE_ALL="bash -c 'cmake --help || yum install -y cmake; cd \"{project}\"; sh .github/tools/install_yajl.sh'" CIBW_TEST_COMMAND="bash -c 'cd \"{project}\"; pytest -vv'" CIBW_ENVIRONMENT_WINDOWS="IJSON_EMBED_YAJL=1" TWINE_USERNAME=__token__) 14
95.19
 Travis Job 294.10
11 294.11 (CIBW_SKIP="cp27-win*" CIBW_TEST_REQUIRES=pytest cffi= CIBW_BEFORE_ALL="bash -c 'cmake --help || yum install -y cmake; cd \"{project}\"; sh .github/tools/install_yajl.sh'" CIBW_TEST_COMMAND="bash -c 'cd \"{project}\"; pytest -vv'" CIBW_ENVIRONMENT_WINDOWS="IJSON_EMBED_YAJL=1" TWINE_USERNAME=__token__) 14
95.19
 Travis Job 294.11
Source Files on build 294