• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

snowplow / snowplow-rdb-loader / 11214130791
52%
master: 52%

Build:
Build:
LAST BUILD BRANCH: develop
DEFAULT BRANCH: master
Ran 07 Oct 2024 11:15AM UTC
Jobs 1
Files 160
Run time 1min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

04 Oct 2024 02:17PM UTC coverage: 52.005% (+0.08%) from 51.928%
11214130791

push

github

spenes
Fix NPEs in TypesAccumulator

We've seen exceptions in spark executors like:

```
java.lang.NullPointerException: Cannot invoke "scala.collection.mutable.Set.isEmpty()" because the return value of "com.snowplowanalytics.snowplow.rdbloader.transformer.batch.spark.TypesAccumulator.accum()" is null
```

The error is coming from our Spark Accumulator for accumulating Iglu
types. This is similar to [an issue previously seen][1] in Spark's own
`CollectionAccumulator`. That issue [was fixed in Spark][2] by making
the accumulator's internal state non-final, and synchronizing access to
the internal state. So here we make the exact same change to our own
Accumulator.

It is a rare race condition which is hard to reproduce.

[1]: https://issues.apache.org/jira/browse/SPARK-20977
[2]: https://github.com/apache/spark/pull/31540

13 of 14 new or added lines in 1 file covered. (92.86%)

11 existing lines in 9 files now uncovered.

2321 of 4463 relevant lines covered (52.01%)

0.83 hits per line

Jobs
ID Job ID Ran Files Coverage
1 11214130791.1 07 Oct 2024 11:15AM UTC 0
52.01
GitHub Action Run
Source Files on build 11214130791
Detailed source file information is not available for this build.
  • Back to Repo
  • d540e99f on github
  • Prev Build on refs/tags/6.1.1-rc4 (#11152989198)
  • Next Build on develop (#11253216202)
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2026 Coveralls, Inc