bigdatagenomics / adam / 2523 / 6

push

jenkins

<a href="https://github.com/bigdatagenomics/adam/commit/<a class=hub.com/bigdatagenomics/adam/commit/b1fce67705ab49815a9707938972a7d1c0a5f2f4">b1fce6770<a href="https://github.com/bigdatagenomics/adam/commit/b1fce67705ab49815a9707938972a7d1c0a5f2f4">&quot;&gt;[ADAM-1358] Refactor BQSR to improve performance and legibility.

Resolves #1358.

* Adds instrumentation to BQSR.
* Changed SnpTable to remove RichVariant conversion, use VariantRDD API.
* Refactoring SnpTable to eliminate per-residue costly masked site lookup.
* Restructuring core of SnpTable around an array to improve GC performance.
  Additionally, wrote custom serializer to improve serialization performance.
* Added test suite for SnpTable, to test table creation.
* Refactored SnpTable to use an IntervalArray-like approach. This approach
  improves masked site lookup performance by 50%.
* Added tests to SnpTableSuite to cover lookup case, and reenabled tests in
  BaseQualityRecalibrationSuite.
* Adding unit test coverage to covariates
* Revert &amp;quot;[ADAM-775] Allow all IUPAC codes in BQSR&quot;
  This reverts commit </a><a class="double-link" href="https://github.com/bigdatagenomics/adam/commit/<a class="double-link" href="https://github.com/bigdatagenomics/adam/commit/207eebaf3dbf6f01e5b8398b2af388ee70c862aa">207eebaf3</a>">207eebaf3</a><a href="https://github.com/bigdatagenomics/adam/commit/b1fce67705ab49815a9707938972a7d1c0a5f2f4">.
* Pulled Seq allocation for base check out into an immutable set.
* Rewrote dinuc covariate. 50% improvement in performance.
* Rewrite main BQSR aggregate as reduce by key
* Added tests to recalibrator, recalibration table.
* Majorly refactors of BQSR tables.
* Starting to factor out the QualityScore class
* Refactoring CovariateKey to reduce size in memory
* Eliminated `org.bdgenomics.adam.rich.DecadentRead` (partially resolves #577)
* Refactor CovariateKey to store record group ID instead of record group name.
* Removed `org.bdgenomics.adam.models.QualityScore`.
* Split multi-class files into one class per file (excepting private classes) to improve navigability.
* Scaladoc all the recalibrators! You get a scaladoc! And you get a scaladoc!

4700 of 5826 relevant lines covered (80.67%)

0.81 hits per line