5441618274
65%
master: 60%

Ran 03 Jul 2023 07:45AM UTC

Jobs 1

Files 262

Run time 5s

Badge

Embed ▾

pending completion

Build # 5441618274

Build Type

push

github

Committed by

web-flow

Commit Message

Feature/doc similarity ranker (#13858)

* Added doc similarity ranker annotator template

* Created ranker model

* gitignore modified

* Added params to LSH models

* Added BRP LSH as annotator engine

* Added replace features col with embeddings

* Added LSH logic on vector cast

* Added skeleton for lsh doc sim ranker - WIP

* Fixed mh3 hash calculation

* Fixed dataset assertions id vs neghbours

* Converting neighbours result string to map

* Added finisher to extract lsh id and neighbors

* Labels refactoring

* Added distance param to show in rankings

* Added logic to select nearest neighbor

* Added identity ranking for debugging

* Adding Python interface to doc sim ranker approach and model

* WIP - Python interface

* WIP - fixed umbalanced embeddings Py test

* Added MinHash engine to doc sim ranker

* Fixed serde for ranker map params

* Clean up pytests

* Added doc sim ranker finisher Python interface

* stabilized tests for doc sim ranker

* Moved and enriched test for doc sim ranker

* Bumped version 5.0.0 in doc sim ranker test

---------

Co-authored-by: Stefano Lori <s.lori@izicap.com>

Run Details

8652 of 13289 relevant lines covered (65.11%)

0.65 hits per line

Jobs

ID	Job ID	Ran	Files	Coverage
1	Apache Spark 3.4.x - Scala 2.12 - 5441618274.1	03 Jul 2023 07:45AM UTC	262	65.11	GitHub Action Run

JohnSnowLabs / spark-nlp / 5441618274
65%
master: 60%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 5441618274

JohnSnowLabs / spark-nlp / 5441618274 65% master: 60%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 5441618274

JohnSnowLabs / spark-nlp / 5441618274
65%
master: 60%

README BADGES
x