650
42%

Ran 04 Oct 2017 03:27AM UTC

Jobs 2

Files 433

Run time 2min

Badge

Embed ▾

pending completion

Build # 650

Build Type

push

travis-ci

Committed by Takuya Kitazawa

Commit Message

[HIVEMALL-146] Yet another UDF to generate n-grams

## What changes were proposed in this pull request?

Add a new UDF `to_ngrams(array<string> words, int minSize, int maxSize)` which returns list of n-grams `minSize <= n <= maxSize` for given words. This UDF can be alternative of the original Hive `ngrams` function.

## What type of PR is it?

Feature

## What is the Jira issue?

https://issues.apache.org/jira/browse/HIVEMALL-146

## How was this patch tested?

Unit test, manual tests both on EMR and local Hive

## How to use this feature?

as documented

## Checklist

(Please remove this section if not needed; check `x` for YES, blank for NO)

- [x] Did you apply source code formatter, i.e., `mvn formatter:format`, for your commit?
- [x] Did you run system tests on Hive (or Spark)?

Author: Takuya Kitazawa <k.takuti@gmail.com>

Closes #118 from takuti/HIVEMALL-146-ngrams.

Run Details

25 of 25 new or added lines in 1 file covered. (100.0%)

11933 of 29028 relevant lines covered (41.11%)

5938382.77 hits per line

New Missed Lines in Diff

Lines	Coverage	∆	File
1	100.0		core/src/main/java/hivemall/tools/text/WordNgramsUDF.java

Uncovered Existing Lines

Lines	Coverage	File
1	100.0	core/src/main/java/hivemall/evaluation/GradedResponsesMeasures.java
1	100.0	core/src/main/java/hivemall/HivemallConstants.java
4	100.0	core/src/main/java/hivemall/math/vector/VectorProcedure.java
6	100.0	core/src/main/java/hivemall/mf/OnlineMatrixFactorizationUDTF.java
11	100.0	core/src/main/java/hivemall/mf/BPRMatrixFactorizationUDTF.java
14	100.0	core/src/main/java/hivemall/evaluation/BinaryResponsesMeasures.java
29	100.0	core/src/main/java/hivemall/utils/collections/maps/Long2IntOpenHashTable.java
32	100.0	core/src/main/java/hivemall/utils/collections/maps/OpenHashTable.java
33	100.0	core/src/main/java/hivemall/math/matrix/sparse/CSCMatrix.java
35	100.0	core/src/main/java/hivemall/utils/collections/maps/Int2FloatOpenHashTable.java
35	100.0	core/src/main/java/hivemall/evaluation/MAPUDAF.java
35	100.0	core/src/main/java/hivemall/evaluation/MRRUDAF.java
35	100.0	core/src/main/java/hivemall/evaluation/RecallUDAF.java
43	100.0	core/src/main/java/hivemall/evaluation/AUCUDAF.java
44	100.0	core/src/main/java/hivemall/utils/math/MathUtils.java
45	100.0	core/src/main/java/hivemall/utils/lang/StringUtils.java
45	100.0	core/src/main/java/hivemall/evaluation/FMeasureUDAF.java
45	100.0	core/src/main/java/hivemall/evaluation/PrecisionUDAF.java
60	100.0	core/src/main/java/hivemall/utils/collections/maps/IntOpenHashTable.java
60	100.0	core/src/main/java/hivemall/evaluation/NDCGUDAF.java
71	100.0	core/src/main/java/hivemall/utils/collections/maps/Long2FloatOpenHashTable.java
75	100.0	core/src/main/java/hivemall/utils/collections/maps/Long2DoubleOpenHashTable.java
78	100.0	core/src/main/java/hivemall/math/matrix/sparse/DoKMatrix.java
83	100.0	core/src/main/java/hivemall/utils/collections/maps/Int2IntOpenHashTable.java
206	100.0	core/src/main/java/hivemall/utils/hadoop/HiveUtils.java

Jobs

ID	Job ID	Ran	Files	Coverage
1	650.1	04 Oct 2017 03:28AM UTC	0	41.44	Travis Job 650.1
2	650.2	04 Oct 2017 03:27AM UTC	0	41.15	Travis Job 650.2

Source Files on build 650

Detailed source file information is not available for this build.

apache / incubator-hivemall / 650
42%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

New Missed Lines in Diff

Uncovered Existing Lines

Jobs

Source Files on build 650

apache / incubator-hivemall / 650 42%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

New Missed Lines in Diff

Uncovered Existing Lines

Jobs

Source Files on build 650

apache / incubator-hivemall / 650
42%

README BADGES
x