912
76%

Ran 26 Aug 2018 09:31AM UTC

Jobs 1

Files 991

Run time 47s

Badge

Embed ▾

pending completion

Build # 912

Build Type

push

jenkins

Committed by kumarvishal09

Commit Message

[CARBONDATA-2872] Added Spark FileFormat interface implementation in Carbon

Added new package carbondata-spark-datasource under /integration/spark-datasource
It contains the implementation of Spark's FileFormat and user can use carbon as format in spark
For example

create table test_table(c1 string, c2 int) using carbon
or
dataframe.write.format("carbon").saveAsTable("test_table")
There are few classes moved to this datasource package as part of refactoring and spark2 and spark-common packages now depends on spark-datasource package.

This closes #2647

Run Details

601 of 601 new or added lines in 27 files covered. (100.0%)

57315 of 71045 relevant lines covered (80.67%)

1.07 hits per line

New Missed Lines in Diff

Lines	Coverage	∆	File
1	91.11	0.0%	core/src/main/java/org/apache/carbondata/core/metadata/AbsoluteTableIdentifier.java
1	83.85	0.0%	core/src/main/java/org/apache/carbondata/core/util/CarbonUtil.java
1	7.35	0.0%	integration/spark-datasource/src/main/scala/org/apache/carbondata/converter/SparkDataTypeConverterImpl.java
1	54.72	0.0%	integration/spark-datasource/src/main/scala/org/apache/spark/sql/util/CarbonMetastoreTypes.scala
1	80.56	0.0%	integration/spark2/src/main/scala/org/apache/spark/sql/optimizer/CarbonFilters.scala
3	80.87	0.0%	core/src/main/java/org/apache/carbondata/core/datamap/DataMapStoreManager.java
3	0.0	0.0%	integration/spark2/src/main/spark2.2/org/apache/spark/sql/hive/CarbonInMemorySessionState.scala
5	86.27	0.0%	core/src/main/java/org/apache/carbondata/core/readcommitter/LatestFilesReadCommittedScope.java
6	70.0	0.0%	integration/spark-datasource/src/main/scala/org/apache/carbondata/spark/vectorreader/VectorizedCarbonRecordReader.java
6	83.78	0.0%	integration/spark-datasource/src/main/scala/org/apache/spark/sql/carbondata/execution/datasources/CarbonFileIndexReplaceRule.scala
8	87.1	0.0%	integration/spark-datasource/src/main/scala/org/apache/spark/sql/carbondata/execution/datasources/CarbonFileIndex.scala
9	88.64	0.0%	hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonInputFormat.java
15	91.33	0.0%	integration/spark-datasource/src/main/scala/org/apache/spark/sql/carbondata/execution/datasources/SparkCarbonFileFormat.scala
18	63.46	0.0%	integration/spark-common/src/main/java/org/apache/carbondata/spark/util/Util.java
47	68.87	0.0%	integration/spark-datasource/src/main/scala/org/apache/spark/sql/carbondata/execution/datasources/CarbonSparkDataSourceUtil.scala

Uncovered Existing Lines

Lines	Coverage	∆	File
1	80.36	0.0%	hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonFileInputFormat.java
1	63.46	0.0%	integration/spark-common/src/main/java/org/apache/carbondata/spark/util/Util.java
2	94.12	0.0%	core/src/main/java/org/apache/carbondata/core/datamap/DataMapUtil.java
3	91.11	0.0%	core/src/main/java/org/apache/carbondata/core/metadata/AbsoluteTableIdentifier.java
6	91.84	0.0%	integration/spark2/src/main/scala/org/apache/spark/sql/hive/CarbonRelation.scala
7	75.41	0.0%	integration/spark2/src/main/scala/org/apache/spark/sql/SparkUnknownExpression.scala
9	86.27	0.0%	core/src/main/java/org/apache/carbondata/core/readcommitter/LatestFilesReadCommittedScope.java
14	86.24	0.0%	integration/spark-common/src/main/scala/org/apache/carbondata/spark/rdd/StreamHandoffRDD.scala
15	91.19	0.0%	integration/spark-common/src/main/scala/org/apache/carbondata/spark/rdd/CarbonMergerRDD.scala
21	70.0	0.0%	integration/spark-datasource/src/main/scala/org/apache/carbondata/spark/vectorreader/VectorizedCarbonRecordReader.java
22	93.08	0.0%	integration/spark2/src/main/scala/org/apache/spark/sql/execution/strategy/CarbonLateDecodeStrategy.scala
26	88.64	0.0%	hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonInputFormat.java
29	7.35	0.0%	integration/spark-datasource/src/main/scala/org/apache/carbondata/converter/SparkDataTypeConverterImpl.java
31	81.75	0.0%	integration/spark-common/src/main/scala/org/apache/carbondata/spark/rdd/CarbonScanRDD.scala
31	90.81	0.0%	integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/management/CarbonLoadDataCommand.scala
37	80.87	0.0%	core/src/main/java/org/apache/carbondata/core/datamap/DataMapStoreManager.java
39	80.56	0.0%	integration/spark2/src/main/scala/org/apache/spark/sql/optimizer/CarbonFilters.scala
40	0.0	0.0%	integration/spark2/src/main/spark2.2/org/apache/spark/sql/hive/CarbonInMemorySessionState.scala
67	75.78	0.0%	integration/spark-common/src/main/scala/org/apache/carbondata/spark/util/CarbonScalaUtil.scala
129	83.85	0.0%	core/src/main/java/org/apache/carbondata/core/util/CarbonUtil.java

Jobs

ID	Job ID	Ran	Files	Coverage
1	912.1	26 Aug 2018 09:31AM UTC	991	80.67

apache / carbondata / 912
76%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

New Missed Lines in Diff

Uncovered Existing Lines

Jobs

Source Files on build 912

apache / carbondata / 912 76%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

New Missed Lines in Diff

Uncovered Existing Lines

Jobs

Source Files on build 912

apache / carbondata / 912
76%

README BADGES
x