441
76%

Ran 16 May 2018 08:51AM UTC

Jobs 1

Files 1019

Run time 4min

Badge

Embed ▾

pending completion

Build # 441

Build Type

push

jenkins

Committed by kunal642

Commit Message

[CARBONDATA-2463] concurrent insert requires separtate temp path which is differentiated with seg_id only

issue : for non-transaction table we are not setting any segment-id in loadmodel .
temp location contains databasenaem_tablename_segId_taskid . during concurrent insert in same table,
temp folder has to be created at separate location . only segment_id value will change during two concurrent insert.

solution: insert flow for external table is same as carbon table., and we are not storing segment
info to anywhere. so dummy unique segment-id can be assigned to loadmodel for nontransactional table.

This closes #2284

Run Details

2 of 2 new or added lines in 2 files covered. (100.0%)

48555 of 69139 relevant lines covered (70.23%)

0.92 hits per line

Uncovered Existing Lines

Lines	Coverage	∆	File
1	72.73	-9.09%	store/sdk/src/main/java/org/apache/carbondata/store/MetaCachedCarbonStore.java
1	92.86	-3.57%	processing/src/main/java/org/apache/carbondata/processing/loading/dictionary/DictionaryServerClientDictionary.java
1	81.46	-0.49%	integration/spark2/src/main/scala/org/apache/spark/sql/CarbonSession.scala
1	93.48	-2.17%	processing/src/main/java/org/apache/carbondata/processing/loading/converter/impl/DictionaryFieldConverterImpl.java
1	42.13	-0.39%	integration/spark2/src/main/scala/org/apache/spark/sql/execution/CastExpressionOptimization.scala
1	91.04	-1.49%	integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/datamap/CarbonCreateDataMapCommand.scala
1	86.54	-1.92%	core/src/main/java/org/apache/carbondata/core/cache/dictionary/AbstractColumnDictionaryInfo.java
1	77.27	-4.55%	core/src/main/java/org/apache/carbondata/core/scan/filter/resolver/resolverinfo/visitor/FilterInfoTypeVisitorFactory.java
1	87.5	-12.5%	core/src/main/java/org/apache/carbondata/core/scan/filter/intf/RowImpl.java
1	85.71	-1.79%	processing/src/main/java/org/apache/carbondata/processing/loading/iterator/CarbonOutputIteratorWrapper.java
1	93.86	-0.26%	integration/spark2/src/main/scala/org/apache/spark/sql/execution/strategy/CarbonLateDecodeStrategy.scala
1	97.1	-0.41%	processing/src/main/java/org/apache/carbondata/processing/store/CarbonFactDataHandlerModel.java
1	92.31	-7.69%	core/src/main/java/org/apache/carbondata/core/scan/filter/executer/TrueFilterExecutor.java
1	66.67	-11.11%	core/src/main/java/org/apache/carbondata/core/statusmanager/FileFormat.java
2	78.05	-2.44%	processing/src/main/java/org/apache/carbondata/processing/loading/sort/unsafe/merger/UnsafeSingleThreadFinalSortFilesMerger.java
2	92.31	-7.69%	core/src/main/java/org/apache/carbondata/core/dictionary/client/NonSecureDictionaryClient.java
2	0.0	-100.0%	core/src/main/java/org/apache/carbondata/core/scan/filter/partition/PruneAllPartitionFilterImpl.java
2	72.93	-0.32%	core/src/main/java/org/apache/carbondata/core/util/CarbonProperties.java
2	76.47	-11.76%	core/src/main/java/org/apache/carbondata/core/cache/dictionary/ReverseDictionary.java
2	95.24	-4.76%	integration/spark2/src/main/scala/org/apache/spark/sql/execution/strategy/StreamingTableStrategy.scala
2	88.89	-11.11%	core/src/main/java/org/apache/carbondata/core/scan/filter/executer/OrFilterExecuterImpl.java
2	94.83	-0.22%	integration/spark2/src/main/scala/org/apache/spark/sql/hive/CarbonPreAggregateRules.scala
2	29.13	-1.94%	core/src/main/java/org/apache/carbondata/core/datastore/compression/SnappyCompressor.java
2	91.92	-2.02%	integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/table/CarbonDropTableCommand.scala
2	80.78	-0.28%	integration/spark-common/src/main/scala/org/apache/spark/sql/catalyst/CarbonDDLSqlParser.scala
2	78.26	-8.7%	core/src/main/java/org/apache/carbondata/core/datastore/row/CarbonRow.java
2	73.71	-0.8%	core/src/main/java/org/apache/carbondata/core/util/ByteUtil.java
2	85.96	-1.12%	integration/spark2/src/main/scala/org/apache/spark/sql/parser/CarbonSparkSqlParser.scala
2	88.46	-3.85%	core/src/main/java/org/apache/carbondata/core/datastore/chunk/impl/FixedLengthDimensionColumnPage.java
2	81.97	-1.64%	core/src/main/java/org/apache/carbondata/core/scan/model/QueryModel.java
2	88.46	-7.69%	core/src/main/java/org/apache/carbondata/core/cache/dictionary/ForwardDictionary.java
2	69.49	-3.39%	core/src/main/java/org/apache/carbondata/core/scan/filter/executer/AndFilterExecuterImpl.java
3	74.77	-2.7%	core/src/main/java/org/apache/carbondata/core/statusmanager/LoadMetadataDetails.java
3	84.62	-2.31%	processing/src/main/java/org/apache/carbondata/processing/loading/sort/impl/ParallelReadMergeSorterWithColumnRangeImpl.java
3	87.77	-1.08%	hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonInputFormat.java
3	92.31	-7.69%	processing/src/main/java/org/apache/carbondata/processing/loading/converter/impl/DirectDictionaryFieldConverterImpl.java
3	80.65	-3.23%	core/src/main/java/org/apache/carbondata/core/util/comparator/Comparator.java
4	41.67	-16.67%	integration/spark-common/src/main/scala/org/apache/carbondata/spark/KeyVal.scala
4	88.35	-3.88%	core/src/main/java/org/apache/carbondata/core/scan/processor/DataBlockIterator.java
4	83.78	-5.41%	processing/src/main/java/org/apache/carbondata/processing/loading/steps/DataWriterBatchProcessorStepImpl.java
4	91.49	-4.26%	core/src/main/java/org/apache/carbondata/core/dictionary/generator/IncrementalColumnDictionaryGenerator.java
4	0.0	-100.0%	streaming/src/main/java/org/apache/carbondata/streaming/CarbonStreamException.java
5	0.0	-100.0%	integration/spark-common/src/main/java/org/apache/carbondata/spark/partition/DropPartitionCallable.java
5	74.6	-1.98%	core/src/main/java/org/apache/carbondata/core/scan/filter/executer/RowLevelRangeLessThanFilterExecuterImpl.java
5	67.89	-0.97%	core/src/main/java/org/apache/carbondata/core/util/DataTypeUtil.java
5	70.0	-4.55%	core/src/main/java/org/apache/carbondata/core/scan/filter/resolver/ConditionalFilterResolverImpl.java
5	0.0	-100.0%	integration/spark-common/src/main/java/org/apache/carbondata/spark/partition/SplitPartitionCallable.java
5	58.16	-3.55%	core/src/main/java/org/apache/carbondata/core/datastore/impl/FileFactory.java
5	92.96	-7.04%	integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/schema/CarbonAlterTableAddColumnCommand.scala
6	80.97	-0.46%	core/src/main/java/org/apache/carbondata/core/util/CarbonUtil.java
6	91.98	-2.83%	core/src/main/java/org/apache/carbondata/core/scan/result/vector/MeasureDataVectorProcessor.java
6	90.0	-7.5%	core/src/main/java/org/apache/carbondata/core/scan/filter/partition/PartitionFilterUtil.java
6	79.31	-20.69%	integration/spark2/src/main/spark2.2/org/apache/spark/sql/hive/CarbonOptimizer.scala
6	0.0	-40.0%	streaming/src/main/java/org/apache/carbondata/streaming/CarbonStreamOutputFormat.java
6	0.0	-100.0%	streaming/src/main/java/org/apache/carbondata/streaming/parser/CSVStreamParserImp.java
7	72.67	-4.07%	processing/src/main/java/org/apache/carbondata/processing/merger/CompactionResultSortProcessor.java
7	87.5	-3.5%	core/src/main/java/org/apache/carbondata/core/scan/filter/FilterExpressionProcessor.java
7	82.41	-0.2%	core/src/main/java/org/apache/carbondata/core/statusmanager/SegmentStatusManager.java
7	75.0	-25.0%	integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/management/CarbonShowLoadsCommand.scala
8	0.0	-100.0%	core/src/main/java/org/apache/carbondata/core/scan/filter/partition/OrFilterImpl.java
8	75.74	-3.4%	core/src/main/java/org/apache/carbondata/core/scan/filter/executer/RowLevelRangeGrtThanFiterExecuterImpl.java
8	76.75	-3.51%	core/src/main/java/org/apache/carbondata/core/scan/filter/executer/RowLevelRangeGrtrThanEquaToFilterExecuterImpl.java
8	73.66	-3.9%	core/src/main/java/org/apache/carbondata/core/datamap/DataMapStoreManager.java
9	91.58	-2.45%	core/src/main/java/org/apache/carbondata/core/metadata/converter/ThriftWrapperSchemaConverterImpl.java
9	77.46	-3.69%	integration/spark2/src/main/scala/org/apache/spark/sql/execution/strategy/DDLStrategy.scala
9	70.0	-22.5%	streaming/src/main/scala/org/apache/carbondata/streaming/parser/FieldConverter.scala
9	70.59	-13.24%	hadoop/src/main/java/org/apache/carbondata/hadoop/CarbonMultiBlockSplit.java
9	0.0	-100.0%	store/sdk/src/main/java/org/apache/carbondata/store/CarbonRowReadSupport.java
10	67.74	-32.26%	integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/mutation/IUDCommonUtil.scala
10	77.66	-5.08%	hadoop/src/main/java/org/apache/carbondata/hadoop/CarbonInputSplit.java
10	68.13	-6.25%	core/src/main/java/org/apache/carbondata/core/util/path/CarbonTablePath.java
10	73.39	-4.03%	core/src/main/java/org/apache/carbondata/core/scan/filter/executer/RowLevelRangeLessThanEqualFilterExecuterImpl.java
11	75.28	-4.06%	processing/src/main/java/org/apache/carbondata/processing/util/CarbonDataProcessorUtil.java
11	84.99	-1.92%	processing/src/main/java/org/apache/carbondata/processing/merger/CarbonDataMergerUtil.java
12	0.0	-80.0%	integration/spark2/src/main/scala/org/apache/spark/util/DeleteSegmentByDate.scala
12	87.63	-12.37%	core/src/main/java/org/apache/carbondata/core/metadata/schema/PartitionInfo.java
13	73.56	-14.94%	hadoop/src/main/java/org/apache/carbondata/hadoop/util/CarbonInputFormatUtil.java
13	0.0	-76.47%	core/src/main/java/org/apache/carbondata/core/scan/result/iterator/PartitionSpliterRawResultIterator.java
13	87.0	-2.91%	integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/preaaggregate/PreAggregateListeners.scala
13	73.03	-14.61%	core/src/main/java/org/apache/carbondata/core/util/DeleteLoadFolders.java
13	0.0	-81.25%	integration/spark2/src/main/scala/org/apache/spark/util/DeleteSegmentById.scala
14	75.4	-4.47%	integration/spark2/src/main/scala/org/apache/spark/sql/hive/CarbonFileMetastore.scala
14	74.32	-9.46%	processing/src/main/java/org/apache/carbondata/processing/loading/sort/impl/UnsafeBatchParallelReadMergeSorterImpl.java
15	76.61	-3.44%	integration/spark-common/src/main/scala/org/apache/carbondata/spark/util/GlobalDictionaryUtil.scala
15	0.0	-68.18%	integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/management/CarbonAlterTableFinishStreaming.scala
15	0.0	-71.43%	integration/spark2/src/main/scala/org/apache/spark/util/TableAPIUtil.scala
15	60.88	-3.14%	integration/spark-common/src/main/scala/org/apache/carbondata/spark/util/CommonUtil.scala
15	0.0	-78.95%	processing/src/main/java/org/apache/carbondata/processing/partition/spliter/AbstractCarbonQueryExecutor.java
16	68.05	-6.02%	core/src/main/java/org/apache/carbondata/core/scan/filter/executer/IncludeFilterExecuterImpl.java
17	69.47	-8.95%	integration/spark2/src/main/scala/org/apache/spark/sql/CarbonSource.scala
17	82.4	-4.75%	integration/spark2/src/main/scala/org/apache/spark/sql/parser/CarbonSpark2SqlParser.scala
17	14.29	-80.95%	integration/spark-common/src/main/scala/org/apache/carbondata/streaming/CarbonStreamingQueryListener.scala
19	0.0	-67.86%	core/src/main/java/org/apache/carbondata/core/scan/filter/resolver/resolverinfo/visitor/RangeDirectDictionaryVisitor.java
20	0.0	-95.24%	integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/schema/CarbonGetTableDetailCommand.scala
20	69.06	-7.55%	core/src/main/java/org/apache/carbondata/core/scan/filter/executer/RangeValueFilterExecuterImpl.java
21	89.92	-5.88%	core/src/main/java/org/apache/carbondata/core/metadata/schema/table/CarbonTable.java
21	57.87	-2.54%	core/src/main/java/org/apache/carbondata/core/scan/filter/FilterUtil.java
22	0.0	-100.0%	processing/src/main/java/org/apache/carbondata/processing/partition/spliter/CarbonSplitExecutor.java
22	0.0	-88.0%	integration/spark2/src/main/scala/org/apache/spark/util/CleanFiles.scala
23	53.7	-7.4%	core/src/main/java/org/apache/carbondata/core/scan/filter/executer/RowLevelFilterExecuterImpl.java
23	68.0	-15.33%	integration/spark-common/src/main/scala/org/apache/carbondata/api/CarbonStore.scala
25	77.42	-5.53%	integration/spark-common/src/main/scala/org/apache/carbondata/spark/rdd/CarbonScanRDD.scala
26	0.0	-100.0%	streaming/src/main/scala/org/apache/carbondata/streaming/parser/RowStreamParserImp.scala
28	86.55	-5.62%	integration/spark-common/src/main/scala/org/apache/spark/sql/execution/command/carbonTableSchemaCommon.scala
28	67.41	-12.5%	core/src/main/java/org/apache/carbondata/core/scan/filter/executer/ExcludeFilterExecuterImpl.java
29	52.78	-26.85%	integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/management/RefreshCarbonTableCommand.scala
31	77.16	-10.73%	integration/spark-common/src/main/scala/org/apache/carbondata/spark/rdd/CarbonGlobalDictionaryRDD.scala
32	0.0	-71.11%	streaming/src/main/java/org/apache/carbondata/streaming/CarbonStreamInputFormat.java
33	89.79	-1.22%	integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/management/CarbonLoadDataCommand.scala
33	43.48	-47.83%	integration/spark2/src/main/scala/org/apache/carbondata/store/SparkCarbonStore.scala
34	63.32	-17.09%	integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/management/CarbonAlterTableCompactionCommand.scala
36	0.0	-76.6%	processing/src/main/java/org/apache/carbondata/processing/partition/spliter/RowResultProcessor.java
37	66.08	-21.64%	integration/spark2/src/main/scala/org/apache/spark/util/AlterTableUtil.scala
43	25.0	-63.24%	integration/spark-common/src/main/java/org/apache/carbondata/spark/util/SparkDataTypeConverterImpl.java
45	0.0	-84.91%	integration/spark-common/src/main/scala/org/apache/carbondata/spark/rdd/PartitionSplitter.scala
58	0.0	-86.57%	integration/spark-common/src/main/scala/org/apache/carbondata/spark/rdd/PartitionDropper.scala
63	0.0	-91.3%	integration/spark-common/src/main/scala/org/apache/carbondata/spark/rdd/AlterTableLoadPartitionRDD.scala
67	0.0	-90.54%	streaming/src/main/java/org/apache/carbondata/streaming/StreamBlockletWriter.java
76	68.65	-23.82%	hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonTableInputFormat.java
98	29.79	-69.5%	integration/spark-common/src/main/scala/org/apache/spark/util/PartitionUtils.scala
102	0.0	-90.27%	streaming/src/main/java/org/apache/carbondata/streaming/StreamBlockletReader.java
119	0.0	-83.8%	integration/spark-common/src/main/scala/org/apache/carbondata/streaming/StreamSinkFactory.scala
120	0.0	-85.11%	integration/spark-common/src/main/scala/org/apache/carbondata/spark/rdd/CarbonScanPartitionRDD.scala
134	0.0	-88.74%	streaming/src/main/java/org/apache/carbondata/streaming/CarbonStreamRecordWriter.java
137	0.0	-85.63%	integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/partition/CarbonAlterTableDropPartitionCommand.scala
157	0.0	-85.33%	integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/partition/CarbonAlterTableSplitPartitionCommand.scala
166	0.0	-93.26%	integration/spark-common/src/main/scala/org/apache/spark/sql/execution/streaming/CarbonAppendableStreamSink.scala
188	0.0	-86.24%	integration/spark-common/src/main/scala/org/apache/carbondata/spark/rdd/StreamHandoffRDD.scala
192	0.0	-86.1%	streaming/src/main/java/org/apache/carbondata/streaming/segment/StreamSegment.java
325	0.0	-82.28%	streaming/src/main/java/org/apache/carbondata/streaming/CarbonStreamRecordReader.java

Jobs

ID	Job ID	Ran	Files	Coverage
1	441.1	16 May 2018 08:51AM UTC	1019	70.23

apache / carbondata / 441
76%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Uncovered Existing Lines

Jobs

Source Files on build 441

apache / carbondata / 441 76%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Uncovered Existing Lines

Jobs

Source Files on build 441

apache / carbondata / 441
76%

README BADGES
x