apache / carbondata / 2046
76%

DEFAULT BRANCH: master
Ran
Jobs 1
Files 1075
Run time 1min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
2046

push

jenkins

akashrn5 
[CARBONDATA-3512]Index Server enhancement

What changes are proposed

1. Remove the keytab dependency for IndexServer. Currently IndexServer needs to configure keytab and prinicipal for both
Client side and Server Side.But indexServer is super user and having super user's keytab and principal in client is not
correct(specialy spark-submit). Since IndexServer is wrapped around spark application so no need to ask Keytab from User
for IndexServer.

2. Authentication:-This happens in org.apache.hadoop.security.SaslRpcClient#createSaslClient .it checks getServerPrincipal
(spark.carbon.indexserver.principal) and Server protocol (UGI of IndexServer). User need to configure spark.carbon.indexserver.principal
properly.

3. Authorization(ACL):- Support User who can access the IndexServer. Authorization is controlled by hadoop.security.authorization
parameter. IndexServer has below scenarios.
	1. Spark-submit,spark-shell,spark-Sql :-> These type of spark Application has UGI where LoginUser and LoginUser will be same
	either based on kinit or based on spark.yarn.principal. Authorization is done in org.apache.hadoop.ipc.Server#authorize
	using IndexServer ProtocolClass and ACL list which is prepared by org.apache.hadoop.security.authorize.PolicyProvider
	(generally hadoop-policy.xml with key security.indexserver.protocol.acl , by default *).
	2. Spark JDBCServer :- It has UGI based on ProxyUser like user1(auth:PROXY)via spark//. where user1 is currentUser and spark is
	LoginUser (JDBCServer started UGI).This type of Authorization happens in org.apache.hadoop.security.authorize.ProxyUsers#authorize
	with proxyUserAcl list prepared by hadoop.proxyuser.<INDEXSERVER_UGI>.users ,hadoop.proxyuser.<INDEXSERVER_UGI>.hosts ,
	hadoop.proxyuser.<INDEXSERVER_UGI>.groups.

TokenRenewer:- IndexServer is NOT Token based Hadoop Service. It does not required Delegation Token as IndexServer does not connect to
KDC since it is inside SparkApplication(both, Indexclient and IndexServe... (continued)

41 of 41 new or added lines in 4 files covered. (100.0%)

66778 of 84925 relevant lines covered (78.63%)

1.04 hits per line

New Missed Lines in Diff

Lines Coverage ∆ File
4
0.0
 integration/spark-common/src/main/scala/org/apache/carbondata/events/IndexServerEvents.scala
18
30.25
 -2.75% integration/spark2/src/main/scala/org/apache/carbondata/indexserver/IndexServer.scala

Uncovered Existing Lines

Lines Coverage ∆ File
1
75.0
 0.0% common/src/main/java/org/apache/carbondata/common/CarbonIterator.java
1
88.89
 0.0% common/src/main/java/org/apache/carbondata/common/constants/LoggerAction.java
1
96.15
 0.0% core/src/main/java/org/apache/carbondata/core/cache/dictionary/ForwardDictionary.java
1
85.29
 0.0% core/src/main/java/org/apache/carbondata/core/cache/dictionary/ManageDictionaryAndBTree.java
1
50.0
 0.0% core/src/main/java/org/apache/carbondata/core/datamap/AbstractDataMapJob.java
1
87.5
 0.0% core/src/main/java/org/apache/carbondata/core/datamap/dev/expr/DataMapDistributableWrapper.java
1
20.0
 0.0% core/src/main/java/org/apache/carbondata/core/datamap/dev/fgdatamap/FineGrainDataMap.java
1
71.43
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/chunk/reader/measure/AbstractMeasureChunkReader.java
1
77.55
 18.37% core/src/main/java/org/apache/carbondata/core/datastore/compression/AbstractCompressor.java
1
64.22
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/page/VarLengthColumnPageBase.java
1
96.0
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/row/CarbonRow.java
1
93.75
 0.0% core/src/main/java/org/apache/carbondata/core/indexstore/blockletindex/IndexWrapper.java
1
68.42
 0.0% core/src/main/java/org/apache/carbondata/core/indexstore/TableBlockIndexUniqueIdentifier.java
1
97.8
 0.0% core/src/main/java/org/apache/carbondata/core/keygenerator/columnar/impl/MultiDimKeyVarLengthVariableSplitGenerator.java
1
90.91
 0.0% core/src/main/java/org/apache/carbondata/core/keygenerator/mdkey/AbstractKeyGenerator.java
1
99.31
 0.0% core/src/main/java/org/apache/carbondata/core/keygenerator/mdkey/Bits.java
1
96.97
 0.0% core/src/main/java/org/apache/carbondata/core/localdictionary/dictionaryholder/MapBasedDictionaryStore.java
1
41.67
 0.0% core/src/main/java/org/apache/carbondata/core/localdictionary/exception/DictionaryThresholdReachedException.java
1
85.71
 0.0% core/src/main/java/org/apache/carbondata/core/locks/CarbonLockUtil.java
1
95.45
 0.0% core/src/main/java/org/apache/carbondata/core/memory/HeapMemoryAllocator.java
1
33.33
 0.0% core/src/main/java/org/apache/carbondata/core/reader/CarbonFooterReader.java
1
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/scan/executor/exception/QueryExecutionException.java
1
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/scan/filter/partition/OrFilterImpl.java
1
95.83
 0.0% core/src/main/java/org/apache/carbondata/core/scan/filter/partition/RangeFilterImpl.java
1
93.02
 0.0% core/src/main/java/org/apache/carbondata/core/scan/filter/resolver/resolverinfo/DimColumnResolvedFilterInfo.java
1
80.0
 0.0% core/src/main/java/org/apache/carbondata/core/scan/filter/resolver/resolverinfo/FalseConditionalResolverImpl.java
1
95.74
 0.0% core/src/main/java/org/apache/carbondata/core/scan/filter/resolver/resolverinfo/MeasureColumnResolvedFilterInfo.java
1
91.67
 0.0% core/src/main/java/org/apache/carbondata/core/scan/filter/resolver/resolverinfo/visitor/ImplicitColumnVisitor.java
1
95.65
 0.0% core/src/main/java/org/apache/carbondata/core/scan/partition/RangePartitioner.java
1
93.55
 0.0% core/src/main/java/org/apache/carbondata/core/scan/result/impl/FilterQueryScannedResult.java
1
88.24
 0.0% core/src/main/java/org/apache/carbondata/core/scan/result/impl/NonFilterQueryScannedResult.java
1
91.91
 0.0% core/src/main/java/org/apache/carbondata/core/scan/result/iterator/AbstractDetailQueryResultIterator.java
1
94.44
 0.0% core/src/main/java/org/apache/carbondata/core/scan/result/RowBatch.java
1
12.24
 0.0% core/src/main/java/org/apache/carbondata/core/scan/result/vector/impl/directread/ColumnarVectorWrapperDirectWithInvertedIndex.java
1
68.42
 0.0% core/src/main/java/org/apache/carbondata/core/statusmanager/SegmentRefreshInfo.java
1
92.31
 0.0% core/src/main/java/org/apache/carbondata/core/util/CarbonThreadFactory.java
1
98.63
 0.0% core/src/main/java/org/apache/carbondata/core/util/DataFileFooterConverterV3.java
1
91.84
 0.0% integration/spark2/src/main/java/org/apache/carbondata/datamap/IndexDataMapProvider.java
1
93.94
 0.0% integration/spark2/src/main/java/org/apache/carbondata/datamap/PreAggregateDataMapProvider.java
1
0.0
 0.0% integration/spark-common/src/main/java/org/apache/carbondata/spark/dictionary/provider/SecureDictionaryServiceProvider.java
1
85.71
 0.0% integration/spark-datasource/src/main/spark2.1andspark2.2/org/apache/spark/sql/CarbonDictionaryWrapper.java
1
96.43
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/dictionary/DictionaryServerClientDictionary.java
1
94.44
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/parser/impl/MapParserImpl.java
1
93.75
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/sort/unsafe/sort/UnsafeIntSortDataFormat.java
1
91.8
 0.0% processing/src/main/java/org/apache/carbondata/processing/util/CarbonBadRecordUtil.java
1
84.39
 0.0% store/sdk/src/main/java/org/apache/carbondata/sdk/file/AvroCarbonWriter.java
1
88.89
 0.0% store/sdk/src/main/java/org/apache/carbondata/sdk/file/JsonCarbonWriter.java
2
92.86
 0.0% core/src/main/java/org/apache/carbondata/core/cache/dictionary/ColumnReverseDictionaryInfo.java
2
88.24
 0.0% core/src/main/java/org/apache/carbondata/core/cache/dictionary/ReverseDictionary.java
2
77.27
 0.0% core/src/main/java/org/apache/carbondata/core/datamap/dev/expr/AndDataMapExprWrapper.java
2
78.95
 0.0% core/src/main/java/org/apache/carbondata/core/datamap/dev/expr/OrDataMapExprWrapper.java
2
93.62
 0.0% core/src/main/java/org/apache/carbondata/core/datamap/dev/fgdatamap/FineGrainBlocklet.java
2
84.62
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/block/BlockInfo.java
2
85.71
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/chunk/impl/AbstractDimensionColumnPage.java
2
85.33
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/chunk/impl/DimensionRawColumnChunk.java
2
76.92
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/chunk/reader/dimension/v3/CompressedDimChunkFileBasedPageLevelReaderV3.java
2
64.29
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/compression/ZstdCompressor.java
2
25.0
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/exception/CarbonDataWriterException.java
2
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/exception/IndexBuilderException.java
2
77.78
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/page/UnsafeVarLengthColumnPage.java
2
88.24
 0.0% core/src/main/java/org/apache/carbondata/core/indexstore/BlockletDataMapIndexWrapper.java
2
91.73
 0.0% core/src/main/java/org/apache/carbondata/core/indexstore/BlockletDetailInfo.java
2
88.52
 0.0% core/src/main/java/org/apache/carbondata/core/indexstore/blockletindex/BlockletDataMap.java
2
86.11
 0.0% core/src/main/java/org/apache/carbondata/core/indexstore/schema/CarbonRowSchema.java
2
96.7
 0.0% core/src/main/java/org/apache/carbondata/core/keygenerator/columnar/impl/MultiDimKeyVarLengthEquiSplitGenerator.java
2
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/locks/AlluxioFileLock.java
2
87.1
 0.0% core/src/main/java/org/apache/carbondata/core/locks/LocalFileLock.java
2
71.43
 0.0% core/src/main/java/org/apache/carbondata/core/metadata/datatype/DataTypeAdapter.java
2
89.58
 0.0% core/src/main/java/org/apache/carbondata/core/metadata/schema/table/AggregationDataMapSchema.java
2
91.67
 0.0% core/src/main/java/org/apache/carbondata/core/metadata/schema/table/RelationIdentifier.java
2
95.56
 0.0% core/src/main/java/org/apache/carbondata/core/reader/CarbonDictionaryMetadataReaderImpl.java
2
95.98
 0.0% core/src/main/java/org/apache/carbondata/core/scan/executor/impl/AbstractQueryExecutor.java
2
85.71
 0.0% core/src/main/java/org/apache/carbondata/core/scan/expression/MatchExpression.java
2
84.0
 0.0% core/src/main/java/org/apache/carbondata/core/writer/CarbonDeleteDeltaWriterImpl.java
2
82.43
 0.0% hadoop/src/main/java/org/apache/carbondata/hadoop/CarbonMultiBlockSplit.java
2
62.07
 0.0% hadoop/src/main/java/org/apache/carbondata/hadoop/readsupport/impl/DictionaryDecodeReadSupport.java
2
0.0
 0.0% processing/src/main/java/org/apache/carbondata/processing/exception/SliceMergerException.java
2
91.67
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/converter/impl/DictionaryFieldConverterImpl.java
2
90.91
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/row/CarbonRowBatch.java
2
66.67
 0.0% processing/src/main/java/org/apache/carbondata/processing/merger/CarbonDataMergerUtilResult.java
2
85.93
 0.0% processing/src/main/java/org/apache/carbondata/processing/merger/RowResultMergerProcessor.java
2
0.0
 0.0% processing/src/main/java/org/apache/carbondata/processing/sort/exception/CarbonSortKeyAndGroupByException.java
2
83.33
 0.0% processing/src/main/java/org/apache/carbondata/processing/sort/sortdata/FileMergeSortComparator.java
3
92.16
 0.0% core/src/main/java/org/apache/carbondata/core/cache/dictionary/AbstractColumnDictionaryInfo.java
3
82.14
 0.0% core/src/main/java/org/apache/carbondata/core/datamap/dev/expr/DataMapExprWrapperImpl.java
3
83.33
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/chunk/impl/VariableLengthDimensionColumnPage.java
3
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/columnar/BlockIndexerStorageForNoDictionary.java
3
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/page/ActualDataBasedFallbackEncoder.java
3
66.67
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/page/statistics/KeyPageStatsCollector.java
3
76.32
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/page/statistics/LVStringStatsCollector.java
3
87.5
 0.0% core/src/main/java/org/apache/carbondata/core/dictionary/generator/TableDictionaryGenerator.java
3
85.71
 0.0% core/src/main/java/org/apache/carbondata/core/keygenerator/mdkey/MultiDimKeyVarLengthGenerator.java
3
91.11
 0.0% core/src/main/java/org/apache/carbondata/core/metadata/AbsoluteTableIdentifier.java
3
80.0
 0.0% core/src/main/java/org/apache/carbondata/core/metadata/schema/table/column/CarbonMeasure.java
3
67.5
 0.0% core/src/main/java/org/apache/carbondata/core/scan/filter/executer/ImplicitIncludeFilterExecutorImpl.java
3
76.47
 0.0% core/src/main/java/org/apache/carbondata/core/scan/result/iterator/PartitionSpliterRawResultIterator.java
3
40.0
 0.0% core/src/main/java/org/apache/carbondata/core/scan/wrappers/IntArrayWrapper.java
3
89.86
 0.0% hadoop/src/main/java/org/apache/carbondata/hadoop/CarbonRecordReader.java
3
95.65
 0.0% integration/spark2/src/main/scala/org/apache/carbondata/stream/CarbonStreamRecordReader.java
3
94.53
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/converter/impl/RowConverterImpl.java
3
90.83
 0.0% processing/src/main/java/org/apache/carbondata/processing/sort/sortdata/TableFieldStat.java
3
89.84
 0.0% processing/src/main/java/org/apache/carbondata/processing/store/CarbonFactDataHandlerColumnar.java
4
95.39
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/chunk/reader/dimension/v3/CompressedDimensionChunkFileBasedReaderV3.java
4
75.68
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/chunk/reader/measure/v3/CompressedMsrChunkFileBasedPageLevelReaderV3.java
4
90.2
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/chunk/store/impl/LocalDictDimensionDataChunkStore.java
4
58.33
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/columnar/ColumnWithRowId.java
4
80.0
 0.0% core/src/main/java/org/apache/carbondata/core/dictionary/server/NonSecureDictionaryServerHandler.java
4
89.74
 0.0% core/src/main/java/org/apache/carbondata/core/metadata/schema/table/column/CarbonDimension.java
4
82.61
 0.0% core/src/main/java/org/apache/carbondata/core/preagg/QueryColumn.java
4
94.23
 0.0% core/src/main/java/org/apache/carbondata/core/scan/processor/DataBlockIterator.java
4
45.71
 0.0% datamap/lucene/src/main/java/org/apache/carbondata/datamap/lucene/LuceneFineGrainDataMapFactory.java
4
0.0
 0.0% integration/spark-common/src/main/java/org/apache/carbondata/spark/dictionary/client/SecureDictionaryClientHandler.java
4
88.68
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/converter/impl/NonDictionaryFieldConverterImpl.java
4
82.02
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/sort/impl/ParallelReadMergeSorterImpl.java
4
73.08
 0.0% processing/src/main/java/org/apache/carbondata/processing/merger/NodeMultiBlockRelation.java
5
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/columnar/ColumnWithRowIdForHighCard.java
5
85.71
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/impl/DefaultFileTypeProvider.java
5
82.61
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/page/DecoderBasedFallbackEncoder.java
5
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/TableSegmentUniqueIdentifier.java
5
94.79
 0.0% core/src/main/java/org/apache/carbondata/core/dictionary/generator/IncrementalColumnDictionaryGenerator.java
5
59.29
 0.0% core/src/main/java/org/apache/carbondata/core/indexstore/ExtendedBlockletWrapper.java
5
79.1
 0.0% core/src/main/java/org/apache/carbondata/core/keygenerator/directdictionary/timestamp/DateDirectDictionaryGenerator.java
5
65.91
 0.0% core/src/main/java/org/apache/carbondata/core/keygenerator/directdictionary/timestamp/TimeStampDirectDictionaryGenerator.java
5
96.77
 0.0% core/src/main/java/org/apache/carbondata/core/metadata/schema/table/TableInfo.java
5
47.37
 0.0% core/src/main/java/org/apache/carbondata/core/mutate/DeleteDeltaBlockletDetails.java
5
82.86
 0.0% core/src/main/java/org/apache/carbondata/core/readcommitter/TableStatusReadCommittedScope.java
5
84.21
 0.0% core/src/main/java/org/apache/carbondata/core/scan/complextypes/ArrayQueryType.java
5
97.7
 -0.35% core/src/main/java/org/apache/carbondata/core/scan/executor/util/RestructureUtil.java
5
44.44
 0.0% core/src/main/java/org/apache/carbondata/core/scan/expression/conditional/ImplicitExpression.java
5
76.3
 0.0% core/src/main/java/org/apache/carbondata/core/scan/expression/ExpressionResult.java
5
72.22
 0.0% core/src/main/java/org/apache/carbondata/core/scan/filter/resolver/LogicalFilterResolverImpl.java
5
81.15
 0.0% datamap/lucene/src/main/java/org/apache/carbondata/datamap/lucene/LuceneDataMapFactoryBase.java
5
83.51
 0.0% hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonFileInputFormat.java
5
94.64
 0.0% hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonTableOutputFormat.java
5
0.0
 0.0% integration/spark-common/src/main/java/org/apache/carbondata/spark/dictionary/server/SecureDictionaryServerHandler.java
5
89.47
 0.0% processing/src/main/java/org/apache/carbondata/processing/datatypes/ArrayDataType.java
5
70.97
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/AbstractDataLoadProcessorStep.java
5
87.27
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/TableProcessingOperations.java
5
0.0
 0.0% processing/src/main/java/org/apache/carbondata/processing/merger/NodeBlockRelation.java
5
70.0
 0.0% processing/src/main/java/org/apache/carbondata/processing/sort/sortdata/InMemorySortTempChunkHolder.java
5
40.0
 0.0% streaming/src/main/java/org/apache/carbondata/streaming/CarbonStreamOutputFormat.java
6
83.73
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/block/SegmentPropertiesAndSchemaHolder.java
6
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/block/TableBlockUniqueIdentifier.java
6
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/chunk/reader/measure/v1/CompressedMeasureChunkFileBasedReaderV1.java
6
66.67
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/chunk/store/impl/safe/SafeAbsractDimensionDataChunkStore.java
6
82.98
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/impl/DFSFileReaderImpl.java
6
73.08
 0.0% core/src/main/java/org/apache/carbondata/core/fileoperations/AtomicFileOperationsImpl.java
6
79.12
 0.0% core/src/main/java/org/apache/carbondata/core/indexstore/ExtendedBlocklet.java
6
72.73
 0.0% core/src/main/java/org/apache/carbondata/core/mutate/DeleteDeltaBlockDetails.java
6
65.63
 0.0% core/src/main/java/org/apache/carbondata/core/reader/CarbonDeleteDeltaFileReaderImpl.java
6
81.25
 0.0% core/src/main/java/org/apache/carbondata/core/reader/sortindex/CarbonDictionarySortIndexReaderImpl.java
6
50.0
 0.0% core/src/main/java/org/apache/carbondata/core/scan/executor/infos/DeleteDeltaInfo.java
6
86.21
 0.0% core/src/main/java/org/apache/carbondata/core/writer/sortindex/CarbonDictionarySortIndexWriterImpl.java
6
76.19
 0.0% store/sdk/src/main/java/org/apache/carbondata/sdk/file/TestUtil.java
6
90.1
 0.0% tools/cli/src/main/java/org/apache/carbondata/tool/FileCollector.java
7
83.13
 0.0% core/src/main/java/org/apache/carbondata/core/datamap/DataMapChooser.java
7
85.48
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/chunk/impl/FixedLengthDimensionColumnPage.java
7
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/columnar/ColumnWithRowIdForNoDictionary.java
7
10.14
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/page/SafeDecimalColumnPage.java
7
52.94
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/page/statistics/DummyStatsCollector.java
7
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/fileoperations/AtomicFileOperationS3Impl.java
7
17.65
 0.0% core/src/main/java/org/apache/carbondata/core/indexstore/ExtendedBlockletWrapperContainer.java
7
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/locks/S3FileLock.java
7
75.82
 0.0% core/src/main/java/org/apache/carbondata/core/metadata/schema/table/DataMapSchema.java
7
91.59
 0.0% core/src/main/java/org/apache/carbondata/core/metadata/schema/table/DiskBasedDMSchemaStorageProvider.java
7
35.29
 0.0% core/src/main/java/org/apache/carbondata/core/mutate/data/RowCountDetailsVO.java
7
87.88
 0.0% core/src/main/java/org/apache/carbondata/core/scan/complextypes/PrimitiveQueryType.java
7
88.89
 0.0% core/src/main/java/org/apache/carbondata/core/scan/complextypes/StructQueryType.java
7
57.14
 0.0% core/src/main/java/org/apache/carbondata/core/util/DataTypeConverterImpl.java
7
83.96
 0.15% core/src/main/java/org/apache/carbondata/core/util/DeleteLoadFolders.java
7
90.24
 -0.23% processing/src/main/java/org/apache/carbondata/processing/datamap/DataMapWriterListener.java
7
89.74
 0.0% processing/src/main/java/org/apache/carbondata/processing/datatypes/StructDataType.java
7
88.31
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/parser/impl/JsonRowParser.java
7
87.8
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/sort/impl/ParallelReadMergeSorterWithColumnRangeImpl.java
8
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/filesystem/S3CarbonFile.java
8
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/locks/HdfsFileLock.java
8
50.0
 0.0% core/src/main/java/org/apache/carbondata/core/mutate/UpdateVO.java
8
74.63
 0.0% core/src/main/java/org/apache/carbondata/core/scan/filter/executer/AndFilterExecuterImpl.java
8
88.79
 0.0% hadoop/src/main/java/org/apache/carbondata/hadoop/util/CarbonVectorizedRecordReader.java
8
70.97
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/sort/unsafe/holder/UnsafeInmemoryHolder.java
8
80.46
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/steps/InputProcessorStepImpl.java
8
76.64
 0.0% processing/src/main/java/org/apache/carbondata/processing/sort/sortdata/SingleThreadFinalSortFilesMerger.java
9
62.86
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/compression/GzipCompressor.java
9
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/locks/ZooKeeperLocking.java
9
88.79
 0.0% core/src/main/java/org/apache/carbondata/core/util/comparator/Comparator.java
9
67.57
 0.0% core/src/main/java/org/apache/carbondata/core/util/DataFileFooterConverter.java
9
0.0
 0.0% integration/spark2/src/main/scala/org/apache/carbondata/indexserver/DistributedCountRDD.scala
9
0.0
 0.0% processing/src/main/java/org/apache/carbondata/processing/sort/SchemaBasedRowUpdater.java
10
92.13
 0.0% core/src/main/java/org/apache/carbondata/core/cache/dictionary/ColumnDictionaryInfo.java
10
56.52
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/block/AbstractIndex.java
10
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/page/SafeVarLengthColumnPage.java
10
80.95
 0.0% core/src/main/java/org/apache/carbondata/core/dictionary/server/NonSecureDictionaryServer.java
10
86.58
 0.0% core/src/main/java/org/apache/carbondata/core/indexstore/BlockletDataMapIndexStore.java
10
77.61
 0.0% core/src/main/java/org/apache/carbondata/core/metadata/blocklet/BlockletInfo.java
10
57.14
 0.0% core/src/main/java/org/apache/carbondata/core/metadata/schema/table/column/CarbonImplicitDimension.java
10
88.03
 0.0% core/src/main/java/org/apache/carbondata/core/metadata/schema/table/TableSchema.java
10
15.38
 0.0% core/src/main/java/org/apache/carbondata/core/scan/result/vector/ColumnVectorInfo.java
10
35.71
 0.0% core/src/main/java/org/apache/carbondata/core/scan/result/vector/impl/CarbonDictionaryImpl.java
10
88.71
 0.0% core/src/main/java/org/apache/carbondata/core/writer/CarbonDictionaryWriterImpl.java
10
93.45
 -0.03% integration/spark2/src/main/scala/org/apache/carbondata/spark/rdd/CarbonTableCompactor.scala
10
87.58
 0.08% integration/spark2/src/main/scala/org/apache/spark/sql/CarbonEnv.scala
10
56.3
 0.0% processing/src/main/java/org/apache/carbondata/processing/sort/sortdata/SortTempFileChunkHolder.java
10
88.04
 0.0% processing/src/main/java/org/apache/carbondata/processing/store/writer/v3/CarbonFactDataWriterImplV3.java
10
86.91
 0.0% streaming/src/main/java/org/apache/carbondata/streaming/CarbonStreamRecordWriter.java
11
58.26
 0.0% core/src/main/java/org/apache/carbondata/core/datamap/TableDataMap.java
11
33.93
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/page/DecimalColumnPage.java
11
85.71
 0.0% core/src/main/java/org/apache/carbondata/core/indexstore/blockletindex/BlockletDataRefNode.java
11
93.78
 0.0% core/src/main/java/org/apache/carbondata/core/metadata/schema/table/column/ColumnSchema.java
11
0.0
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/sort/unsafe/holder/UnsafeFinalMergePageHolder.java
11
0.0
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/sort/unsafe/holder/UnsafeInmemoryMergeHolder.java
12
84.68
 0.0% core/src/main/java/org/apache/carbondata/core/readcommitter/LatestFilesReadCommittedScope.java
12
74.55
 0.0% core/src/main/java/org/apache/carbondata/core/scan/filter/resolver/ConditionalFilterResolverImpl.java
12
78.86
 0.0% core/src/main/java/org/apache/carbondata/core/statusmanager/LoadMetadataDetails.java
12
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/util/DataFileFooterConverter2.java
12
0.0
 0.0% integration/spark-common/src/main/java/org/apache/carbondata/spark/dictionary/client/SecureDictionaryClient.java
12
82.76
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/sort/impl/UnsafeParallelReadMergeSorterImpl.java
12
89.43
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/sort/impl/UnsafeParallelReadMergeSorterWithColumnRangeImpl.java
12
90.48
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/steps/InputProcessorStepWithNoConverterImpl.java
13
64.71
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/block/TableTaskInfo.java
13
87.46
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/page/UnsafeFixLengthColumnPage.java
13
94.06
 0.0% core/src/main/java/org/apache/carbondata/core/metadata/converter/ThriftWrapperSchemaConverterImpl.java
13
78.13
 2.69% core/src/main/java/org/apache/carbondata/core/mutate/SegmentUpdateDetails.java
13
69.81
 0.0% hadoop/src/main/java/org/apache/carbondata/hadoop/util/CarbonInputSplitTaskInfo.java
13
81.32
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/steps/DataWriterBatchProcessorStepImpl.java
14
72.58
 0.0% core/src/main/java/org/apache/carbondata/core/datamap/Segment.java
14
67.39
 0.0% core/src/main/java/org/apache/carbondata/core/indexstore/row/DataMapRowImpl.java
14
84.52
 0.19% integration/spark-common/src/main/scala/org/apache/carbondata/api/CarbonStore.scala
14
84.13
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/steps/DataWriterProcessorStepImpl.java
14
81.63
 0.0% tools/cli/src/main/java/org/apache/carbondata/tool/ScanBenchmark.java
15
82.98
 0.0% core/src/main/java/org/apache/carbondata/core/cache/dictionary/ReverseDictionaryCache.java
15
43.14
 0.0% core/src/main/java/org/apache/carbondata/core/indexstore/PartitionSpec.java
15
65.73
 0.0% core/src/main/java/org/apache/carbondata/core/util/BlockletDataMapUtil.java
15
89.66
 0.0% hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonOutputCommitter.java
15
77.91
 0.26% integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/mutation/CarbonProjectForDeleteCommand.scala
15
85.99
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/steps/CarbonRowDataWriterProcessorStepImpl.java
16
86.5
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/block/TableBlockInfo.java
16
53.7
 0.0% core/src/main/java/org/apache/carbondata/core/indexstore/row/UnsafeDataMapRow.java
17
79.05
 0.0% core/src/main/java/org/apache/carbondata/core/cache/dictionary/ForwardDictionaryCache.java
17
80.45
 1.5% core/src/main/java/org/apache/carbondata/core/datastore/chunk/store/ColumnPageWrapper.java
17
89.35
 0.0% integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/mutation/CarbonProjectForUpdateCommand.scala
18
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/chunk/store/impl/unsafe/UnsafeAbstractDimensionDataChunkStore.java
19
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/chunk/store/impl/unsafe/UnsafeFixedLengthDimensionDataChunkStore.java
19
0.0
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/sort/unsafe/holder/UnsafeSortTempFileChunkHolder.java
20
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/scan/result/vector/impl/directread/ColumnarVectorWrapperDirectWithDeleteDeltaAndInvertedIndex.java
20
50.71
 0.0% processing/src/main/java/org/apache/carbondata/processing/sort/sortdata/SortDataRows.java
21
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/chunk/reader/dimension/v1/CompressedDimensionChunkFileBasedReaderV1.java
21
82.11
 0.0% core/src/main/java/org/apache/carbondata/core/scan/filter/FilterExpressionProcessor.java
21
82.66
 0.0% core/src/main/java/org/apache/carbondata/core/scan/filter/resolver/RowLevelRangeFilterResolverImpl.java
22
66.67
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/page/encoding/adaptive/AdaptiveFloatingCodec.java
22
92.44
 0.0% core/src/main/java/org/apache/carbondata/core/metadata/schema/table/CarbonTable.java
22
82.09
 -1.87% integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/mutation/DeleteExecution.scala
22
55.8
 0.0% integration/spark-datasource/src/main/spark2.1andspark2.2/org/apache/spark/sql/CarbonVectorProxy.java
22
77.09
 0.44% processing/src/main/java/org/apache/carbondata/processing/datatypes/PrimitiveDataType.java
23
81.05
 0.0% core/src/main/java/org/apache/carbondata/core/metadata/datatype/DecimalConverterFactory.java
23
75.0
 0.0% core/src/main/java/org/apache/carbondata/core/scan/filter/executer/IncludeFilterExecuterImpl.java
23
76.63
 0.0% core/src/main/java/org/apache/carbondata/core/util/path/CarbonTablePath.java
23
76.09
 -1.01% integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/management/CarbonAddLoadCommand.scala
23
84.4
 -0.25% integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/management/CarbonAlterTableCompactionCommand.scala
23
81.02
 0.0% streaming/src/main/java/org/apache/carbondata/streaming/segment/StreamSegment.java
25
62.57
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/page/encoding/rle/RLECodec.java
26
77.4
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/sort/impl/UnsafeBatchParallelReadMergeSorterImpl.java
26
57.67
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/sort/unsafe/UnsafeSortDataRows.java
27
68.46
 -0.41% core/src/main/java/org/apache/carbondata/core/indexstore/blockletindex/BlockletDataMapFactory.java
28
68.24
 0.0% core/src/main/java/org/apache/carbondata/core/indexstore/blockletindex/SegmentIndexFileStore.java
28
68.69
 0.08% core/src/main/java/org/apache/carbondata/core/util/CarbonProperties.java
29
84.98
 0.0% core/src/main/java/org/apache/carbondata/hadoop/CarbonInputSplit.java
30
52.63
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/page/encoding/adaptive/AdaptiveDeltaFloatingCodec.java
30
78.44
 0.0% hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonInputFormat.java
31
31.71
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/chunk/store/impl/safe/AbstractNonDictionaryVectorFiller.java
33
0.0
 0.0% integration/spark-common/src/main/java/org/apache/carbondata/spark/dictionary/server/SecureDictionaryServer.java
34
41.76
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/compression/SnappyCompressor.java
35
73.89
 0.0% core/src/main/java/org/apache/carbondata/core/scan/filter/executer/RowLevelRangeGrtThanFiterExecuterImpl.java
37
30.25
 -2.75% integration/spark2/src/main/scala/org/apache/carbondata/indexserver/IndexServer.scala
37
47.25
 0.0% integration/spark-datasource/src/main/scala/org/apache/carbondata/spark/vectorreader/ColumnarVectorWrapperDirect.java
38
77.58
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/page/encoding/adaptive/AdaptiveIntegralCodec.java
38
55.56
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/page/encoding/compress/DirectCompressCodec.java
38
55.66
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/page/LocalDictColumnPage.java
38
69.0
 0.0% core/src/main/java/org/apache/carbondata/core/scan/filter/executer/RowLevelRangeGrtrThanEquaToFilterExecuterImpl.java
39
81.5
 0.0% hadoop/src/main/java/org/apache/carbondata/hadoop/stream/StreamRecordReader.java
39
91.95
 0.08% integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/management/CarbonLoadDataCommand.scala
40
83.79
 0.0% core/src/main/java/org/apache/carbondata/core/indexstore/blockletindex/BlockDataMap.java
40
0.0
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/sort/unsafe/merger/UnsafeIntermediateFileMerger.java
40
0.0
 0.0% processing/src/main/java/org/apache/carbondata/processing/sort/sortdata/IntermediateFileMerger.java
41
80.38
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/filesystem/LocalCarbonFile.java
41
93.17
 0.02% core/src/main/java/org/apache/carbondata/core/metadata/SegmentFileStore.java
42
61.74
 0.0% store/sdk/src/main/java/org/apache/carbondata/sdk/file/arrow/ArrowFieldWriter.java
43
85.06
 -6.98% core/src/main/java/org/apache/carbondata/core/statusmanager/SegmentUpdateStatusManager.java
43
82.76
 0.0% processing/src/main/java/org/apache/carbondata/processing/util/CarbonLoaderUtil.java
48
36.46
 -0.44% core/src/main/java/org/apache/carbondata/core/datamap/DistributableDataMapFormat.java
48
68.45
 0.0% core/src/main/java/org/apache/carbondata/core/scan/filter/executer/RowLevelRangeLessThanEqualFilterExecuterImpl.java
48
0.0
 0.0% processing/src/main/java/org/apache/carbondata/processing/loading/jsoninput/JsonInputFormat.java
49
0.0
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/page/SafeFixLengthColumnPage.java
49
66.86
 0.0% core/src/main/java/org/apache/carbondata/core/scan/filter/executer/RowLevelRangeLessThanFilterExecuterImpl.java
50
74.76
 -1.22% integration/spark2/src/main/scala/org/apache/carbondata/indexserver/DistributedRDDUtils.scala
58
54.65
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/page/encoding/adaptive/AdaptiveDeltaIntegralCodec.java
62
78.7
 0.32% core/src/main/java/org/apache/carbondata/core/mutate/CarbonUpdateUtil.java
68
59.26
 0.0% core/src/main/java/org/apache/carbondata/core/scan/result/vector/impl/CarbonColumnVectorImpl.java
78
75.5
 0.1% integration/spark2/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala
84
0.0
 0.0% integration/spark-datasource/src/main/scala/org/apache/carbondata/spark/vectorreader/ColumnarVectorWrapper.java
87
74.75
 0.0% core/src/main/java/org/apache/carbondata/core/util/DataTypeUtil.java
129
12.73
 0.0% core/src/main/java/org/apache/carbondata/core/datastore/filesystem/AbstractDFSCarbonFile.java
156
66.76
 0.0% core/src/main/java/org/apache/carbondata/core/scan/filter/FilterUtil.java
178
83.66
 0.02% core/src/main/java/org/apache/carbondata/core/util/CarbonUtil.java
Jobs
ID Job ID Ran Files Coverage
1 2046.1 1075
78.63
Source Files on build 2046