mars-project / mars / 384 / 2

93%

master: 93%

push

travis-ci

DataFrame initial support (#173)

* initialize dataframe

* adjust inheritance for mars/core and mars/serialize, serialize no longer inherit from mars/core, and SerializableWithKey and AttributeAsDictKey has been moved to mars/core

* move Chunk and ChunkData to mars/core

* refine import and comment

* add dataframe.proto

* add TilesableData, make TensorData inherit from it

* add SliceField

* add TilesableOperandMixin

* add new_chunks in the TilesableData, add TensorChunkData inherited from ChunkData and TensorChunk inherited from Chunk

* add new_entities

* add IndexChunkData

* add chunk type of index, series and dataframe

* add DataFrameOperandMixin

* add DataFrame datasource

* sync rough_bytes

* add decide_chunk_sizes for dataframe

* support tokenize type relative to pandas

* finish expression part of from_pandas

* move executor to top level, add dataframe execute support

* support serialize dataframe for graph

* refine ut

* fix according to codacy

* remove unused code to increase coverage

5661 of 7042 branches covered (80.39%)

Branch coverage included in aggregate %.

22874 of 25408 relevant lines covered (90.03%)

0.9 hits per line