vanvalenlab / kiosk-redis-consumer / 61

96%

push

travis-ci

replace data processing functions with gRPC API client (#16)

* add gRPC client for data processing along with DP_HOST and DP_PORT as env vars

* remove processing.py and replace with ProcessClient calls in consumer

* update protos and pbs to enable StreamProcess with gRPC server along with grpc_client.stream_process to stream data in 64kB chunks to server

* utils.py 100% coverage but ignoring grpc_clients.py from coverage for now as grpcio_testing is poorly documented

* Add ZipFileConsumer and CONSUMER_TYPE to toggle between the two

* setting in_tensor_dtype dynamically based on model_name [if "f16" is in the model_name, cast to integer, not "half"]

* add env var GRPC_TIMEOUT (default 30) to set the timout for grpc requests

* process each key inside pre/postprocess functions.  Use while loop for gRPC retry for memory issue

* upgrade grpc version to 1.18.0

* add deploy stage to travis.yml

207 of 207 new or added lines in 5 files covered. (100.0%)

453 of 555 relevant lines covered (81.62%)

2.45 hits per line