airbnb / streamalert / 5905

96%

master: 95%

push

travis-ci

Migrate sources to cluster (#1008)

* Added data_sources to clusters

* Moved sources to cluster config

* Updated unit tests

* Changed CLUSTERS env var to actual cluster

* Updated tests, docs and references to sources TLK

* Docs update

* Python 2-3 compat issue

* Pylint fixes

* Realized validate sources is an internal function

* Added data_sources TLK to example json blocks

* Switched from using tuples

* Quote cleanup, moved more code into validate_sources

* More cleanup

* Get env variable at load time not runtime

* Fix cluster env errors, detect duplicate data sources

* Removed no-op i forgot about from testing

* Fixed docs errors, corrected dupe source checking

* Fixed confusion with missing sources versus invalid sources

* Fixed some namespacing and import order from rebase

* Fixed more namespacing

* Fixed global loading sources config in test classifier

* Added multi cluster support for testing

* Fixed some bad decisions

* Name changes

* Added brea for finding cluster in cli handler

* Wording cleanup, error on missind data_sources, other cleanup

* Fixed a missing ,

23 of 23 new or added lines in 2 files covered. (100.0%)

5533 of 5756 relevant lines covered (96.13%)

0.96 hits per line