ExpediaGroup / beekeeper / #632

88%

push

Add feature to ignore Iceberg tables (#185)

* Updated to BK-core

* Updated to path-cleanup

* Update PagingCleanupServiceTest.java

* main business logic

* adding exception

* Add DB & table name to exception message

* Update IcebergValidator.java

* Create IcebergValidatorTest.java

* Update HiveMetadataCleanerTest.java

* Updating and adding S3PathCleaner tests

Integrated LocalStack with containers. Rule is from Junit 4

* Adding IcebergValidator to constructors

* Updating Junit imports

* Update SchedulerApiaryTest.java

* Update CommonBeans

* clean-up add comment

* Remove extra deletion

* adding beans

* fix tests

* fixing it tests for metadata cleanup

* fix path cleanup

* fix main problem with tests

* Fix BeekeeperDryRunPathCleanupIntegrationTest

* revert changes to fix BeekeeperExpiredMetadataSchedulerApiaryIntegrationTest

* Added missing properties to fix BeekeeperUnreferencedPathSchedulerApiaryIntegrationTest

* Add integration test for metadatacleanup

* Update metadataHandler to catch beekeeperException

* Update path-cleanup housekeeping status

* Update beekeeper to runtime exception

* bump versions for testing

* Add Hadoop dependencies

* Update pom.xml

* Revert changes to beekeeper-path

* revert more path-cleanup

* Revert path-cleanup

* cleanup

* Added logging for table params

* add logging

* remove logs to check filters

* cleaning up

* fix validator tests

* clean up it tests

* change expired metadata handler

* fix lenient

* Add IcebergTableListenerEventFilter

* Add integration test for scheduler

* Revert versions used for testing & changelog

* Revert testing version

* Update beekeeper-scheduler-apiary/src/main/java/com/expediagroup/beekeeper/scheduler/apiary/filter/IcebergTableListenerEventFilter.java

Co-authored-by: Jay Green-Stevens <jaydenegreen@hotmail.com>

* Updating asserts and remove unused loggi... (continued)

30 of 57 new or added lines in 8 files covered. (52.63%)

1299 of 1513 relevant lines covered (85.86%)

0.86 hits per line