OverLordGoldDragon / keras-adamw / 168
95%

DEFAULT BRANCH: master
Ran
Jobs 6
Files 6
Run time 4min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
168

push

travis-ci-com

web-flow 
TF2.2 compatib, usage changes, code cleanup

**FEATURES**:
 - Compatibility with TF 2.2 (other versions still compatible, but no longer tested)
 - `eta_t` now behaves deterministically, updating after `t_cur` (previously, behavior was semi-random)
 - Lots of code cleanup

**USAGE NOTES**:
 - `t_cur` should now be set to `-1` instead of `0` to restart `eta_t`
 - `t_cur` should now be set at `iters == total_iterations - 2`; explanation [here](https://github.com/OverLordGoldDragon/keras-adamw/blob/master/tests/test_optimizers.py#L53)
 - `total_iterations` must now be `> 1`, instead of only `> 0`
 - `total_iterations <= 1` will force `weight_decays` and `lr_multipliers` to `None`

**FIXES**:
 - Optimizers will no longer zero layer penalties if weight decays cannot be applied (i.e. `total_iterations` is not `> 1`)
 - `eta_t` is now properly updated as a `tf.Variable`, instead of being an update `tf.Tensor`
 - Testing didn't actually include Eager in last version - now does

**BREAKING**:
 - `utils_225tf.py` removed
 - `utils_common.py` removed
 - `optimizers_tfpy.py` removed
 - `utils.py` code is now that of `utils_225tf.py`
 - `utils_common.py` merged with `utils.py`
 - `self.batch_size` is now an `int`, instead of `tf.Variable`

**MISC**:
 - `tests`: `/test_optimizers`, `/test_optimizers_225`, `/test_optimizers_225tf`, `test_optimizers_v2`, `test_optimizers_tfpy` removed
 - All tests now done in single file: `tests/test_optimizers.py`
 - `_update_t_cur_eta_t` and `_update_t_cur_eta_t_apply_lr_mult` added to `utils.py`
 - Updated `examples.py` and related parts in README

1265 of 1303 relevant lines covered (97.08%)

1.96 hits per line

Jobs
ID Job ID Ran Files Coverage
1 168.1 (TF_EAGER="0" TF_KERAS="0" TF_VERSION="1.14.0" KERAS_VERSION="2.2.5") 0
27.09
 Travis Job 168.1
2 168.2 (TF_EAGER="0" TF_KERAS="0" TF_VERSION="1.14.0" KERAS_VERSION="2.2.5" TF_KERAS="1") 0
37.76
 Travis Job 168.2
3 168.3 (TF_EAGER="0" TF_KERAS="0" TF_VERSION="2.2.0" KERAS_VERSION="2.3.0" TF_EAGER="1") 0
28.09
 Travis Job 168.3
4 168.4 (TF_EAGER="0" TF_KERAS="0" TF_VERSION="2.2.0" KERAS_VERSION="2.3.0") 0
28.17
 Travis Job 168.4
5 168.5 (TF_EAGER="0" TF_KERAS="0" TF_VERSION="2.2.0" KERAS_VERSION="2.3.0" TF_KERAS="1" TF_EAGER="1") 0
37.61
 Travis Job 168.5
6 168.6 (TF_EAGER="0" TF_KERAS="0" TF_VERSION="2.2.0" KERAS_VERSION="2.3.0" TF_KERAS="1") 0
37.61
 Travis Job 168.6
Source Files on build 168
Detailed source file information is not available for this build.