OverLordGoldDragon / keras-adamw
97%
master: 95%

LAST BUILD BRANCH: 114-fix
DEFAULT BRANCH: master
Repo Added
Files 6
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

LAST BUILD ON BRANCH v1.3
branch: v1.3
CHANGE BRANCH
x

169

push

travis-ci-com

web-flow 
TF2.2 compatib, usage changes, code cleanup

**FEATURES**:
 - Compatibility with TF 2.2 (other versions still compatible, but no longer tested)
 - `eta_t` now behaves deterministically, updating after `t_cur` (previously, behavior was semi-random)
 - Lots of code cleanup

**USAGE NOTES**:
 - `t_cur` should now be set to `-1` instead of `0` to restart `eta_t`
 - `t_cur` should now be set at `iters == total_iterations - 2`; explanation [here](https://github.com/OverLordGoldDragon/keras-adamw/blob/master/tests/test_optimizers.py#L53)
 - `total_iterations` must now be `> 1`, instead of only `> 0`
 - `total_iterations <= 1` will force `weight_decays` and `lr_multipliers` to `None`

**FIXES**:
 - Optimizers will no longer zero layer penalties if weight decays cannot be applied (i.e. `total_iterations` is not `> 1`)
 - `eta_t` is now properly updated as a `tf.Variable`, instead of being an update `tf.Tensor`
 - Testing didn't actually include Eager in last version - now does

**BREAKING**:
 - `utils_225tf.py` removed
 - `utils_common.py` removed
 - `optimizers_tfpy.py` removed
 - `utils.py` code is now that of `utils_225tf.py`
 - `utils_common.py` merged with `utils.py`
 - `self.batch_size` is now an `int`, instead of `tf.Variable`

**MISC**:
 - `tests`: `/test_optimizers`, `/test_optimizers_225`, `/test_optimizers_225tf`, `test_optimizers_v2`, `test_optimizers_tfpy` removed
 - All tests now done in single file: `tests/test_optimizers.py`
 - `_update_t_cur_eta_t` and `_update_t_cur_eta_t_apply_lr_mult` added to `utils.py`
 - Updated `examples.py` and related parts in README

1266 of 1303 relevant lines covered (97.16%)

1.96 hits per line

Relevant lines Covered
1303 RELEVANT LINES 1266 COVERED LINES
1.96 HITS PER LINE
Source Files on v1.3

Recent builds

Builds Branch Commit Type Ran Committer Via Coverage
169 v1.3 TF2.2 compatib, usage changes, code cleanup **FEATURES**: - Compatibility with TF 2.2 (other versions still compatible, but no longer tested) - `eta_t` now behaves deterministically, updating after `t_cur` (previously, behavior was semi-rando... push web-flow travis-ci-com pending completion  
See All Builds (149)