Skip to content
Snippets Groups Projects
  • Mashiro's avatar
    3e3866c1
    [Feature] Add optimizer wrapper (#265) · 3e3866c1
    Mashiro authored
    
    * Support multiple optimizers
    
    * minor refinement
    
    * improve unit tests
    
    * minor fix
    
    * Update unit tests for resuming or saving ckpt for multiple optimizers
    
    * refine docstring
    
    * refine docstring
    
    * fix typo
    
    * update docstring
    
    * refactor the logic to build multiple optimizers
    
    * resolve comments
    
    * ParamSchedulers spports multiple optimizers
    
    * add optimizer_wrapper
    
    * fix comment and docstirng
    
    * fix unit test
    
    * add unit test
    
    * refine docstring
    
    * RuntimeInfoHook supports printing multi learning rates
    
    * resolve comments
    
    * add optimizer_wrapper
    
    * fix mypy
    
    * fix lint
    
    * fix OptimizerWrapperDict docstring and add unit test
    
    * rename OptimizerWrapper to OptimWrapper, OptimWrapperDict inherit OptimWrapper, and fix as comment
    
    * Fix AmpOptimizerWrapper
    
    * rename build_optmizer_wrapper to build_optim_wrapper
    
    * refine optimizer wrapper
    
    * fix AmpOptimWrapper.step, docstring
    
    * resolve confict
    
    * rename DefaultOptimConstructor
    
    * fix as comment
    
    * rename clig grad auguments
    
    * refactor optim_wrapper config
    
    * fix docstring of DefaultOptimWrapperConstructor
    
    fix docstring of DefaultOptimWrapperConstructor
    
    * add get_lr method to OptimWrapper and OptimWrapperDict
    
    * skip some amp unit test
    
    * fix unit test
    
    * fix get_lr, get_momentum docstring
    
    * refactor get_lr, get_momentum, fix as comment
    
    * fix error message
    
    Co-authored-by: default avatarzhouzaida <zhouzaida@163.com>
    [Feature] Add optimizer wrapper (#265)
    Mashiro authored
    
    * Support multiple optimizers
    
    * minor refinement
    
    * improve unit tests
    
    * minor fix
    
    * Update unit tests for resuming or saving ckpt for multiple optimizers
    
    * refine docstring
    
    * refine docstring
    
    * fix typo
    
    * update docstring
    
    * refactor the logic to build multiple optimizers
    
    * resolve comments
    
    * ParamSchedulers spports multiple optimizers
    
    * add optimizer_wrapper
    
    * fix comment and docstirng
    
    * fix unit test
    
    * add unit test
    
    * refine docstring
    
    * RuntimeInfoHook supports printing multi learning rates
    
    * resolve comments
    
    * add optimizer_wrapper
    
    * fix mypy
    
    * fix lint
    
    * fix OptimizerWrapperDict docstring and add unit test
    
    * rename OptimizerWrapper to OptimWrapper, OptimWrapperDict inherit OptimWrapper, and fix as comment
    
    * Fix AmpOptimizerWrapper
    
    * rename build_optmizer_wrapper to build_optim_wrapper
    
    * refine optimizer wrapper
    
    * fix AmpOptimWrapper.step, docstring
    
    * resolve confict
    
    * rename DefaultOptimConstructor
    
    * fix as comment
    
    * rename clig grad auguments
    
    * refactor optim_wrapper config
    
    * fix docstring of DefaultOptimWrapperConstructor
    
    fix docstring of DefaultOptimWrapperConstructor
    
    * add get_lr method to OptimWrapper and OptimWrapperDict
    
    * skip some amp unit test
    
    * fix unit test
    
    * fix get_lr, get_momentum docstring
    
    * refactor get_lr, get_momentum, fix as comment
    
    * fix error message
    
    Co-authored-by: default avatarzhouzaida <zhouzaida@163.com>