[Refactor] Refactor the accumulate gradient implemention of OptimWrapper (#284)
* merge context * update unit test * add docstring * fix bug in AmpOptimWrapper * add docstring for backward * add warning and docstring for accumuate gradient * fix docstring * fix docstring * add params_group method * fix as comment * fix as comment * make default_value of loss_scale to dynamic * Fix docstring * decouple should update and should no sync * rename attribute in OptimWrapper * fix docstring * fix comment * fix comment * fix as comment * fix as comment and add unit test
Showing
- mmengine/model/base_model/base_model.py 2 additions, 2 deletionsmmengine/model/base_model/base_model.py
- mmengine/model/wrappers/distributed.py 2 additions, 2 deletionsmmengine/model/wrappers/distributed.py
- mmengine/optim/optimizer/amp_optimizer_wrapper.py 18 additions, 4 deletionsmmengine/optim/optimizer/amp_optimizer_wrapper.py
- mmengine/optim/optimizer/default_constructor.py 1 addition, 1 deletionmmengine/optim/optimizer/default_constructor.py
- mmengine/optim/optimizer/optimizer_wrapper.py 170 additions, 109 deletionsmmengine/optim/optimizer/optimizer_wrapper.py
- mmengine/optim/optimizer/optimizer_wrapper_dict.py 44 additions, 66 deletionsmmengine/optim/optimizer/optimizer_wrapper_dict.py
- mmengine/runner/loops.py 8 additions, 14 deletionsmmengine/runner/loops.py
- mmengine/runner/runner.py 10 additions, 6 deletionsmmengine/runner/runner.py
- tests/test_model/test_wrappers/test_model_wrapper.py 28 additions, 10 deletionstests/test_model/test_wrappers/test_model_wrapper.py
- tests/test_optim/test_optimizer/test_optimizer_wrapper.py 85 additions, 90 deletionstests/test_optim/test_optimizer/test_optimizer_wrapper.py
- tests/test_optim/test_optimizer/test_optimizer_wrapper_dict.py 61 additions, 50 deletions.../test_optim/test_optimizer/test_optimizer_wrapper_dict.py
- tests/test_runner/test_runner.py 4 additions, 1 deletiontests/test_runner/test_runner.py
Loading
Please register or sign in to comment