Commits · 3e3866c1b9202dfad3de70f9526901fd8df3423d · Florian Schiffel / ICV-mmengine_basecode

Jun 01, 2022

[Feature] Add optimizer wrapper (#265) · 3e3866c1

Mashiro authored 2 years ago


* Support multiple optimizers

* minor refinement

* improve unit tests

* minor fix

* Update unit tests for resuming or saving ckpt for multiple optimizers

* refine docstring

* refine docstring

* fix typo

* update docstring

* refactor the logic to build multiple optimizers

* resolve comments

* ParamSchedulers spports multiple optimizers

* add optimizer_wrapper

* fix comment and docstirng

* fix unit test

* add unit test

* refine docstring

* RuntimeInfoHook supports printing multi learning rates

* resolve comments

* add optimizer_wrapper

* fix mypy

* fix lint

* fix OptimizerWrapperDict docstring and add unit test

* rename OptimizerWrapper to OptimWrapper, OptimWrapperDict inherit OptimWrapper, and fix as comment

* Fix AmpOptimizerWrapper

* rename build_optmizer_wrapper to build_optim_wrapper

* refine optimizer wrapper

* fix AmpOptimWrapper.step, docstring

* resolve confict

* rename DefaultOptimConstructor

* fix as comment

* rename clig grad auguments

* refactor optim_wrapper config

* fix docstring of DefaultOptimWrapperConstructor

fix docstring of DefaultOptimWrapperConstructor

* add get_lr method to OptimWrapper and OptimWrapperDict

* skip some amp unit test

* fix unit test

* fix get_lr, get_momentum docstring

* refactor get_lr, get_momentum, fix as comment

* fix error message

Co-authored-by: zhouzaida <zhouzaida@163.com>

3e3866c1

May 31, 2022

[Feature] Support multiple optimizers (#235) · f1da9a1d

Zaida Zhou authored 2 years ago

* Support multiple optimizers

* minor refinement

* improve unit tests

* minor fix

* Update unit tests for resuming or saving ckpt for multiple optimizers

* refine docstring

* refine docstring

* fix typo

* update docstring

* refactor the logic to build multiple optimizers

* resolve comments

* ParamSchedulers spports multiple optimizers

* refine docstring

* RuntimeInfoHook supports printing multi learning rates

* resolve comments

* fix typo

f1da9a1d

May 26, 2022

[Enhance] Add RuntimeInfoHook to update runtime information. (#254) · 4705e1fe

RangiLyu authored 2 years ago

* [Enhance] Add RuntimeInfoHook to update runtime information.

* move lr to runtime info

* docstring

* resolve comments

* update ut and doc

4705e1fe

May 20, 2022

[Fix] Fix some bugs in hooks and runner. (#242) · 11688507

RangiLyu authored 2 years ago

* [Fix] Fix some bugs in hooks and runner.

* fix markdown

* fix latex formula

* resolve comments

11688507

May 19, 2022

[Feature] Support EMA and SWA. (#239) · 0279ac2e

RangiLyu authored 2 years ago

* [Feature] Support EMA and SWA.

* add ema hook

* add avg model ut

* add more unit tests

* resolve comments

* fix warmup ema

* rename

* fix comments

* add assert

* fix typehint

* add comments

0279ac2e

May 18, 2022
- [Refactor] Make loop-related attributes to be runner's properties. (#236) · e37f1f90
  RangiLyu authored 2 years ago
  
  * [Enhance] Make loop related attributes to be runner's properties. * move iter and epoch to loop * resolve comments
  e37f1f90
May 06, 2022

[Fix] Fix some code and docstring in LogProcessor and LoggerHook (#213) · 859f4d15

Mashiro authored 2 years ago

* fix logger hook

* fix to record multi-level logs, log train/a/b to a/b

* fix loggerhook json path

* fix uunit test

* change runner.train_dataloader to runner.train_loop.dataloader

* clean debug code

* refie comments and docstring

* fix unit test

859f4d15

May 05, 2022
- [Fix] change CheckPointHook before_run to before train (#214) · 50078256
  Mashiro authored 2 years ago
  
  * change CheckPointHook before_run to before train * using tmp_path in each checkpointhook test case
  50078256
Apr 25, 2022

[Fix] resolve conflict betweem adapt and main. (#198) · e0d00c5b

Mashiro authored 2 years ago


* [Docs] Refine registry documentation (#186)

* [Docs] Refine registry documentation

* reslove comments

* minor refinement

* Refine Visualizer docs (#177)

* Refine Visualizer docs

* update

* update

* update featmap

* update docs

* update visualizer docs

* [Refactor] Refine LoggerHook (#155)

* rename global accessible and intergration get_sintance and create_instance

* move ManagerMixin to utils

* fix as docstring and seporate get_instance to get_instance and get_current_instance

* fix lint

* fix docstring, rename and move test_global_meta

* rename LogBuffer to HistoryBuffer, rename MessageHub methods, MessageHub support resume

* refine MMLogger timestamp, update unit test

* MMLogger add logger_name arguments

* Fix docstring

* Add LogProcessor and some unit test

* update unit test

* complete LogProcessor unit test

* refine LoggerHook

* solve circle import

* change default logger_name to mmengine

* refactor eta

* Fix docstring comment and unitt test

* Fix with runner

* fix docstring

fix docstring

* fix docstring

* Add by_epoch attribute to LoggerHook and fix docstring

* Please mypy and fix comment

* remove \ in MMLogger

* Fix lint

* roll back pre-commit-hook

* Fix hook unit test

* Fix comments

* remove \t in log and add docstring

* Fix as comment

* should not accept other arguments if corresponding instance has been created

* fix logging ddp file saving

* fix logging ddp file saving

* move log processor to logging

* move log processor to logging

* remove current datalaoder

* fix docstring

* fix unit test

* add learing rate in messagehub

* Support output training/validation/testing message after iterations/epochs

* fix docstring

* Fix IterBasedRunner log string

* Fix IterBasedRunner log string

* Support parse validation loss in log processor

* [Enhancement] Add PolyParamScheduler, PolyMomentum and PolyLR (#188)

* [Enhancement] Add PolyParamScheduler, PolyMomentum and PolyLR

* min_lr -> eta_min, refined docstr

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Co-authored-by: Haian Huang(深度眸) <1286304229@qq.com>
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>

e0d00c5b

Apr 24, 2022

[Refactor] Refine LoggerHook (#155) · e2a2b043

Mashiro authored 2 years ago

* rename global accessible and intergration get_sintance and create_instance

* move ManagerMixin to utils

* fix as docstring and seporate get_instance to get_instance and get_current_instance

* fix lint

* fix docstring, rename and move test_global_meta

* rename LogBuffer to HistoryBuffer, rename MessageHub methods, MessageHub support resume

* refine MMLogger timestamp, update unit test

* MMLogger add logger_name arguments

* Fix docstring

* Add LogProcessor and some unit test

* update unit test

* complete LogProcessor unit test

* refine LoggerHook

* solve circle import

* change default logger_name to mmengine

* refactor eta

* Fix docstring comment and unitt test

* Fix with runner

* fix docstring

fix docstring

* fix docstring

* Add by_epoch attribute to LoggerHook and fix docstring

* Please mypy and fix comment

* remove \ in MMLogger

* Fix lint

* roll back pre-commit-hook

* Fix hook unit test

* Fix comments

* remove \t in log and add docstring

* Fix as comment

* should not accept other arguments if corresponding instance has been created

* fix logging ddp file saving

* fix logging ddp file saving

* move log processor to logging

* move log processor to logging

* remove current datalaoder

* fix docstring

* fix unit test

* add learing rate in messagehub

* Support output training/validation/testing message after iterations/epochs

* fix docstring

* Fix IterBasedRunner log string

* Fix IterBasedRunner log string

* Support parse validation loss in log processor

e2a2b043

Apr 21, 2022

[Enhancement] Refine logging. (#148) · 82a313d0

Mashiro authored 2 years ago

* rename global accessible and intergration get_sintance and create_instance

* move ManagerMixin to utils

* fix as docstring and seporate get_instance to get_instance and get_current_instance

* fix lint

* fix docstring, rename and move test_global_meta

* rename LogBuffer to HistoryBuffer, rename MessageHub methods, MessageHub support resume

* refine MMLogger timestamp, update unit test

* MMLogger add logger_name arguments

* Fix docstring

* change default logger_name to mmengine

* Fix docstring comment and unitt test

* fix docstring

fix docstring

* fix docstring

* Fix lint

* Fix hook unit test

* Fix comments

* should not accept other arguments if corresponding instance has been created

* fix logging ddp file saving

* fix logging ddp file saving

* fix docstring

* fix unit test

* fix docstring as comment

82a313d0

Apr 15, 2022

refactor visualization (#147) · 5f8f36e6

liukuikun authored 2 years ago


* [WIP] add inline

* refactor vis module

* [Refactor] according review

* [Fix] fix comment

* fix some error

* Get sub visualizer be Visualizer.get_instance

* fix conflict

* fix lint

* fix unit test

* fix mypy

* fix comment

* fix lint

* update docstr

* update

* update instancedata

* remove replace __mro__ with issubclass

Co-authored-by: PJLAB\huanghaian <1286304229@qq.com>
Co-authored-by: HAOCHENYE <21724054@zju.edu.cn>

5f8f36e6

Apr 12, 2022

Haochenye/fix logging (#167) · 605e78be

Mashiro authored 2 years ago

* remove LoggerHook master_only

* remogve \t in log string

* fix lint

* Fix lint

605e78be

Apr 08, 2022
- [Refactor] Refactor data_batch type and remove cur_dataloader in runner. (#171) · 59cc08e3
  RangiLyu authored 3 years ago
  
  * [Refactor] Refactor data_batch type. * fix sampler * [Refactor] Remove cur_dataloader in runner. * fix set_epoch
  59cc08e3
Mar 31, 2022

[Enhancement] refactor base data element (#143) · 7e246b6f

liukuikun authored 3 years ago

* [Enhancement] refactor base data elment

* fix comment

* fix comment

* fix pop not existing key without error

7e246b6f

Mar 29, 2022
- [Refactor] Add batch_idx to hook input. (#140) · 9a61b389
  RangiLyu authored 3 years ago
  
  * [Refactor] Add batch_idx to hook input. * update
  9a61b389
Mar 25, 2022
- [Feature]: Add dist semantics in checkpoint hook (#131) · 26f24296
  Yuan Liu authored 3 years ago
  
  * [Feature]: Add dist semantics in checkpoint hook * [Fix]: Delete sync buffer in checkpoint hook
  26f24296
Mar 13, 2022

[Refactor] Refactor the interfaces of Hook and its subclassed (#117) · a7961407

Mashiro authored 3 years ago

* Fix hook

* Fix

* Fix docs

* FIx

* Fix

* Fix as comment

* update

* Fix hook

* Fix hook

* Fix hook

* Fix itertimerhook

* Fix iter_timer_hook

* Fix

* Fix

* fix logger hook

* Fix loggerhook

* update cur_dataloader

* Fix docstring

* Fix docstring

* Fix as commet

* Fix as commet

* Fix as comment

* rename is_last_epoch, enhance and add after_val before_val .etc

* fix typo in docstring

* remove resolved TODO

* refactor docstring

a7961407

Mar 12, 2022

[Refactor]: Change scheduler to param_scheduler (#121) · 755f8b5b

Yuan Liu authored 3 years ago


* [Refactor]: Change scheduler to param_scheduler

* [Fix]: Fix UT of param scheduler hook

Co-authored-by: Your <you@example.com>

755f8b5b

Mar 10, 2022

[Feature] NaiveVisualizationHook (#98) · 3e0c064f

liukuikun authored 3 years ago

* [WIP] testvisualizationhook

* add TestNaiveVisualizationHook

* fix comment

* unpad

* batch imdenormalize

* fix comment

* fix comment

3e0c064f

Mar 09, 2022
- Fix test_get_max_memory (#113) · 2e4ae21f
  Mashiro authored 3 years ago
  
  2e4ae21f
Mar 08, 2022

[Feature] Add LoggerHook (#77) · 6f69039c

Mashiro authored 3 years ago

* add logger hook

* update

* update

* update test

* update

* update test

* update

* update

* update

* update

* update

* Add logger hook

* Fix pre-commit

* Fix as comment

* Fix as comment

* Fix as comment

* Fix as comment

* Fix as comment

* Fix bytes

* update

* Fix as comment

* Fix as comment

* Update runner

* Fix as comment

* Fix as comment

* Fix as comment

* Fix as comment

6f69039c

Mar 07, 2022

[Fix]: Change the type of runner in docstring to Runner (#103) · be997178

Yuan Liu authored 3 years ago


* [Fix]: Change after inter and epoch to after train iter and epoch

* [Fix]: Add new UT to param scheduler hook

* [Fix]: Change the type of runner in docstring to Runner

Co-authored-by: Your <you@example.com>

be997178

Mar 03, 2022

[Feature] Add Sync Buffer Hook (#57) · 149248ce

Yifei Yang authored 3 years ago


* [Feature]: Add Part3 of Hooks

* [Feature]: Add Hook

* [Fix]: Add docstring and type hint for base hook

* add sync buffer hook

* update typing hint and docs

* fix lint

* fix mypy

* fix lint

* use mock from unittest

Co-authored-by: seuyou <3463423099@qq.com>

149248ce

Mar 02, 2022

[Feature]: Add checkpoint hook (#66) · cf239a2b

Yuan Liu authored 3 years ago

* [Feature]: Add checkpoint hook

* [Fix]: Fix lint

* [Fix]: Delete redundant optional and give an example to our_dir

* [Feature]: Add test the last_ckpt in UT

* [Fix]: Fix docstring problem

* [Fix]: Add patch to UT

* [Feature]: Add Test case for by epoch

cf239a2b

use unittest mock (#71) · 24483803
Yifei Yang authored 3 years ago

24483803

[Feature] Add empty cache hook (#58) · 94ab45d0

Yifei Yang authored 3 years ago


* [Feature]: Add Part3 of Hooks

* [Feature]: Add Hook

* [Fix]: Add docstring and type hint for base hook

* [Fix]: Add test case to not the last iter, inner_iter, epoch

* [Fix]: Add missing type hint

* [Feature]: Add Args and Returns in docstring

* [Fix]: Add missing colon

* [Fix]: Add optional to docstring

* [Fix]: Fix docstring problem

* [Fix]: Fix lint

* fix lint

* update typing and docs

* fix lint

* Update mmengine/hooks/empty_cache_hook.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Update mmengine/hooks/empty_cache_hook.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Update mmengine/hooks/empty_cache_hook.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Update tests/test_hook/test_empty_cache_hook.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* fix lint

* fix comments

* remove test condition

Co-authored-by: seuyou <3463423099@qq.com>
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

94ab45d0

Mar 01, 2022

[Feature]: Add optimizer hook (#70) · 63a3af4f

Yuan Liu authored 3 years ago

* [Feature]: Add optimizer hook

* [Fix]: Update docstring

* [Fix]: Add call with in UT

63a3af4f

[Feature]: Add param scheduler hook (#63) · ab31e193

Yuan Liu authored 3 years ago

* [Feature]: Add param scheduler hook

* [Fix]: update docstring and add assert_call to UT

ab31e193

[Feature]: Add sampler seed hook (#64) · 2d3e9124
Yuan Liu authored 3 years ago
```
* [Feature]: Add sampler seed hook

* [Fix]: Add call with to UT
```
2d3e9124

[Feature] Add Iter Timer Hook (#48) · 1244e486

Yifei Yang authored 3 years ago


* [Feature]: Add Part3 of Hooks

* [Feature]: Add Hook

* add iter timer hook

* update test

* [Fix]: Add docstring and type hint for base hook

* fix mypy

* improve doc coverage and merge main

Co-authored-by: seuyou <3463423099@qq.com>

1244e486

Feb 26, 2022

[Feature]: Add base Hook (#47) · bc759e55

Yuan Liu authored 3 years ago


* [Feature]: Add Part3 of Hooks

* [Feature]: Add Hook

* [Fix]: Add docstring and type hint for base hook

* [Fix]: Add test case to not the last iter, inner_iter, epoch

* [Fix]: Add missing type hint

* [Feature]: Add Args and Returns in docstring

* [Fix]: Add missing colon

* [Fix]: Add optional to docstring

* [Fix]: Fix docstring problem

* [Fix]:typo

* [Fix]: Fix lint

Co-authored-by: Your <you@example.com>

bc759e55