Commits · f1aca8e307c32d4195ca065e18536b23b20c668c · Florian Schiffel / ICV-mmengine_basecode · GitLab

Snippets Groups Projects

Apr 20, 2023

[Fix] Failed to remove the previous best checkpoints (#1086) · f1aca8e3

Mashiro authored 1 year ago

* [Fix] Only reserve one best checkpoint

* [Fix] Only reserve one best checkpoint

* Fix unit test

* shutdown logging

* clean the save_checkpoint logic

f1aca8e3

[Fix] Call SyncBufferHook before validation in IterBasedTrainLoop (#982) · 6ebb6f83

Luo Yihang authored 1 year ago


* [Fix] Call SyncBufferHook before validation in IterBasedTrainLoop

* Add before_val_epoch in SyncBuffersHook

* Fix white space format

* Add comments for SyncBuffersHook

* Add comments for SyncBuffersHook

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Add comments for SyncBuffersHook

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Fix white space format

* Add before_test_epoch

* Remove before_test_epoch

---------

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

6ebb6f83

[Fix] Fix merge ci (#1089) · 0e5f9da6
Mashiro authored 1 year ago
```
* fix main ci

* Fix

* Fix

* Fix
```
Unverified

0e5f9da6
[Fix] KeyError is thrown in _collect_scalars when log_with_hierarchy is True (#1085) · be347df7
Mashiro authored 1 year ago
```
* Fix log processor

* Fix custom key
```
Unverified

be347df7

Apr 14, 2023

[Enhance] Support configuring directory used to synchronize results in BaseMetric (#1074) · a7d4b7c7

Mashiro authored 1 year ago


* [Enhance] Support configuring synchronize directory for BaseMetric

* Raise error if tmpdir is not an shared dirctory for ann ranks

* Raise error if tmpdir is not an shared dirctory for ann ranks

* Update mmengine/evaluator/metric.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* refine

* Update mmengine/evaluator/metric.py

---------

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

a7d4b7c7

[Feature] Support MLU backend (#1075) · 60b4c199

黄启元 authored 1 year ago

* support mlu device

* support mlu device

* fix lint error

* fix lint error builder.py

* fix lint error in amp.py

* fix lint errors

* fix data type in instance_data.py

60b4c199

Apr 12, 2023
- Fix] Fix three typos in runner (#1068) · f22002ec
  t chan authored 1 year ago
  
  Unverified
  
  f22002ec
- [Docs] Translate tutorials/evaluation.md (#1053) · 6b366f23
  LEFTeyes authored 1 year ago
  
  * [Docs] Translate tutorials/evaluation.md
  Unverified
  
  6b366f23
- [Docs] Translate the migration/hook.md to English (#1054) · 7877f851
  SheffieldCao authored 1 year ago
  
  * [Docs] add en version doc migration/hook.md * [Docs] modifications to en/migration/hook.md
  Unverified
  
  7877f851
- [Fix] Fix publish multiple checkpoints when using multiple GPUs (#1059) (#1070) · d41906fa
  Junwei Zheng authored 1 year ago
  
  Unverified
  
  d41906fa
Apr 11, 2023

[Docs] Introduce the use of wandb and tensorboard (#912) · 9207e84a

Zaida Zhou authored 1 year ago

* [Docs] Introduce the use of wandb and tensorboard

* fix link

* Update docs/en/common_usage/visualize_training_log.md

9207e84a

Apr 10, 2023

[Enhance] Complement type hint of get_model_complexity_info() (#1064) · 5da24ed1

sjiang95 authored 1 year ago


* Complement type hint of get_model_complexity_info()

The type of `inputs` should be one of `torch.Tensor`,
`tuple[torch.Tensor, ...]` and `None`.

Signed-off-by: Shengjiang QUAN <qsj287068067@126.com>

* Update print_helper.py

---------

Signed-off-by: Shengjiang QUAN <qsj287068067@126.com>
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

5da24ed1

[Feature] Support registering partial functions and more (#595) · b2ad2210

Qian Zhao authored 1 year ago


* support registering partial functions

* Update mmengine/registry/build_functions.py

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* Update mmengine/registry/registry.py

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* Revert unit test and refine

* add current logger and set log level

---------

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>
Co-authored-by: HAOCHENYE <21724054@zju.edu.cn>

b2ad2210

[Enhance] Make the parameters of get_model_complexity_info() friendly (#1056) · f76218a4

sjiang95 authored 1 year ago


* print_helper: optimize inputs of get_model_complexity_info

Signed-off-by: Shengjiang QUAN <qsj287068067@126.com>

* directly throw error

When "input_shape" and "inputs" are both `None` or both set,
throw ValueError.

Signed-off-by: Shengjiang QUAN <qsj287068067@126.com>

---------

Signed-off-by: Shengjiang QUAN <qsj287068067@126.com>

f76218a4

[Enhance] Allow users to customize worker_init_fn of Dataloader (#1038) · 5e1ed7aa
shufan wu authored 1 year ago
```
* customize worker init fn function

* add assert

* narrow worker_init_fn type
```
Unverified

5e1ed7aa
[Enhance] Remove useless variable declaration (#1052) · eea2c278
Mashiro authored 1 year ago

Unverified

eea2c278
[Enhancement] Support BoolTensor and LongTensor on Ascend NPU (#1011) · 1c67f9eb
Yinlei Sun authored 1 year ago

Unverified

1c67f9eb

Apr 07, 2023

[Feature] Add vis backend for MLflow. (#878) · 8bf1ecad
sung-hwa kim authored 1 year ago
```
* add vis mlflow backend
```
Unverified

8bf1ecad

[Refactor] Refactor logger hook unit tests (#797) · 5762b288

Mashiro authored 1 year ago


* Enhance config

* add unit test data

* reafactor unittest of loggerhook

* fix rebase error

* Fix permission error in windows

* Fix CI

* Fix windows ci

* Fix windows ci

* Fix windows ci

* Fix windows CI

* Apply suggestions from code review

Co-authored-by: Qian Zhao <112053249+C1rN09@users.noreply.github.com>

* clean the code

* Refine as comment

* Refine error rasing

* Update mmengine/hooks/logger_hook.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* replace assert_called_with with assert_has_calls

* Fix as comment

* Do not remove filehandler and fix unit test

---------

Co-authored-by: Qian Zhao <112053249+C1rN09@users.noreply.github.com>
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

5762b288

Apr 06, 2023

Bump version to v0.7.2 (#1051) · f291212b

Mashiro authored 1 year ago


* Bump version to v0.7.2

* minor refine

* Update docs/en/notes/changelog.md

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

---------

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

f291212b

[Refactor] Refactor checkpointhook unit tests (#789) · 2dbc8ed2

Mashiro authored 1 year ago

* Enhance config

* add unit test data

* Refacotr unitest of checkpointhook

* add comments

* Fix unit test

* remove _get_metric_scope

* tmp save

* Revert "remove _get_metric_scope"

This reverts commit eeb7a8c5ed2766bf773a9ed28f731fddacd10ac1.

* Revert "Revert "remove _get_metric_scope""

This reverts commit 5398255f6fb3dac8341f7d808f0d7d09350fcaae.

* Revert "tmp save"

This reverts commit cdc9919be8e0a78bbf264c060de2a4396c137d5a.

* clean the code

* Fix ut

* minor fix

* use str.replace

2dbc8ed2

Apr 05, 2023
- [Fix] Initialize nested modules in ddp which define 'init_weights' method (#1045) · dc931fd2
  Mashiro authored 1 year ago
  
  Unverified
  
  dc931fd2
Apr 04, 2023
- [Fix] Update the ClassBalancedDataset logic to keep len(repeat_factors) = len(dataset) (#1048) · fd84c210
  BigDong authored 1 year ago
  
  Unverified
  
  fd84c210
Apr 03, 2023

[Enhancement] Align the evaluation result in log (#1034) · 093068e4

zhouhui authored 1 year ago

* align the evaluation result in log

* align the evaluation result in log

* align the evaluation result in log

* align the evaluation result in log

* fix test log_processor

093068e4

[Enhance] Suppress registry warning (#1043) · 0139e6eb
Mashiro authored 1 year ago

v0.7.1 Unverified

0139e6eb

Bump version to 0.7.1 (#1007) · 4d7a2934

Mashiro authored 1 year ago


* bump version to 0.7.1

bump version to 0.7.1

* update change log and readme

* Update docs/en/notes/changelog.md

* refine highlight

refine highlight

---------

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

4d7a2934

Mar 30, 2023

[Enhance] Make sure the FileHandler still alive after `torch.compile` (#1021) · 83c4f3e6

Mashiro authored 1 year ago

* [Enhance] Make sure the FileHandler still alive after

* Resume filter

* avoid bc

* Fix unit test

* clean the code

* revert changes and set mode from 'm' to 'a'

* mode to file_mode

* add comments

* refine comments

* Fix duplicated the

83c4f3e6

Mar 29, 2023

[Enhancement] Do not print config if it is empty (#1028) · b3b1e11b
Zaida Zhou authored 1 year ago

Unverified

b3b1e11b
[Enhance] Do no catch unnecessary exceptions in registry (#1010) · 26a7a92a
Mashiro authored 1 year ago

Unverified

26a7a92a
Skip test_dist in Github Action (#1027) · 30c5996a
Mashiro authored 1 year ago

Unverified

30c5996a

[Fix] Add PyTorch 2.0 CI and fix unit tests (#1026) · eb79d64a

Mashiro authored 1 year ago


* [Enhance] Make sure the FileHandler still alive after

* minor refine

* minor refine

* refine unit test

* update CI

* update CI

* Fix CI

* fix build_windows

* fix build_windows

* fix build_windows

* fix build_windows

* debug

* debug

* debug

* debug

* debug

* debug

* debug

* test windows CI

* Fix

* Debug

* Fix unit test

* Fix unit test

* Fix CI

* update image version

* update action/checkout and action/setup-python

* add condition to skip test compile

* [Fix] Update CI and fix unit test

* check compiling by attempting compilation

* check compiling by attempting compilation

* check compiling by attempting compilation

* use windows-2022 in runs on

* Apply suggestions from code review

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* update yml

* remove unnecessary assert

* assert grad is None according to the PyTorch version

* Fix code

---------

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

eb79d64a

[Feature] Publish models after training if published_keys is set in CheckpointHook (#987) · 5b35c5b6

KerwinKai authored 1 year ago


* add publish keys in checkpointhook and update hook.md file

* Update checkpoint_hook.py

To avoid `mypy` warning `mmengine/hooks/checkpoint_hook.py:358: error: Unsupported right operand type for in ("Optional[List[str]]") Found 1 error in 1 file (checked 224 source files)`

* Update hook.md

Try to avoid trim trailing whitespace waring in hook.md

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* Update checkpoint_hook.py

* Update docs/en/tutorials/hook.md

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Update hook.md

add 自动发布最好的和最后的权重

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Update checkpoint_hook.py

add condition when the best checkpoints more than 1.

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Update checkpoint_hook.py

delete re judge

* Update checkpoint_hook.py

* Update checkpoint_hook.py

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* Update checkpoint_hook.py

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* Update checkpoint_hook.py

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Add Test for publish model

* Update checkpoint_hook.py

* Update test_checkpoint_hook.py

* Fix file to pass pre-commit check

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* Fix mypy warning

* rm not necessary line in checkpoint_hook.py

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* rm unnecessary messages add to message_hub

* Update mmengine/hooks/checkpoint_hook.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Update docs/zh_cn/tutorials/hook.md

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Update docs/zh_cn/tutorials/hook.md

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* update checkpoint hook and hook.md file

* Apply suggestions from code review

* Apply suggestions from code review

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* Update mmengine/hooks/checkpoint_hook.py

---------

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

5b35c5b6

Mar 28, 2023
- [Docs] Add more social networking links (#1024) · cd3fc65c
  Mashiro authored 1 year ago
  
  * [Docs] Add more social networking links * change discord channel to mmengine
  Unverified
  
  cd3fc65c
- [Fix] Fix there is no space between data_time and metric (#1025) · d174952a
  Mashiro authored 1 year ago
  
  Unverified
  
  d174952a
Mar 26, 2023
- [Docs] Minor fixes in docs to remove or replace unicode chars with ascii chars (#1018) · f356b3c2
  Evan authored 1 year ago
  
  * Remove CN comments in EN docs code * Replace some full-width unicode chars with half-width ascii chars
  Unverified
  
  f356b3c2
Mar 19, 2023

[Refactor] Refactor the `get_device` and `is_npu_available` (#1004) · cbb67140

Qian Zhao authored 2 years ago


* refactor get_device and is_npu_available

* Update mmengine/device/utils.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

---------

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

cbb67140

Mar 17, 2023
- [Enhancement] Unify the use of print_log and logger (#997) · ff27b723
  LEFTeyes authored 2 years ago
  
  Unverified
  
  ff27b723
- [Enhance] Add `mmpretrain` to the `MODULE2PACKAGE` (#1002) · 2955ddb0
  Ma Zerun authored 2 years ago
  
  Unverified
  
  2955ddb0
Mar 16, 2023

Bump version to v0.7.0 (#999) · ef4c68de

Mashiro authored 2 years ago

* Bump version to v0.7.0

* Minor refine

* Fix as comment

* Add docs link

* update release date

ef4c68de

Mar 14, 2023

[Fix] Fix pytorch2.0 does not support sys._getframe used to remove private keys (#979) · 67ce04d9

liukuikun authored 2 years ago


* [Fix] fix pytorch2.0 not support sys._getframe to remove private key

* Update mmengine/structures/base_data_element.py

---------

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

67ce04d9

Datenschutz und Impressum