[Feat] Support FSDP Training (#304)
* [Feat] Support FSDP Training * fix version comparison * change param format and move `FSDP_WRAP_POLICY` to wrapper file * add docstring and type hint,reformat code * fix type hint * fix typo, reformat code
Showing
- mmengine/model/__init__.py 6 additions, 0 deletionsmmengine/model/__init__.py
- mmengine/model/wrappers/__init__.py 7 additions, 0 deletionsmmengine/model/wrappers/__init__.py
- mmengine/model/wrappers/fully_sharded_distributed.py 209 additions, 0 deletionsmmengine/model/wrappers/fully_sharded_distributed.py
- tests/test_model/test_wrappers/test_model_wrapper.py 60 additions, 0 deletionstests/test_model/test_wrappers/test_model_wrapper.py
Loading
Please register or sign in to comment