Skip to content
Snippets Groups Projects
Unverified Commit 8b3675a2 authored by Yixiao Fang's avatar Yixiao Fang Committed by GitHub
Browse files

[Enhance] support to add custom settings to param_group (#283)

parent a9afdad7
No related branches found
No related tags found
No related merge requests found
......@@ -216,6 +216,9 @@ class DefaultOptimWrapperConstructor:
if self.base_wd is not None:
decay_mult = custom_keys[key].get('decay_mult', 1.)
param_group['weight_decay'] = self.base_wd * decay_mult
# add custom settings to param_group
for k, v in custom_keys[key].items():
param_group[k] = v
break
if not is_custom:
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment