Skip to content

[Feat] Add Weight Decay to the SGD Optimizer

Benjamin Halimi requested to merge weight_decay into dev

The SGD optimizer was missing a "weight decay" option. This lack is fixed by this Merge Request.

For more information about the weight decay implementation, please refer to the PyTorch doc :

https://pytorch.org/docs/stable/generated/torch.optim.SGD.html

Files modified : SGD.hpp, pybind_SGD.cpp

Edited by Benjamin Halimi

Merge request reports

Loading