[Feat] Add Weight Decay to the SGD Optimizer
The SGD optimizer was missing a "weight decay" option. This lack is fixed by this Merge Request.
For more information about the weight decay implementation, please refer to the PyTorch doc :
https://pytorch.org/docs/stable/generated/torch.optim.SGD.html
Files modified : SGD.hpp
, pybind_SGD.cpp
Edited by Benjamin Halimi