Draft: Learning

- Reversing Node/Operators would be relevant #15

Initializer

• Base class

  initialize(std::set<std::shared_ptr<Node>> listNodes, int seed);

  • Xavier

Backpropagation

Solver / Optimizer

• Optimizer base class
  • SGD
  • Adam
• LearningRate class
• GraphView access methods
  • producers(std::shared_ptr<GraphView>)
  • parameters(std::shared_ptr<GraphView>)

  // create an optimizer
  Optimizer(std::set<std::shared_ptr<Node>> parameters, (void*) updateFunc, (void*) learningRateScheduling);
  
  // associate a set of parameters
  myOptimizer.setLearnableParameters(std::set<std::shared_ptr<Node>> learnableParameters)

Loss

Stateless method.