Skip to content
Snippets Groups Projects

Add Alpha and Beta parameters in Backward method

Merged Olivier Antoni requested to merge oantoni/aidge_backend_cuda:Fix_backward into dev

Context

Solve the issue !272 for CUDA backend.

Modified files

The CUDA kernel for the following operators is modified: ILayerNorm, ShiftGELU, ShiftMax.

Detailed major modifications

Add Alpha=1 and Beta=1 parameters to Backward() method so as to ADD a contribution to the upstream gradient tensor.

Merge request reports

Loading
Loading

Activity

Filter activity
  • Approvals
  • Assignees & reviewers
  • Comments (from bots)
  • Comments (from users)
  • Commits & branches
  • Edits
  • Labels
  • Lock status
  • Mentions
  • Merge request status
  • Tracking
Please register or sign in to reply
Loading