Skip to content

Thales Contribution

Lucas RAKOTOARIVONY requested to merge (removed):main into main

Context

In the context of implementing three operators for the Quantization of Vision Transformers (ShiftMax, ShiftGELU and I-LayerNorm). Here is the first Thales contribution with the implementation of the forward of ShiftMax and ShiftGELU. In aidge_core, we simply defined the operators and the implementation is in aidge_backend_cuda.

Add files

  • ShiftMax.hpp and ShiftMax.cpp : simply defined the ShiftMax proposed operators
  • ShiftGELU.hpp and ShiftGELU.cpp : simply defined the ShiftGELU proposed operators

Merge request reports