The source project of this merge request has been removed.
Thales Contribution
Context
In the context of implementing three operators for the Quantization of Vision Transformers (ShiftMax, ShiftGELU and I-LayerNorm). Here is the first Thales contribution with the implementation of the forward of ShiftMax and ShiftGELU. In aidge_core, we simply defined the operators and the implementation is in aidge_backend_cuda.
Add files
-
ShiftMax.hpp
andShiftMax.cpp
: simply defined the ShiftMax proposed operators -
ShiftGELU.hpp
andShiftGELU.cpp
: simply defined the ShiftGELU proposed operators