Real quantization cast for PTQ

Related to Issue:#59

This MR aims to bring real quantization and Graph Integer Execution in AIDGE quantization module (Solving this issue [aidge_backend_cpu#35]):

Changes for now:

• PTQ.cpp: Creation of a CastNetwork Routine that directly cast the network into the target type. The routine differentiates between normal mode and single-shift mode, inserting either BitShift or IntQuantizer accordingly. IntQuantizer is a modified version of the quantizer operator that allows execution within a fully integer network, as this new meta-operator enables casting the input to Float and the output to Int.

Also, I added the foldGraph flag in the quantizeNetwork() function. When this flag is set to true, the pipeline will now apply the constant folding recipe to the graph, making it much simpler and more readable by 'removing' all the intermediate PTQ nodes inserted, from the user's perspective.

• PTQMetaOps.(h/c)pp Adding the new metaoperator IntQuantizer and BitShiftQuantizer

Results: We obtain exactly the same results for MiniResNet as when using the fake quantization pipeline (with and without SingleShift). For ResNet18, we observe a slight drop in accuracy from 68.7% to 67.6% in Int32 with SingleShift, due to the approximation of the Global Average Pooling operator in integer arithmetic.

Also there is now a functional testsuite to prevent regression in the PTQ pipeline (aidge_quantization/aidge_quantization/unit_tests/test_ptq.py) [#64 (closed)\]

Quick fix to solve this issue: #19 (comment 3112773)

What remains to be done:

• Add support for Int8

added Feature 🚀 StatusWork in Progress labels

requested review from @bhalimi

assigned to @noamzerah

changed the description

added 1 commit

• 6c9a568d - Adding clearInput method to supress Int32 inputs after PTQ

Compare with previous version

added 1 commit

• c9d95227 - Correcting issue with targettype

Compare with previous version

changed the description

added 1 commit

• 774c5f9d - Fixing deprecated ways of getting all the nodes in graphview

Compare with previous version

@noamzerah everything looks good to me, excepted the code of PTQMetaOps that i feel could be factorized ! :)

added 1 commit

• fc524226 - Fixing clearGraphViewInputNode chich automatically cast all input of the GV...

Compare with previous version

mentioned in issue aidge_core#239 (closed)

marked this merge request as ready

changed title from Draft: Real quantization cast for PTQ to /aidge/aidge_core/-/merge_requests/353Draft: Real quantization cast for PTQ

mentioned in issue aidge_backend_cpu#35

added 1 commit

• 30f8212d - INtegrating the new ptq testsuite into the CI

Compare with previous version

mentioned in issue #59

changed title from /aidge/aidge_core/-/merge_requests/353Draft: Real quantization cast for PTQ to Real quantization cast for PTQ

changed the description

removed StatusWork in Progress label

added StatusReview Ready label

added 15 commits

• 30f8212d...f2713d00 - 7 commits from branch eclipse/aidge:dev
• f38da961 - first change
• 1d1fa3a4 - Adding changes
• 67a29eb2 - Rebasing real quantization cast onto dev
• 7cf77a7e - Adding bitshift rounding option
• f66860a3 - Adding clearInput method to supress Int32 inputs after PTQ
• 44a47ae8 - Correcting issue with targettype
• bf1783f3 - Fixing clearGraphViewInputNode chich automatically cast all input of the GV...
• e79d0618 - INtegrating the new ptq testsuite into the CI

Compare with previous version

added 1 commit

• d43726ea - new

Compare with previous version

added 1 commit

• 80e695e1 - Adding ONNX assets

Compare with previous version

added 1 commit

• cd79e1c3 - Fixing resetInput() with MetaOps

Compare with previous version

@noamzerah What is the status of this MR? Is this really review ready it looks like it is still under dev, should we set it to Draft and Work In Progress?

This MR is almost finished. I talked with @bhalimi today, and only a few minor modifications are missing.

marked this merge request as draft

removed StatusReview Ready label

added StatusWork in Progress label

We discussed this MR extensivly and i agree with most of it : you have my approval ! :)

approved this merge request

added 1 commit

• ce4864db - Last Fix

Compare with previous version

reset approvals from @bhalimi by pushing to the branch

approved this merge request

marked this merge request as ready

removed StatusWork in Progress label

added StatusReview Ready label

added 35 commits

• ce4864db...3f669a98 - 23 commits from branch eclipse/aidge:dev
• 3f669a98...5728ab0d - 2 earlier commits
• d1e683b9 - Rebasing real quantization cast onto dev
• bd5f3d62 - Adding bitshift rounding option
• ec544068 - Adding clearInput method to supress Int32 inputs after PTQ
• 76e033fb - Correcting issue with targettype
• 1104463b - Fixing clearGraphViewInputNode chich automatically cast all input of the GV...
• 874ae4ad - INtegrating the new ptq testsuite into the CI
• 6f99f885 - new
• 30244425 - Adding ONNX assets
• 1e320d3b - Fixing resetInput() with MetaOps
• 2fe4cba6 - Last Fix

Compare with previous version

reset approvals from @bhalimi by pushing to the branch

mentioned in commit 1553e9ef

merged