Add knowledge distillation (KD) loss to aidge_learning

Context

Adding the Knowledge Distillation (KD) loss to aidge for incremental learning.

Modified files

• aidge_learning/src/loss/distillation/KD.cpp: definition of the KD loss (highly inspired by BCE loss)
• aidge_learning/include/aidge/loss/LossList.hpp: Adding the KD loss the loss list
• aidge_learning/python_binding/learning/loss/pybind_Loss.cpp: Add the biding python for the KD Loss

TODO

Integrate the merge request into the main branch

• NOT DONE
• DONE
• TO DO

added Feature 🚀 label

@olivierbichler Do you have an explanation of why the pipeline fails during the build? My code only introduces a new loss function and defines it in python biding and in LossList.hpp. Thanks in advance.

changed target branch from main to dev

marked this merge request as draft

assigned to @lrakotoarivony

@lrakotoarivony what is the status on this MR?

Is it possible to add a unit-test for this?

Currently, the pipeline seems to be blocked during the build stage. As I'm external to CEA, I can't start the pipeline. It's therefore difficult for me to identify where the problem comes from, as my contributions are just the addition of a loss strongly inspired by the BCE loss.

marked this merge request as ready

added 92 commits

• 3309f38d...c19db949 - 90 commits from branch eclipse/aidge:dev
• 0ce89002 - Merge branch 'dev' into 'main'
• 00c0bdeb - Merge branch aidge_learning:main into main

Compare with previous version

added 44 commits

• 00c0bdeb...7c755ad7 - 42 commits from branch eclipse/aidge:dev
• 6b597512 - Fix merge conflicts
• e0961e95 - Resolved merge conflicts with dev

Compare with previous version

requested review from @olivierbichler

Alright, I propose to merge this, even though there is no unit test yet, in order to favour useful contributions, considering the time this MR has been open. @lrakotoarivony You will need to rebase on your side, then I will be able to merge!

Done, let me know if I can do anything else.

added 13 commits

• e0961e95...58f7c200 - 12 commits from branch eclipse/aidge:dev
• 16041991 - Add knowledge distillation (KD) loss

Compare with previous version

added 2 commits

• 0ce89002 - Merge branch 'dev' into 'main'
• 7fae6b72 - Merge branch aidge_learning:main into main

Compare with previous version

approved this merge request

enabled an automatic merge when all merge checks for 7fae6b72 pass

changed milestone to %aidge v0.6.0

added 1 commit

• 915aebf8 - Edit KD.cpp

Compare with previous version

reset approvals from @olivierbichler by pushing to the branch

approved this merge request

enabled an automatic merge when all merge checks for 915aebf8 pass

merged

mentioned in commit 9c7303e5