Script that demonstrates the LSQ over ImageNet
Context
Now that all the elements of the LSQ Quantization Aware Training are ready, we want a script that train a real-size network (e.g. ResNet18) with LSQ nodes inserted, and that evaluate the accuracy drop when using 8 and 4 bits precisions.
Key Steps
-
LSQ of a ConvNet using SGD on CIFAR-10 -
Add support of Adam optimizer -
Add support of Cross-Entropy Loss -
Training of a ResNet18 using Adam on ImageNet -
LSQ of a ResNet18 using Adam on ImageNet
Results
TODO ...
Edited by Benjamin Halimi