Skip to content
Snippets Groups Projects
Commit b76944f7 authored by Olivier Antoni's avatar Olivier Antoni
Browse files

Fix Adam optimizer unit test

parent d298f23d
No related branches found
No related tags found
2 merge requests!10version 0.1.2,!9Add Adam optimizer
Pipeline #49080 passed
......@@ -119,9 +119,9 @@ TEST_CASE("[learning/Adam] update", "[Optimizer][Adam]") {
REQUIRE(approxEq<float,float>(tmpt2, tmpt1, 1e-5f, 1e-8f));
}
// truth
for (std::size_t step = 0; step < 10; ++step) {
float lr2 = lr * std::sqrt(1.0f - std::pow(beta1, step + 1)) / (1.0f - std::pow(beta1, step + 1));
// truth
float lr2 = lr * std::sqrt(1.0f - std::pow(beta2, step + 1)) / (1.0f - std::pow(beta1, step + 1));
float epsilon2 = epsilon * std::sqrt(1.0f - std::pow(beta2, step + 1));
for (std::size_t t = 0; t < nb_tensors; ++t) {
for (std::size_t i = 0; i < size_tensors[t]; ++i) {
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment