diff --git a/releases/2.0/2.0.0/index.rst b/releases/2.0/2.0.0/index.rst index 308a386ada2194dc5b8747713afdb06bdd2059e9..4124de452b3cd11522e2d3a8d8e2b301fc0440f8 100644 --- a/releases/2.0/2.0.0/index.rst +++ b/releases/2.0/2.0.0/index.rst @@ -16,4 +16,5 @@ release_notes requirements + test_report ip_compliance_note diff --git a/releases/2.0/2.0.0/release_notes.rst b/releases/2.0/2.0.0/release_notes.rst index 5db98c950fabecf1d5afce548c35ab52d76db47b..6c0b1bb8e9e9e6f0c649280530a28ee973c9dc76 100644 --- a/releases/2.0/2.0.0/release_notes.rst +++ b/releases/2.0/2.0.0/release_notes.rst @@ -95,11 +95,6 @@ Supported Hardware Platforms | Arduino Nano 33 BLE | Zephyr | :ref:`SupportedBoardArduinoNano33BLE` | +---------------------------------+-------------------+---------------------------------------+ -Test Report ------------ - -TODO - Installation ************ @@ -145,6 +140,9 @@ Details can be found in: :doc:`/ci/device-testing` document. +This release comes with a detailed `Test Report` accesible +:ref:`here<2_0_0_TestReport>`. + IP Compliance ------------- diff --git a/releases/2.0/2.0.0/test_report.rst b/releases/2.0/2.0.0/test_report.rst new file mode 100644 index 0000000000000000000000000000000000000000..9eae36531cecbc469f2ad2e70f698f42f0c82f88 --- /dev/null +++ b/releases/2.0/2.0.0/test_report.rst @@ -0,0 +1,64 @@ +.. SPDX-FileCopyrightText: Luca Favaretto <luca.favaretto@kalpa.it> and Luca zizolfi <luca.zizolfi@kalpa.it> +.. +.. SPDX-License-Identifier: CC-BY-4.0 + +.. _2_0_0_TestReport: + +Test Report +================== + +Results by test suite +----------------------- + ++---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+ +| TESTS | Manual Automated | TEST | NO RUN | PASSED | FAILED | BLOCKED | N/A | SKIPPED | ++=====================+===================+=======+=========+=========+=========+==========+======+===========+ +| Kernel Build | Both | 32 | 0 | 24 | 6 | | 2 | | ++---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+ +| OTA | Automated | 6 | 0 | 6 | | | | | ++---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+ +| Networking | Manual | 2 | 0 | | | 1 | | 1 | ++---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+ +| Reference Hardware | Manual | 48 | 0 | 10 | | 29 | 5 | 4 | ++---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+ +| Security | Manual | 170 | 0 | 157 | | | 13 | | ++---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+ +| Podman | Automated | 1300 | 0 | 234 | 960 | | 106 | | ++---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+ +| LTP | Automated | 15030 | 0 | 12381 | 520 | | 2129 | | ++---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+ +| Kernel self test | Automated | 56 | 0 | 8 | 24 | | 24 | | ++---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+ +| Libc | Automated | 2185 | 0 | 1464 | 721 | | | | ++---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+ + +Overall Results +----------------- + ++--------------------+------------+ +| **Total** | **23442** | ++--------------------+------------+ +| | | ++--------------------+------------+ +| *Passed* | *17994* | ++--------------------+------------+ +| *Failed* | *2324* | ++--------------------+------------+ +| *Blocked* | *30* | ++--------------------+------------+ +| *Skipped* | *5* | ++--------------------+------------+ +| *Out of scope* | *3089* | ++--------------------+------------+ +| *No Run* | *0* | ++--------------------+------------+ +| | | ++--------------------+------------+ +| **TEST PASS RATE** | **89,94%** | ++--------------------+------------+ +| % Blocked | 0,13% | ++--------------------+------------+ +| % Failed | 9,91% | ++--------------------+------------+ +| % Skipped | 0,02% | ++--------------------+------------+