Skip to content
Snippets Groups Projects
Verified Commit 75873c9e authored by Luca Favaretto's avatar Luca Favaretto Committed by Andrei Gherzan
Browse files

Add 2.0.0 test report


Signed-off-by: default avatarLuca Favaretto <luca.favaretto@kalpa.it>
parent 88cce507
No related branches found
No related tags found
1 merge request!47Add 2.0.0 release docs
...@@ -16,4 +16,5 @@ ...@@ -16,4 +16,5 @@
release_notes release_notes
requirements requirements
test_report
ip_compliance_note ip_compliance_note
...@@ -95,11 +95,6 @@ Supported Hardware Platforms ...@@ -95,11 +95,6 @@ Supported Hardware Platforms
| Arduino Nano 33 BLE | Zephyr | :ref:`SupportedBoardArduinoNano33BLE` | | Arduino Nano 33 BLE | Zephyr | :ref:`SupportedBoardArduinoNano33BLE` |
+---------------------------------+-------------------+---------------------------------------+ +---------------------------------+-------------------+---------------------------------------+
Test Report
-----------
TODO
Installation Installation
************ ************
...@@ -145,6 +140,9 @@ Details can be found in: ...@@ -145,6 +140,9 @@ Details can be found in:
:doc:`/ci/device-testing` document. :doc:`/ci/device-testing` document.
This release comes with a detailed `Test Report` accesible
:ref:`here<2_0_0_TestReport>`.
IP Compliance IP Compliance
------------- -------------
......
.. SPDX-FileCopyrightText: Luca Favaretto <luca.favaretto@kalpa.it> and Luca zizolfi <luca.zizolfi@kalpa.it>
..
.. SPDX-License-Identifier: CC-BY-4.0
.. _2_0_0_TestReport:
Test Report
==================
Results by test suite
-----------------------
+---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+
| TESTS | Manual Automated | TEST | NO RUN | PASSED | FAILED | BLOCKED | N/A | SKIPPED |
+=====================+===================+=======+=========+=========+=========+==========+======+===========+
| Kernel Build | Both | 32 | 0 | 24 | 6 | | 2 | |
+---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+
| OTA | Automated | 6 | 0 | 6 | | | | |
+---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+
| Networking | Manual | 2 | 0 | | | 1 | | 1 |
+---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+
| Reference Hardware | Manual | 48 | 0 | 10 | | 29 | 5 | 4 |
+---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+
| Security | Manual | 170 | 0 | 157 | | | 13 | |
+---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+
| Podman | Automated | 1300 | 0 | 234 | 960 | | 106 | |
+---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+
| LTP | Automated | 15030 | 0 | 12381 | 520 | | 2129 | |
+---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+
| Kernel self test | Automated | 56 | 0 | 8 | 24 | | 24 | |
+---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+
| Libc | Automated | 2185 | 0 | 1464 | 721 | | | |
+---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+
Overall Results
-----------------
+--------------------+------------+
| **Total** | **23442** |
+--------------------+------------+
| | |
+--------------------+------------+
| *Passed* | *17994* |
+--------------------+------------+
| *Failed* | *2324* |
+--------------------+------------+
| *Blocked* | *30* |
+--------------------+------------+
| *Skipped* | *5* |
+--------------------+------------+
| *Out of scope* | *3089* |
+--------------------+------------+
| *No Run* | *0* |
+--------------------+------------+
| | |
+--------------------+------------+
| **TEST PASS RATE** | **89,94%** |
+--------------------+------------+
| % Blocked | 0,13% |
+--------------------+------------+
| % Failed | 9,91% |
+--------------------+------------+
| % Skipped | 0,02% |
+--------------------+------------+
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment