From 75873c9eacc468594c2226df858680a78d2fa3a3 Mon Sep 17 00:00:00 2001
From: Luca Favaretto <luca.favaretto@kalpa.it>
Date: Fri, 25 Nov 2022 15:34:15 +0100
Subject: [PATCH] Add 2.0.0 test report
Signed-off-by: Luca Favaretto <luca.favaretto@kalpa.it>
---
releases/2.0/2.0.0/index.rst | 1 +
releases/2.0/2.0.0/release_notes.rst | 8 ++--
releases/2.0/2.0.0/test_report.rst | 64 ++++++++++++++++++++++++++++
3 files changed, 68 insertions(+), 5 deletions(-)
create mode 100644 releases/2.0/2.0.0/test_report.rst
diff --git a/releases/2.0/2.0.0/index.rst b/releases/2.0/2.0.0/index.rst
index 308a386..4124de4 100644
--- a/releases/2.0/2.0.0/index.rst
+++ b/releases/2.0/2.0.0/index.rst
@@ -16,4 +16,5 @@
release_notes
requirements
+ test_report
ip_compliance_note
diff --git a/releases/2.0/2.0.0/release_notes.rst b/releases/2.0/2.0.0/release_notes.rst
index 5db98c9..6c0b1bb 100644
--- a/releases/2.0/2.0.0/release_notes.rst
+++ b/releases/2.0/2.0.0/release_notes.rst
@@ -95,11 +95,6 @@ Supported Hardware Platforms
| Arduino Nano 33 BLE | Zephyr | :ref:`SupportedBoardArduinoNano33BLE` |
+---------------------------------+-------------------+---------------------------------------+
-Test Report
------------
-
-TODO
-
Installation
************
@@ -145,6 +140,9 @@ Details can be found in:
:doc:`/ci/device-testing` document.
+This release comes with a detailed `Test Report` accesible
+:ref:`here<2_0_0_TestReport>`.
+
IP Compliance
-------------
diff --git a/releases/2.0/2.0.0/test_report.rst b/releases/2.0/2.0.0/test_report.rst
new file mode 100644
index 0000000..9eae365
--- /dev/null
+++ b/releases/2.0/2.0.0/test_report.rst
@@ -0,0 +1,64 @@
+.. SPDX-FileCopyrightText: Luca Favaretto <luca.favaretto@kalpa.it> and Luca zizolfi <luca.zizolfi@kalpa.it>
+..
+.. SPDX-License-Identifier: CC-BY-4.0
+
+.. _2_0_0_TestReport:
+
+Test Report
+==================
+
+Results by test suite
+-----------------------
+
++---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+
+| TESTS | Manual Automated | TEST | NO RUN | PASSED | FAILED | BLOCKED | N/A | SKIPPED |
++=====================+===================+=======+=========+=========+=========+==========+======+===========+
+| Kernel Build | Both | 32 | 0 | 24 | 6 | | 2 | |
++---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+
+| OTA | Automated | 6 | 0 | 6 | | | | |
++---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+
+| Networking | Manual | 2 | 0 | | | 1 | | 1 |
++---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+
+| Reference Hardware | Manual | 48 | 0 | 10 | | 29 | 5 | 4 |
++---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+
+| Security | Manual | 170 | 0 | 157 | | | 13 | |
++---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+
+| Podman | Automated | 1300 | 0 | 234 | 960 | | 106 | |
++---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+
+| LTP | Automated | 15030 | 0 | 12381 | 520 | | 2129 | |
++---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+
+| Kernel self test | Automated | 56 | 0 | 8 | 24 | | 24 | |
++---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+
+| Libc | Automated | 2185 | 0 | 1464 | 721 | | | |
++---------------------+-------------------+-------+---------+---------+---------+----------+------+-----------+
+
+Overall Results
+-----------------
+
++--------------------+------------+
+| **Total** | **23442** |
++--------------------+------------+
+| | |
++--------------------+------------+
+| *Passed* | *17994* |
++--------------------+------------+
+| *Failed* | *2324* |
++--------------------+------------+
+| *Blocked* | *30* |
++--------------------+------------+
+| *Skipped* | *5* |
++--------------------+------------+
+| *Out of scope* | *3089* |
++--------------------+------------+
+| *No Run* | *0* |
++--------------------+------------+
+| | |
++--------------------+------------+
+| **TEST PASS RATE** | **89,94%** |
++--------------------+------------+
+| % Blocked | 0,13% |
++--------------------+------------+
+| % Failed | 9,91% |
++--------------------+------------+
+| % Skipped | 0,02% |
++--------------------+------------+
--
GitLab