Unit tests for the JSON output of cve-check

Value

Description

In scope

Out of Scope

Acceptance Criteria

Applicable Market Segments

Applicable Personas

added to epic &8

added teamtesting label

set weight to 5

changed epic to &98 (closed)

added goofyalpha label

changed milestone to %goofy alpha

changed title from Unit tests for the YAML output of cve-check to Unit tests for the JSON output of cve-check

changed milestone to %goofy beta

added goofybeta teamV&V labels and removed goofyalpha teamtesting labels

assigned to @lucafavaretto

changed iteration to Oniro Core Iterations Jul 1, 2022 - Jul 31, 2022

Current setup:

TEMPLATECONF=../oniro/flavours/linux . ./oe-core/oe-init-build-env build-oniro-linux

oe-selftest -r cve_check.CVECheck.test_recipe_report_json_unpatched cve_check.CVECheck.test_recipe_report_json_ignored cve_check.CVECheck.test_recipe_report_json

add SANITY_TESTED_DISTROS="" to local.conf before the oe-selftest command

@mrybczyn this is the output that we get. Is it correct? The 3 tests took about 6 minutes.

2022-07-04 16:58:31,673 - oe-selftest - INFO - Adding layer libraries:
2022-07-04 16:58:31,673 - oe-selftest - INFO -  /home/lfavaretto/oniroproject/oe-core/meta/lib
2022-07-04 16:58:31,674 - oe-selftest - INFO -  /home/lfavaretto/oniroproject/oe-core/../meta-arm/meta-arm/lib
2022-07-04 16:58:31,674 - oe-selftest - INFO -  /home/lfavaretto/oniroproject/oe-core/../meta-zephyr/meta-zephyr-core/lib
2022-07-04 16:58:31,674 - oe-selftest - INFO -  /home/lfavaretto/oniroproject/oe-core/../meta-freertos/lib
2022-07-04 16:58:31,674 - oe-selftest - INFO -  /home/lfavaretto/oniroproject/oe-core/../meta-intel/lib
2022-07-04 16:58:31,674 - oe-selftest - INFO -  /home/lfavaretto/oniroproject/oe-core/../meta-openembedded/meta-oe/lib
2022-07-04 16:58:31,674 - oe-selftest - INFO -  /home/lfavaretto/oniroproject/oe-core/../meta-raspberrypi/lib
2022-07-04 16:58:31,674 - oe-selftest - INFO -  /home/lfavaretto/oniroproject/oe-core/../meta-security/lib
2022-07-04 16:58:31,674 - oe-selftest - INFO -  /home/lfavaretto/oniroproject/oe-core/meta-selftest/lib
2022-07-04 16:58:31,676 - oe-selftest - INFO - Running bitbake -e to test the configuration is valid/parsable
2022-07-04 16:58:35,552 - oe-selftest - INFO - Adding: "include selftest.inc" in /home/lfavaretto/oniroproject/build-oniro-linux-st/conf/local.conf
2022-07-04 16:58:35,553 - oe-selftest - INFO - Adding: "include bblayers.inc" in bblayers.conf
2022-07-04 16:58:35,553 - oe-selftest - INFO - test_recipe_report_json (cve_check.CVECheck)
2022-07-04 17:02:19,541 - oe-selftest - INFO -  ... ok
2022-07-04 17:02:19,542 - oe-selftest - INFO - test_recipe_report_json_ignored (cve_check.CVECheck)
2022-07-04 17:02:33,230 - oe-selftest - INFO -  ... ok
2022-07-04 17:02:33,231 - oe-selftest - INFO - test_recipe_report_json_unpatched (cve_check.CVECheck)
2022-07-04 17:04:28,723 - oe-selftest - INFO -  ... ok
2022-07-04 17:04:29,820 - oe-selftest - INFO - ----------------------------------------------------------------------
2022-07-04 17:04:29,820 - oe-selftest - INFO - Ran 3 tests in 356.283s
2022-07-04 17:04:29,820 - oe-selftest - INFO - OK
2022-07-04 17:04:35,671 - oe-selftest - INFO - RESULTS:
2022-07-04 17:04:35,671 - oe-selftest - INFO - RESULTS - cve_check.CVECheck.test_recipe_report_json: PASSED (223.99s)
2022-07-04 17:04:35,671 - oe-selftest - INFO - RESULTS - cve_check.CVECheck.test_recipe_report_json_ignored: PASSED (13.69s)
2022-07-04 17:04:35,672 - oe-selftest - INFO - RESULTS - cve_check.CVECheck.test_recipe_report_json_unpatched: PASSED (115.49s)
2022-07-04 17:04:35,672 - oe-selftest - INFO - SUMMARY:
2022-07-04 17:04:35,673 - oe-selftest - INFO - oe-selftest () - Ran 3 tests in 356.284s
2022-07-04 17:04:35,673 - oe-selftest - INFO - oe-selftest - OK - All required tests passed (successes=3, skipped=0, failures=0, errors=0)

added Doing label

Yes looks good @lucafavaretto

removed Doing label

closed