Investigate building zephyr upstream tests for better test coverage

Value

Essentially we want as many test suites from this list running in Oniro CI.

Description

Investigate how hard it is to build some of these. We can start with device or net suite if it makes sense.

In scope

Out of Scope

Implementation is out of scope. We only need some estimate on the sensibility of working on this and some estimate on implementation time.

Acceptance Criteria

Applicable Market Segments

Applicable Personas

changed milestone to %goofy beta

added goofybeta teamtesting labels

set weight to 3

assigned to @chaseqi

added to epic &46

changed iteration to Oniro Core Iterations Jul 1, 2022 - Jul 31, 2022

added Doing label

1. We are building all buildable tests now. MRs:

• zephyr-kernel-test-twister: build all buildable kernel tests
• zephyr-kernel-test-twister: build all buildable zephyr tests on nitrogen

The following tests that don't build are excluded.

ZEPHYRTESTS_EXCLUDE_TAGS:96b-nitrogen = "fpu"
ZEPHYRTESTS_DELETE:96b-nitrogen = "\
    kernel/profiling \
    kernel/fatal \
    kernel/timer/starve \
    drivers/sensor \
    misc/test_build \
    lib/sprintf \
    subsys/portability \
    crypto/mbedtls \
    benchmarks/footprints \
    benchmarks/latency_measure \
    benchmarks/sched \
    benchmarks/app_kernel \
    benchmarks/sys_kernel \
"

2. We are able to test all the testable tests on nitrogen now. The subsys test suite is excluded as it returns key parsing error. The error will be revisited on v3.1. Tracking by meta-zephyr#37 (closed)

• MR: job-definitions/ci: enable all testable zephyr tests on nitrogen
• MR: linux/twister: remove unspecified tests to avoid parsing error
• Job example: https://lava.ostc-eu.org/results/30721

3. Current status

• Testing is broken after the kernel source changed to v3.1. Tracking with meta-zephyr#37 (closed)
• Nitrogen will be dropped, and testing on arduino is blocked by meta-zephyr#36
• We plan to enable testing on qemu. Tracking by meta-zephyr#35 (closed)

closed

removed Doing label