This reverts commit a180a4b8.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Artem Kondratiuk authored 2 years ago and Pawel Stankiewicz committed 2 years ago

Signed-off-by: artem.kondratiuk <artem.kondratiuk@huawei.com>

There is an incompatibility issue between the sphinx version in Ubuntu
focal and the docutils version pulled in by sphinx-tabs. We need to make
sure that pip doesn't pull in a version of docutils that would break
sphinx:

https://github.com/sphinx-doc/sphinx/issues/9841



Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

The Ubuntu version we downgraded to doesn't have support for
sphinx-tabs. Switch that to pip until we can upgrade to 22.04.

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

The currently used version, impish, is not updatable anymore since July
the 14th and we don't have a newer version in our repository. Downgrade
this to focal to fix the container image builds.

Fixes: #724


Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

To help Oniro with
eclipsefdn/helpdesk#1565, EF created
a bot for us that is passing the ECA checks. Use it to unblock the docs
pipelines.

Fixes: #723


Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

Chase Qi authored 2 years ago and Stefan Schmidt committed 2 years ago

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Chase Qi authored 2 years ago and Stefan Schmidt committed 2 years ago

Check the current version with `bitbake -s` and the last tested version
via squad's api. When version is changed, continue the following tests,
otherwise, skip the tests.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Chase Qi authored 2 years ago and Stefan Schmidt committed 2 years ago

gcc test suite has been integrated in oe-selftest framework. It allows
to run gcc test against qemu vm and within the build env using qemu
linux-user mode.

These tests can be run in gitlab CI with qemu friendly runners. This
commit add three oe-selftest jobs to run the tests using qemu
linux-user, qemu x86-64 vm and qemu arm64 vm.

Test log and sum files are collected as job artifacts.

When all test jobs finish, report job will be triggered to parse the
sum files to generate results in the format that supported by squad. The
report job will upload results to squad for reporting.

Closes issues #8 and #9.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Pavel Zhukov authored 2 years ago and Andrei Gherzan committed 2 years ago

We need to analyse ABI and keep ABI data for different images/arches
thus artifact name should be job specific

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

Pavel Zhukov authored 2 years ago and Andrei Gherzan committed 2 years ago

It was broken because of BITBAKE_TMPDIR variable definition removal as
part of the cleanup. Define BITBAKE_TOPDIR variable instead which serves
needs of ABI checker better.

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

Zygmunt Krynicki authored 2 years ago and Stefan Schmidt committed 2 years ago

Some jobs care about images and licenses, those look at the
$TMPDIR/deploy, taking some effort to find the correct tmpdir while
hard-coding the deploy dir. Take a shortcut and query for the right
variable (DEPLOY_DIR).

This allows non-trivial layouts with DEPLOY_DIR and TMPDIR placed on
distinct filesystems, for efficiency.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Pavel Zhukov authored 2 years ago and Stefan Schmidt committed 2 years ago

ABI checker implementation is meta-binaryaudit. Adding it for CI only
to not extend support surface of the project.
Added to three flavours for now. It can be easily extended to all jobs
if needed in the future

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

Part of gcc oeself-test is client/server based. It uses qemu vm for
native tests via ssh. The vm is launched by runqemu command which
requires the following changes in the docker image.

* passwordless sudo permission
* package iptables pre-installed

Signed-off-by: Chase Qi <chase.qi@linaro.org>

The reference is provided only when repo is used with runner persistent
storage. This is not a major change, just a clean-up of the existing
logic.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Add missing INHERITs to Linux jobs. Now all
Linux images in CI run "create-spdx.bbclass" correctly.

Signed-off-by: Davide Gardenal <davide.gardenal@huawei.com>

Signed-off-by: Davide Gardenal <davide.gardenal@huawei.com>

The parent of all zephyr jobs is now unified to enable easier
extensibility later on.
Update documentation.

Signed-off-by: Davide Gardenal <davide.gardenal@huawei.com>

Enabling debug mode is not the ideal solution for running
tests because it's responsible for enlarging the rootfs size and causing
tests to fail. More detail reported in #673.

This reverts commit 3ddebb37.

Signed-off-by: Davide Gardenal <davide.gardenal@huawei.com>

Use the Yocto class to generate SBOM. Activate on Linux only,
there is a pending issue on Zephyr [1]

[1] https://lists.openembedded.org/g/openembedded-core/message/167450



Signed-off-by: Marta Rybczynska <marta.rybczynska@huawei.com>

LAVA needs a writable directory to deploy test cases, and many test
cases only work with root user.

The debug mode can be disabled by overwriting the
CI_ONIRO_BB_LOCAL_CONF_plus_equals_INHERIT variable at build job level.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

When the callback not dispatchered correctly, the record can be helpful
for debugging in squad.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Given test scope for new MRs is not defined yet and we only have one
rpi4, b68 and c61 in the warsaw lab which are occupied mostly by daily
scheduled pipeline, starting with boot and smoke tests on qemu devices
should be a good starting point for per MR testing.

Jobs that extend `.lava-test` will be added to MR's pipeline and
schedueld pipeline.

`.lava-test-scheduled` extends `.lava-test` with new scheduled pipeline
only rule. Long run jobs like ltp should extends the job so that they
wouldn't prevent MRs from merging.

Solves #486.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Unqualified jobs, which rely on the default compiler, are gone.
Qualified jobs explicitly configure either clang or gcc and use the
appropriate suffix. Qualified jobs have needs/depends set to empty to
both avoid waiting for previous stages to start and to avoid pulling in
artifacts from the previous stage.

Qualified jobs inhabit two new lanes: build-gcc and build-clang, to
visually break the already long column of "build" jobs.

Job ordering within a lane is not exactly matching, gcc-clang. This is
noticeable with the jobs using the "extra" suffix. The reason for this
is unclear.

Some jobs are marked as broken as they do not build with clang. Allow
them to fail and make them start manually until more patches arrive.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Chase Qi authored 2 years ago and Stevan Radaković committed 2 years ago

Pipeline ID is used as squad project level build ID. However, squad
build ID is the one to use for api calls. It is unique cross the
instance.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

We switched the build id scheme in SQUAD to use pipeline ID instead
of short commit SHA. Now lava-report job has to reflect that as well.

Signed-off-by: Stevan Radaković <stevan.radakovic@linaro.org>

Davide Gardenal authored 2 years ago and Pavel Zhukov committed 2 years ago

With oe-core/65498411d73e8008d5550c2d0a1148f990717587
creating the image manifest for FreeRTOS raises an
exception. FreeRTOS support is experimental and there
is an issue in rootfs generation, so we disable the option
for now.

Signed-off-by: Davide Gardenal <davide.gardenal@huawei.com>

Add the SQUAD_INSTANCE variable to the update callback URL

Signed-off-by: Stevan Radaković <stevan.radakovic@linaro.org>

Use SQUAD callback to trigger the lava-report pipeline job and
simplify lava-badge calculation by using SQUAD API.
SQUAD build ID is now implemented to be the same as pipeline ID.

Signed-off-by: Stevan Radaković <stevan.radakovic@linaro.org>

Apparently those rules clash with the rules defined in the
.gitlab-ci.yml .workspace-rules, due to the order of evaluation inside
GitLab.

The set of rules on .bitbake-workspace is entirely redundant, and should
be defined by the workflow. The rules on .workspace-rules have a
different purpose, namely to inject specific variables into certian
types of pipelines.

Fixes: #613



Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

This is a first patch to introduce squad as a middleman in handling
LAVA job. SQUAD provides a DB to store test results in a scalable manner,
while also providing a good comparison engine for quick discovery of
regressions. Any visualization tool will make good use of SQUAD db and API.

Signed-off-by: Stevan Radaković <stevan.radakovic@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Chase Qi authored 2 years ago and Stevan Radaković committed 2 years ago

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Chase Qi authored 2 years ago and Stevan Radaković committed 2 years ago

Signed-off-by: Chase Qi <chase.qi@linaro.org>

This is consistent with the job which builds the bundles.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

The find call that was used to copy artifacts selected only files. In
some cases, bitbake generates symbolic links that are worth copying as
well. Extend the find expression to find both.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

The --archive flag should help us preserve symlinks.
Add --verbose to make the process easier to debug.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>