Pavel Zhukov authored 2 years ago and Stefan Schmidt committed 2 years ago

ABI checker implementation is meta-binaryaudit. Adding it for CI only
to not extend support surface of the project.
Added to three flavours for now. It can be easily extended to all jobs
if needed in the future

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

Part of gcc oeself-test is client/server based. It uses qemu vm for
native tests via ssh. The vm is launched by runqemu command which
requires the following changes in the docker image.

* passwordless sudo permission
* package iptables pre-installed

Signed-off-by: Chase Qi <chase.qi@linaro.org>

The reference is provided only when repo is used with runner persistent
storage. This is not a major change, just a clean-up of the existing
logic.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Add missing INHERITs to Linux jobs. Now all
Linux images in CI run "create-spdx.bbclass" correctly.

Signed-off-by: Davide Gardenal <davide.gardenal@huawei.com>

Signed-off-by: Davide Gardenal <davide.gardenal@huawei.com>

The parent of all zephyr jobs is now unified to enable easier
extensibility later on.
Update documentation.

Signed-off-by: Davide Gardenal <davide.gardenal@huawei.com>

Enabling debug mode is not the ideal solution for running
tests because it's responsible for enlarging the rootfs size and causing
tests to fail. More detail reported in #673.

This reverts commit 3ddebb37.

Signed-off-by: Davide Gardenal <davide.gardenal@huawei.com>

Use the Yocto class to generate SBOM. Activate on Linux only,
there is a pending issue on Zephyr [1]

[1] https://lists.openembedded.org/g/openembedded-core/message/167450



Signed-off-by: Marta Rybczynska <marta.rybczynska@huawei.com>

LAVA needs a writable directory to deploy test cases, and many test
cases only work with root user.

The debug mode can be disabled by overwriting the
CI_ONIRO_BB_LOCAL_CONF_plus_equals_INHERIT variable at build job level.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

When the callback not dispatchered correctly, the record can be helpful
for debugging in squad.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Given test scope for new MRs is not defined yet and we only have one
rpi4, b68 and c61 in the warsaw lab which are occupied mostly by daily
scheduled pipeline, starting with boot and smoke tests on qemu devices
should be a good starting point for per MR testing.

Jobs that extend `.lava-test` will be added to MR's pipeline and
schedueld pipeline.

`.lava-test-scheduled` extends `.lava-test` with new scheduled pipeline
only rule. Long run jobs like ltp should extends the job so that they
wouldn't prevent MRs from merging.

Solves #486.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Unqualified jobs, which rely on the default compiler, are gone.
Qualified jobs explicitly configure either clang or gcc and use the
appropriate suffix. Qualified jobs have needs/depends set to empty to
both avoid waiting for previous stages to start and to avoid pulling in
artifacts from the previous stage.

Qualified jobs inhabit two new lanes: build-gcc and build-clang, to
visually break the already long column of "build" jobs.

Job ordering within a lane is not exactly matching, gcc-clang. This is
noticeable with the jobs using the "extra" suffix. The reason for this
is unclear.

Some jobs are marked as broken as they do not build with clang. Allow
them to fail and make them start manually until more patches arrive.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Chase Qi authored 2 years ago and Stevan Radaković committed 2 years ago

Pipeline ID is used as squad project level build ID. However, squad
build ID is the one to use for api calls. It is unique cross the
instance.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

We switched the build id scheme in SQUAD to use pipeline ID instead
of short commit SHA. Now lava-report job has to reflect that as well.

Signed-off-by: Stevan Radaković <stevan.radakovic@linaro.org>

Davide Gardenal authored 2 years ago and Pavel Zhukov committed 2 years ago

With oe-core/65498411d73e8008d5550c2d0a1148f990717587
creating the image manifest for FreeRTOS raises an
exception. FreeRTOS support is experimental and there
is an issue in rootfs generation, so we disable the option
for now.

Signed-off-by: Davide Gardenal <davide.gardenal@huawei.com>

Add the SQUAD_INSTANCE variable to the update callback URL

Signed-off-by: Stevan Radaković <stevan.radakovic@linaro.org>

Use SQUAD callback to trigger the lava-report pipeline job and
simplify lava-badge calculation by using SQUAD API.
SQUAD build ID is now implemented to be the same as pipeline ID.

Signed-off-by: Stevan Radaković <stevan.radakovic@linaro.org>

Apparently those rules clash with the rules defined in the
.gitlab-ci.yml .workspace-rules, due to the order of evaluation inside
GitLab.

The set of rules on .bitbake-workspace is entirely redundant, and should
be defined by the workflow. The rules on .workspace-rules have a
different purpose, namely to inject specific variables into certian
types of pipelines.

Fixes: #613



Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

This is a first patch to introduce squad as a middleman in handling
LAVA job. SQUAD provides a DB to store test results in a scalable manner,
while also providing a good comparison engine for quick discovery of
regressions. Any visualization tool will make good use of SQUAD db and API.

Signed-off-by: Stevan Radaković <stevan.radakovic@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Chase Qi authored 2 years ago and Stevan Radaković committed 2 years ago

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Chase Qi authored 2 years ago and Stevan Radaković committed 2 years ago

Signed-off-by: Chase Qi <chase.qi@linaro.org>

This is consistent with the job which builds the bundles.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

The find call that was used to copy artifacts selected only files. In
some cases, bitbake generates symbolic links that are worth copying as
well. Extend the find expression to find both.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

The --archive flag should help us preserve symlinks.
Add --verbose to make the process easier to debug.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Those timestamps are useful to create unique content in HawkBit
later on. We can always strip them if we want to, but it is hard
to re-create that information when it is not encoded in the file name.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

This saves several gigabytes of traffic per build. Those artifacts
are automatically pulled due to being present in the previous stage.
Bundle is built from source, so no artifact is ever used.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

The job extends the .build-image job so this part is automatic.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Introduce variable CI_ONIRO_JOB_ARTIFACTS to allow build job to
customize what artifacts it needs to deploy.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Fail build job if the MACHINE variable not defined, otherwise build job will be
continued with the default qemux86-64 machine which is not desired.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

This change makes the git operations reference the project's name and a
generic project CI email.

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

The EF infrastructure (GitLab) doesn't support image registry. This
change switches the container images to use the OSTC registry while
EF catches up[1].

[1] eclipsefdn/helpdesk#1108



Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

The relevant repository was now migrated to EF Gitlab so reflect that in
the comments mentioning the Dockerfiles.

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>