Our GitLab pipeline jobs rely on both the .extends mechanism and the
re-definition-in-place mechanism, in order to avoid repetition.
Something is misbehaving, as evidenced by [1] and [2], suggesting that
the way GitLab computes the effective set of jobs in a pipiline is
different from what we understand.

The CI_ONIRO_MAGIC variable is set to the name and location of the job
defining the particular value. By showing the effective value of the
variable, we may gain some insight into what is going on in practice.

[1] eclipse/oniro-core/oniro#613
[2] eclipse/oniro-core/oniro#574



Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

This is a first patch to introduce squad as a middleman in handling
LAVA job. SQUAD provides a DB to store test results in a scalable manner,
while also providing a good comparison engine for quick discovery of
regressions. Any visualization tool will make good use of SQUAD db and API.

Signed-off-by: Stevan Radaković <stevan.radakovic@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Chase Qi authored 2 years ago and Stevan Radaković committed 2 years ago

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Chase Qi authored 2 years ago and Stevan Radaković committed 2 years ago

Signed-off-by: Chase Qi <chase.qi@linaro.org>

This is consistent with the job which builds the bundles.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

The find call that was used to copy artifacts selected only files. In
some cases, bitbake generates symbolic links that are worth copying as
well. Extend the find expression to find both.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

The --archive flag should help us preserve symlinks.
Add --verbose to make the process easier to debug.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Those timestamps are useful to create unique content in HawkBit
later on. We can always strip them if we want to, but it is hard
to re-create that information when it is not encoded in the file name.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

This saves several gigabytes of traffic per build. Those artifacts
are automatically pulled due to being present in the previous stage.
Bundle is built from source, so no artifact is ever used.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

The job extends the .build-image job so this part is automatic.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Introduce variable CI_ONIRO_JOB_ARTIFACTS to allow build job to
customize what artifacts it needs to deploy.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Fail build job if the MACHINE variable not defined, otherwise build job will be
continued with the default qemux86-64 machine which is not desired.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

This change makes the git operations reference the project's name and a
generic project CI email.

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

The EF infrastructure (GitLab) doesn't support image registry. This
change switches the container images to use the OSTC registry while
EF catches up[1].

[1] eclipsefdn/helpdesk#1108



Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

The relevant repository was now migrated to EF Gitlab so reflect that in
the comments mentioning the Dockerfiles.

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

This change tweaks the CI comments and references to the EF migrated
repositories.

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

Chase Qi authored 2 years ago and Andrei Gherzan committed 2 years ago

Fail lava-report if incomplete job found. Allow lava-report to fail to
run the downstream lava-badage job.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

Closes #487

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

Zygmunt Krynicki authored 3 years ago and Andrei Gherzan committed 3 years ago

As defined on https://booting.oniroproject.org/distro/infra/



Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Zygmunt Krynicki authored 3 years ago and Andrei Gherzan committed 3 years ago

Historically the DCO check was routed to a dedicated but slow machine
that guaranteed that no CI would be stuck waiting on the miniscule
compliance job.

With the Eclipse migration and CI/CD being slightly out of our control,
it's just more convenient to drop this tag rather than request
configuration change in the instance.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Zygmunt Krynicki authored 3 years ago and Andrei Gherzan committed 3 years ago

Historically the REUSE check was routed to a dedicated but slow machine
that guaranteed that no CI would be stuck waiting on the miniscule
compliance job.

With the Eclipse migration and CI/CD being slightly out of our control,
it's just more convenient to drop this tag rather than request
configuration change in the instance.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

This is now the currently main development branch.

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

The repository holding the repo manifests is now under Eclipse
infrastructure.

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

This helps to understand that the actual interpolation process cannot use
syntax like bash/sh. In addition, putting the @ sigil at both ends so that
@FOO_BAR is not incorrectly replaced as well.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

After splitting, also ci need to build separate MACHINE variables.

Signed-off-by: Ettore Chimenti <ettore.chimenti@seco.com>

Zygmunt Krynicki authored 3 years ago and Stefan Schmidt committed 3 years ago

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Zygmunt Krynicki authored 3 years ago and Stefan Schmidt committed 3 years ago

The update bundle is built with the new hidden job .build-rauc-bundle.
The job is documented and instantiated in the main pipeline.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Signed-off-by: Chase Qi <chase.qi@linaro.org>