Our GitLab pipeline jobs rely on both the .extends mechanism and the
re-definition-in-place mechanism, in order to avoid repetition.
Something is misbehaving, as evidenced by [1] and [2], suggesting that
the way GitLab computes the effective set of jobs in a pipeline is
different from what we understand.

The CI_ONIRO_MAGIC variable is set to the name and location of the job
defining the particular value. By showing the effective value of the
variable, we may gain some insight into what is going on in practice.

[1] #613
[2] #574



Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

This is consistent with the job which builds the bundles.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

The find call that was used to copy artifacts selected only files. In
some cases, bitbake generates symbolic links that are worth copying as
well. Extend the find expression to find both.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

The --archive flag should help us preserve symlinks.
Add --verbose to make the process easier to debug.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Those timestamps are useful to create unique content in HawkBit
later on. We can always strip them if we want to, but it is hard
to re-create that information when it is not encoded in the file name.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

This saves several gigabytes of traffic per build. Those artifacts
are automatically pulled due to being present in the previous stage.
Bundle is built from source, so no artifact is ever used.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

The job extends the .build-image job so this part is automatic.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Introduce variable CI_ONIRO_JOB_ARTIFACTS to allow build job to
customize what artifacts it needs to deploy.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Fail build job if the MACHINE variable not defined, otherwise build job will be
continued with the default qemux86-64 machine which is not desired.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

This change tweaks the CI comments and references to the EF migrated
repositories.

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

Closes #487

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

Zygmunt Krynicki authored 3 years ago and Andrei Gherzan committed 3 years ago

As defined on https://booting.oniroproject.org/distro/infra/



Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

This is now the currently main development branch.

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

The repository holding the repo manifests is now under Eclipse
infrastructure.

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Zygmunt Krynicki authored 3 years ago and Stefan Schmidt committed 3 years ago

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Zygmunt Krynicki authored 3 years ago and Stefan Schmidt committed 3 years ago

The update bundle is built with the new hidden job .build-rauc-bundle.
The job is documented and instantiated in the main pipeline.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

The job always fail due to permission issue, and there is no need to
run the job for scheduled pipelines.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

LFS was only needed for the blueprints documentation. That was removed
from the main repo so we don't need to keep a dependency on LFS anymore.

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

This is needed due to the custom setup we do with a additional fork
remote for the incoming repository.

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

Andrei Gherzan authored 3 years ago and philippe coval committed 3 years ago

Since https://gerrit-review.googlesource.com/c/git-repo/+/83130/

 repo
requires manual handling of LFS blobs.

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

During workspace construction, the .workspace job relies on a git-repo
mirror which tracks all of the repositories described by the manifest.
Those mirrors are maintained externally in the infrastructure of the
continuous integration system. Switch to the mirror which tracks the
manifests from booting.onrioproject.org.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

With the move to booting.oniroproject.org the manifest repository has a
new URL. Switch to it to ensure that continuous integration does not
rely on old infrastructure.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

With the move to booting.oniroproject.org, the container registry is at
a different sub-domain. Switch to it to detach CI from the old
infrastructure.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Zephyr and FreeRTOS jobs do not require 16GB of RAM to build and
constitute the bulk of our CI (by number) quota usage. By moving them to
smaller instances, with 4GB of RAM, we can use the remaining quota
better.

On the infrastructure side we now have a new auto-scaling pool, with
s3.large.2 instances. Those join the existing s3.xlarge.4 (formerly
known as "heavy") and s3.large.8 (formerly known as "light").

The .workspace job uses the s2.large.8 by default, making a safe (but
expensive) default. Specific jobs deviate as follows:

 - zephyr and freertos jobs use s3.large.2
 - two blueprint jobs with more recipes use s3.xlarge.4

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Correct to the new filename.

Signed-off-by: Stefan Schmidt <stefan.schmidt@huawei.com>

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

The new location is just `distro/docs`.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Most things are moved unchanged. The relatively few changes are to the
documentation, as the split between the meta-ohos and manifest is gone,
as well as to the actual CI definitions for the workspace directory,
since the sources/ sub-directory is gone, and there was some
backwards-compatibility code that no longer makes sense to maintain.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>