Set lava-test and lava-report job as scheduled pipeline only for the
below reasons.

* lava-test requires token set using GitLab variable for job submission
* lava-report depends on all test jobs

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Zygmunt Krynicki authored 3 years ago and Stefan Schmidt committed 3 years ago

The update bundle is built with the new hidden job .build-rauc-bundle.
The job is documented and instantiated in the main pipeline.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

The 'when: never' rule should be put on the top to prevent gitlab from
adding the job to pipeline.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Chase Qi authored 3 years ago and Stevan Radaković committed 3 years ago

Signed-off-by: Chase Qi <chase.qi@linaro.org>

This closes: #226

Signed-off-by: Chase Qi <chase.qi@linaro.org>

lava-test badge shows success rate for on device testing in lava.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Introduce machine variable for lava-test and search build images for the
test target device only to make sure only images for the target device
submitted for test.

This closes #215.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Chase Qi authored 3 years ago and Stevan Radaković committed 3 years ago

Signed-off-by: Chase Qi <chase.qi@linaro.org>

After all test jobs for a pipeline finish, trigger lava-report via gitlab api
to collect test results from all jobs.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

* fix the syntax for CI/CD var check
* enable lava report

Signed-off-by: Chase Qi <chase.qi@linaro.org>

CI_LAVA_TOKEN is required for submitting job to LAVA server. It should
be set in instance level gitlab CI/CD variables for testing forking dev
flow based MRs.

With `when: never` rule, test job will not be added to pipeline if the
above var not set. If the condition not set in test job that extends
`.lava-test`, `.lava-test` will ask user to do so and then exit with
unsuccessful job status. There is no easy way to exit early with
successful status yet. See
https://gitlab.com/gitlab-org/gitlab/-/issues/329217#note_572963049



Adding the above condition in `.lava-test` has no impact on test job
that extends the `.lava-test`.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

This may be reverted ASAP,
this change was suggested by @zyga to suspend bot failures
on release

Cc: @zyga
Forwarded: https://booting.oniroproject.org/distro/oniro/-/merge_requests/383


Signed-off-by: Philippe Coval <philippe.coval@huawei.com>

Zygmunt Krynicki authored 3 years ago and Stefan Schmidt committed 3 years ago

Changes to the pipeline definition file should trigger the same set of
builds as changes to the shared jobs.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Zygmunt Krynicki authored 3 years ago and Stefan Schmidt committed 3 years ago

The manifest is special, because when it changes the oniro repository is
cloned three times inside the CI process:

- first time by GitLab, as a part of the normal CI checkout process
- second time by repo init, as a part of the .workspace job
- last time by repo sync, as a part of the same job

When the manifest changes, the CI system should be testing the incoming
change. Crucially the second step needs to be adjusted, to take the
manifest from a non-default location. This was handled before the
manifest repository was merged into the oniro repository. During that
merge the critical step was lost.

Adjust the .bitbake-workspace job to inject variables that pick the
correct manifest repository and branch. Leave a comment for the untested
rule about CI for tags.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

REUSE is allowed to fail, DCO is enforced.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

The CI system depends on a number of containers. Those used to be
defined in another repository but with this migration we can now
simplify and aggregate everything into one repository.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

This hidden job allows building Docker containers without privileged or
nested docker. It will be used to build all the containers used in CI.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

With the move to booting.oniroproject.org, the two compliance jobs now
refer to non-existent repository. They will be re-enabled soon, after
all containers and shared jobs definitions are merged into the oniro
project.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

This template is offered by GitLab to enable pipelines for merge
requests, a safety feature that avoids breaking the default branch by
merging things that passed in the past.

Reference: https://docs.gitlab.com/ee/ci/pipelines/merge_request_pipelines.html


Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

The machines-and-flavours.yaml file needs to be included after
build-generic.yaml. Order matters because of the delicate manner
in which they override and extend jobs seen previously.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Most things are moved unchanged. The relatively few changes are to the
documentation, as the split between the meta-ohos and manifest is gone,
as well as to the actual CI definitions for the workspace directory,
since the sources/ sub-directory is gone, and there was some
backwards-compatibility code that no longer makes sense to maintain.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

The .ostc-ci directory becomes .oniro-ci

The various CI variables names are now all uniformly named CI_ONIRO_.
Some specific variables were further trimmed to avoid using "CI" twice.

Remaining uses of OSTC and OHOS are for URLs, container images and
branch names.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

LAVA jobs are AFAIK not useful since the read-only images landed. Since
we've disabled publishing image artifacts earlier, let's properly
disable the LAVA jobs as well.

This commit should be reverted when LAVA jobs are working and the
slowness issue was debugged.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Hidden job .lava-test and .lava-report should have same set of rules
as the .bitbake-workspace job (which has the rules overridden for this
project).

Signed-off-by: Stevan Radaković <stevan.radakovic@linaro.org>

Add Qemu test jobs.
Add images for Qemu builds in order to boot them with LAVA.
Also fix a problem where CI jobs where not added to the pipeline on
changes within .ostc-ci dir.

Signed-off-by: Stevan Radaković <stevan.radakovic@linaro.org>

Chase Qi authored 3 years ago and Stevan Radaković committed 3 years ago

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Scheduled builds will allow us to re-test what's in HEAD without opening
a pull request. Making drafts start in manual mode will conserve
resources without limiting one's ability to iterate on selective
targets.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Include the machines-and-flavours file explicitly, from the local
repository.  It is already included via the build-generic.yaml
project-include above, but including it again here allows GitLab to pick
up the changes to the definition straight away. The include done via the
manifest repository is using the default branch, so it cannot pick up
changes to this file as it is being modified by incoming branches.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

The manifest repository now offers new hidden jobs, that make
customization and reuse easier. Those allow us to remove bulk of the
custom logic, again, reducing everything to mere configuration.

The build-docs and update-docs jobs are entirely replaced by .build-docs
and .aggregate-docs (name change without logic change).

Custom .build job is split into smaller changes to the .workspace and
.bitbake-workspace jobs. Lastly, the variable OHOS_CI_GIT_REPO_PATH
is no longer relative to sources/ but includes it explicitly.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

There are two separate issues here:

- CI_BRANCH_NAME doesn't exist, we want CI_COMMIT_BRANCH instead.
- The rules engine doesn't handle quotes in the normal sense.
Quotes are only allowed on literals, not variable references.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

CI_BRANCH_NAME doesn't exist

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>