Signed-off-by: Chase Qi <chase.qi@linaro.org>

Reorganize SQUAD groups and projects to make it easier to find out what
is tested by looking at the group/project overview.

New group/project org.

```
squad/
├── merge-request
│   ├── meta-zephyr
│   └── oniro
├── release
├── scheduled-daily
│   ├── kselftest
│   ├── ltp
│   ├── perf
│   └── zephyr
└── scheduled-weekly
    └── gcc
```

This closes: #731

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Chase Qi authored 2 years ago and Stevan Radaković committed 2 years ago

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Using build job name to download bundles doesn't work. We need to introduce
new var and make it mandatory for lava jobs containing the `sysota`
in job name.

Signed-off-by: Stevan Radaković <stevan.radakovic@linaro.org>

There was some cases that the same variable appears more then once in
the line. Only first appearence in the line was replaced.

Signed-off-by: artem.kondratiuk <artem.kondratiuk@huawei.com>

Artem Kondratiuk authored 2 years ago and Artem Kondratiuk committed 2 years ago

Signed-off-by: artem.kondratiuk <artem.kondratiuk@huawei.com>

Use squad build ID to query test pass percentage.

The lava-badge job is only needed by scheduled pipeline as calculating
pass rate of full testing makes more sense. Enabling the job here for
MR in draft status is mainly for debugging purpose.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

When the callback not dispatchered correctly, the record can be helpful
for debugging in squad.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Given test scope for new MRs is not defined yet and we only have one
rpi4, b68 and c61 in the warsaw lab which are occupied mostly by daily
scheduled pipeline, starting with boot and smoke tests on qemu devices
should be a good starting point for per MR testing.

Jobs that extend `.lava-test` will be added to MR's pipeline and
schedueld pipeline.

`.lava-test-scheduled` extends `.lava-test` with new scheduled pipeline
only rule. Long run jobs like ltp should extends the job so that they
wouldn't prevent MRs from merging.

Solves #486.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Chase Qi authored 2 years ago and Stevan Radaković committed 2 years ago

Pipeline ID is used as squad project level build ID. However, squad
build ID is the one to use for api calls. It is unique cross the
instance.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

We switched the build id scheme in SQUAD to use pipeline ID instead
of short commit SHA. Now lava-report job has to reflect that as well.

Signed-off-by: Stevan Radaković <stevan.radakovic@linaro.org>

Add the SQUAD_INSTANCE variable to the update callback URL

Signed-off-by: Stevan Radaković <stevan.radakovic@linaro.org>

Use SQUAD callback to trigger the lava-report pipeline job and
simplify lava-badge calculation by using SQUAD API.
SQUAD build ID is now implemented to be the same as pipeline ID.

Signed-off-by: Stevan Radaković <stevan.radakovic@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

This is a first patch to introduce squad as a middleman in handling
LAVA job. SQUAD provides a DB to store test results in a scalable manner,
while also providing a good comparison engine for quick discovery of
regressions. Any visualization tool will make good use of SQUAD db and API.

Signed-off-by: Stevan Radaković <stevan.radakovic@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Chase Qi authored 2 years ago and Stevan Radaković committed 2 years ago

Signed-off-by: Chase Qi <chase.qi@linaro.org>

The EF infrastructure (GitLab) doesn't support image registry. This
change switches the container images to use the OSTC registry while
EF catches up[1].

[1] eclipsefdn/helpdesk#1108



Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

Chase Qi authored 2 years ago and Andrei Gherzan committed 2 years ago

Fail lava-report if incomplete job found. Allow lava-report to fail to
run the downstream lava-badage job.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

This helps to understand that the actual interpolation process cannot use
syntax like bash/sh. In addition, putting the @ sigil at both ends so that
@FOO_BAR is not incorrectly replaced as well.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Chase Qi authored 3 years ago and Stevan Radaković committed 3 years ago

The old ostc-builder cannot be patched now as the project has been
migrated to the `distro/oniro` project.

This closes: #218

Signed-off-by: Chase Qi <chase.qi@linaro.org>

lava-test badge shows success rate for on device testing in lava.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Introduce machine variable for lava-test and search build images for the
test target device only to make sure only images for the target device
submitted for test.

This closes #215.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Skip git operations in lava jobs as these jobs operate exclusively on
artifacts.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

CI_LAVA_TOKEN is required for submitting job to LAVA server. It should
be set in instance level gitlab CI/CD variables for testing forking dev
flow based MRs.

With `when: never` rule, test job will not be added to pipeline if the
above var not set. If the condition not set in test job that extends
`.lava-test`, `.lava-test` will ask user to do so and then exit with
unsuccessful job status. There is no easy way to exit early with
successful status yet. See
https://gitlab.com/gitlab-org/gitlab/-/issues/329217#note_572963049



Adding the above condition in `.lava-test` has no impact on test job
that extends the `.lava-test`.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Most things are moved unchanged. The relatively few changes are to the
documentation, as the split between the meta-ohos and manifest is gone,
as well as to the actual CI definitions for the workspace directory,
since the sources/ sub-directory is gone, and there was some
backwards-compatibility code that no longer makes sense to maintain.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>