This introduces support for new variable to be set by gitlab-runner.

It should be set to the max number of parallel jobs to be spawned. It will be
applied to both the number of concurrent bitbake threads/tasks and the number of
parallel jobs in each make/cmake/meson based bitbake task though. So take
care...

Signed-off-by: Esben Haabendal <esben.haabendal@huawei.com>

Signed-off-by: Esben Haabendal <esben.haabendal@huawei.com>

Signed-off-by: Esben Haabendal <esben.haabendal@huawei.com>

This will make make and ninja builds also respect the value set by
$CI_ONIRO_NUM_CPU variable, and apply a sane default using the nproc shell
command.

Signed-off-by: Esben Haabendal <esben.haabendal@huawei.com>

Signed-off-by: Esben Haabendal <esben.haabendal@huawei.com>

I don't have a valid explanation for that but it turns out that fetching
3.0 repositories first then 3.1.1 ones leads to bitbake fetch failures.
Starting by fetching 3.1.1 then 3.0 repositories works better.

Signed-off-by: Thierry Escande <thierry.escande@huawei.com>

Signed-off-by: Esben Haabendal <esben.haabendal@huawei.com>

Signed-off-by: Esben Haabendal <esben.haabendal@huawei.com>

Signed-off-by: Esben Haabendal <esben.haabendal@huawei.com>

Fetch OpenHarmony OS codebase release tarballs and test
oniro-openharmony-toolchain and oniro-openharmony-bundle against these.

In order to save CI resources, only MR pipelines run these new jobs
automatically.  For normal branch pipelines, the job are set to manual, so
developer can choose to run them as needed.

Signed-off-by: Esben Haabendal <esben.haabendal@huawei.com>

Execution of do_testimage have been stable for a while, so we don't need to
allow it to fail anymore. We should not accept changes that breaks it anymore.

Signed-off-by: Esben Haabendal <esben.haabendal@huawei.com>

This change adds support for OpenHarmony 3.0 and 3.1 builds by adding
the OPENHARMONY_VERSION variable to the build matrices.

It is added to conf/auto.conf by the before_script section of the
.bitbake job.

This is handled differently for the fetch job, as in this case the
variable OPENHARMONY_VERSION is set after the .bitbake before_script. So
the before_script appends 'OPENHARMONY_VERSION = ""' to auto.conf and a
sed substitution is used to set it to the correct value.

Signed-off-by: Thierry Escande <thierry.escande@huawei.com>

If the script step fails in fetch job, the after_script was failing because of
missing mirror-updates-ch dir, causing source mirror to not be updated with what
was already fetched.

Signed-off-by: Esben Haabendal <esben.haabendal@huawei.com>

By moving the copying of downloaded files to mirror from script to after_script,
the mirror will be updated with successfully downloaded files even in case of
script failure, which will help out if we have unreliable access multiple
upstream sources.

Signed-off-by: Esben Haabendal <esben.haabendal@huawei.com>

This allows downloading of pipeline ptest test reports.

Signed-off-by: Esben Haabendal <esben.haabendal@huawei.com>

Signed-off-by: Esben Haabendal <esben.haabendal@huawei.com>

Thierry Escande authored 2 years ago and Esben Haabendal committed 2 years ago

Since the git clone done by CI has its own uid and git operations
occurring within the build container uses a different uid, we need to
add the CI_PROJECT_DIR folder to the safe directory git configuration.

This is related to CVE-2022-24765 [1].

[1] https://github.blog/2022-04-12-git-security-vulnerability-announced/



Signed-off-by: Thierry Escande <thierry.escande@huawei.com>

Signed-off-by: Esben Haabendal <esben.haabendal@huawei.com>