The Oniro pipeline is a bit special, because it has to cope with several layers
of git repositories. On one hand side oniro.git uses git-repo manifests, this
presents the first complexity of a branch trying to change the manifest that
needs special care to test correctly (so that the test correctly verifies the
change, rather than previous, known-good commit). On the other hand side it can
be used as a reusable pipeline in other repositories that are described by the
manifest naturally have distinct projects with their own pipelines.

As a sort-of special case, oniro.git fits both of those conditions. Changes to
oniro.git need to both replace the manifest checkout stage (repo init && repo
sync) _and_ replace what the manifest would have checked out to instead use
what GitLab wants to check out inside $CI_PROJECT_DIR.

This presents us with a puzzle, what _did_ GitLab runner do? What exactly is
checked out in $CI_PROJECT_DIR? This depends on project settings, pipeline type
and perhaps other things we have yet to encounter.

Instead of trying to correctly model all the variants, let's do something
stupid and brutal, but correct. When the pipeline indicates that manifest
element needs to be replaced by setting $CI_ONIRO_GIT_REPO_PATH to a non-empty
value then remove the git checkout prepared by git-repo and replace it with a
symbolic link to $CI_PROJECT_DIR.

This allows us to work with merge trains, pipelines for branches and pipelines
for merge requests all at the same time.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Bernhard Rosenkränzer authored 2 years ago and Stefan Schmidt committed 2 years ago

Update documentation on building with openharmony support after
!250
and
https://gitlab.eclipse.org/eclipse/oniro-core/meta-openharmony/-/merge_requests/65


have landed

Signed-off-by: Bernhard Rosenkränzer <bernhard.rosenkraenzer.ext@huawei.com>

Marta Rybczynska authored 2 years ago and Pavel Zhukov committed 2 years ago

Enable TPM-related distro features. We're interested in TPM2, so
we need to enable both tpm and tpm2.

Also enable security dependencies. The dependency on meta-security
we have already had before, now add also tpm and tpm2 as we enable
the feature.

As a next step we need to enable related MACHINE_FEATURES for the
machines TPM (or software TPM) is available.

Signed-off-by: Marta Rybczynska <marta.rybczynska@huawei.com>

Marta Rybczynska authored 2 years ago and Pavel Zhukov committed 2 years ago

Signed-off-by: Marta Rybczynska <marta.rybczynska@huawei.com>

Marta Rybczynska authored 2 years ago and Pavel Zhukov committed 2 years ago

Add LEDGE forks with kirkstone-related changes. We use forks because
the meta-ts layer doesn't have kirkstone support yet,
and meta-ledge-secure has some dependencies we do not need right now
(especially meta-selinux). Discussions for the two layers are in
progress, but may still take some time. When all our required changes
are upstream, we may switch to using the upstream directly.

Signed-off-by: Marta Rybczynska <marta.rybczynska@huawei.com>

Add zephyr build and test jobs for the below qemu machines:
* qemu-x86
* qemu-cortex-m3

Closes eclipse/oniro-core/meta-zephyr#35



Signed-off-by: Chase Qi <chase.qi@linaro.org>

Since all it does is change permissions on installed binaries,
it is independent of the binutils version.
This gets it ready for the 2.39 update.

Signed-off-by: Bernhard Rosenkränzer <bernhard.rosenkraenzer.ext@huawei.com>

Update binutils to 2.39

This is in sync with upstream openembedded-core
commit 30e902f42d4a0205d2a75bf9b2a9cc5e8db582be

Signed-off-by: Bernhard Rosenkränzer <bernhard.rosenkraenzer.ext@huawei.com>

Forwarded: eclipse/oniro-core/oniro!283
Relate-to: eclipse/oniro-core/oniro#787


Signed-off-by: Philippe Coval <philippe.coval.ext@huawei.com>

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

The new keys contain the new "Eclipse Oniro" branding and are valid for 365
days like before.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

The correct syntax is ConditionFoo=, not ConditionalFoo=. This was
easily missed because invalid syntax is not fatal, and the service will
work correctly regardless of presence or absence of this configuration
element.

https://www.freedesktop.org/software/systemd/man/systemd.unit.html#ConditionPathExists=



Thanks to Kristijonas Čiulčinskas <kristijonas.ciulcinskas@huawei.com>
Grzegorz Gwóźdź <grzegorz.gwozdz@huawei.com> for reporting this.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

Pavel Zhukov authored 2 years ago and Andrei Gherzan committed 2 years ago

* 4ada86c : bitbake: runqueue: add memory pressure regulation - Aryaman Gupta
* f4954b8 : bitbake: runqueue: add cpu/io pressure regulation - Aryaman Gupta

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

OpenHarmony needs a writable /data directory. Create it by bind-mounting
a subdirectory of /run/mount/appdata if the openharmony
DISTRO_FEATURE is set.

Signed-off-by: Bernhard Rosenkränzer <bernhard.rosenkraenzer.ext@huawei.com>

Marta Rybczynska authored 2 years ago and Andrei Gherzan committed 2 years ago

Update the comment on ONIRO_LAYERS_CONF_VERSION to tell the user
that they also need to change ONIRO_REQUIRED_LAYERS_CONF_VERSION
and where to find it. Cover both cases of the sample and the
local file.

Signed-off-by: Marta Rybczynska <marta.rybczynska@huawei.com>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

When DISTRO_NAME was refactored, it reused the lowercase variant of
flavour name changing in this way its style. This fixes it to use
the "pretty" flavour name.

Fixes eclipse/oniro-core/oniro#786



Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

* 33eec78 : ceph: upgrade v15.2.15 -> v15.2.17 - sakib.sajal@windriver.com
* 406eb64 : singularity: Drop explicit runtime dep glibc - Andrei Gherzan

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

* 10891d4 : lttng-modules: replace mips compaction fix with upstream change - Bruce Ashfield
* 86c1096 : lttng-modules: fix build against mips and v5.19 kernel - Bruce Ashfield
* a69cb04 : lttng-modules: fix 5.19+ build - Bruce Ashfield
* a894fda : selftest/wic: Tweak test case to not depend on kernel size - Richard Purdie
* 3f25837 : relocate_sdk.py: ensure interpreter size error causes relocation to fail - Paul Eggleton
* 394c1bb : nativesdk: Clear TUNE_FEATURES - Richard Purdie
* b60f4c7 : scripts/oe-setup-builddir: make it known where configurations come from - Alexander Kanavin
* aeec7cc : cmake: remove CMAKE_ASM_FLAGS variable in toolchain file - Martin Beeger
* f595240 : boost: fix install of fiber shared libraries - Mikko Rapeli
* 9079992 : create-spdx: ignore packing control files from ipk and deb - Jose Quaresma
* 504b50a : create-spdx: Fix supplier field - Mihai Lindner
* 31ed9d6 : archiver.bbclass: remove unsed do_deploy_archives[dirs] - Jose Quaresma
* fcb55a1 : runqemu: Add missing space on default display option - Mark Hatle
* 72bfdca : devtool/upgrade: catch bb.fetch2.decodeurl errors - Alexander Kanavin
* a7d406d : devtool/upgrade: correctly clean up when recipe filename isn't yet known - Alexander Kanavin
* 3aee342 : devtool: error out when workspace is using old override syntax - Roland Hieber
* 27e4c6f : vim: update from 9.0.0063 to 9.0.0115 - Randy MacLeod
* 46ac4a9 : zlib: CVE-2022-37434 a heap-based buffer over-read - Hitendra Prajapati
* 49781a7 : gnutls: CVE-2022-2509 Double free during gnutls_pkcs7_verify - Hitendra Prajapati
* af701fd : u-boot: fix CVE-2022-33103 - Sakib Sajal
* f2ebd77 : qemu: fix CVE-2022-0216 - Sakib Sajal
* 99c4b60 : qemu: fix CVE-2022-0358 - Sakib Sajal
* a171d1f : qemu: fix CVE-2021-4158 - Sakib Sajal
* 3be3101 : qemu: fix CVE-2021-3929 - Sakib Sajal
* 8ad9e87 : qemu: fix CVE-2021-3507 - Sakib Sajal
* 978bc91 : gdk-pixbuf: CVE-2021-46829 a heap-based buffer overflow - Hitendra Prajapati

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

Add the below daily test jobs for qemuarm-efi and qemuarm64-efi
machines.

* ltp
* kselftest
* perf

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Luca Seritan authored 2 years ago and Andrei Gherzan committed 2 years ago

Current qemuarm-efi defconfig contains many useless features,
remove it and use the qemuarm base config with additional EFI features.

For linux-yocto compatibility, set qemuarm-efi to fetch from the same
machine specific branches as qemuarm.

Signed-off-by: Luca Seritan <luca.seritan@huawei.com>

Luca Seritan authored 2 years ago and Andrei Gherzan committed 2 years ago

Current qemuarm64-efi defconfig contains many useless features,
remove it and use the qemuarm64 base config with additional EFI features.

For linux-yocto compatibility, set qemuarm64-efi to fetch from the same
machine specific branches as qemuarm64.

Signed-off-by: Luca Seritan <luca.seritan@huawei.com>

Luca Seritan authored 2 years ago and Andrei Gherzan committed 2 years ago

Machines that have the efi feature also need the efi kernel features, so
add these by default to both linux-oniro and linux-yocto.

Signed-off-by: Luca Seritan <luca.seritan@huawei.com>

Luca Seritan authored 2 years ago and Andrei Gherzan committed 2 years ago

qemuarm-efi is an efi machine that does not support ACPI. To fix this,
drop ACPI as a dependency in efi.cfg. This will not affect x86 machines
as ACPI is enabled by default for those. For arm64, apply an additional
patch that defaults to ACPI=y.

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>
Signed-off-by: Luca Seritan <luca.seritan@huawei.com>

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

Modern ssh clients use SFTP protocol and refuse to connect using
SCP protocol (dropbear uses) by default. Adding sftp-server to allow
sftp connections in Oniro.
This requires workaround for [Yocto #14858] to be applied for every
Oniro images, not only extra-tests.

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

Document gcc and clang as supported toolchains, and how to
switch between them

Signed-off-by: Bernhard Rosenkränzer <bernhard.rosenkraenzer.ext@huawei.com>

Bernhard Rosenkränzer authored 2 years ago and Andrei Gherzan committed 2 years ago

Fixes building without meta-network (e.g. meta-openharmony CI)

Signed-off-by: Bernhard Rosenkränzer <bernhard.rosenkraenzer.ext@huawei.com>

Bernhard Rosenkränzer authored 2 years ago and Andrei Gherzan committed 2 years ago

Fixes building without meta-arm (e.g. meta-openharmony CI)

Signed-off-by: Bernhard Rosenkränzer <bernhard.rosenkraenzer.ext@huawei.com>

We define the initial value for these variables as being 1. We also need
to set a default value for ONIRO_LAYERS_CONF_VERSION because the check
will not be triggered when ONIRO_LAYERS_CONF_VERSION is not defined
(builds before this check is introduced).

Finally, we drop POKY_BBLAYERS_CONF_VERSION as it is  an artefact from
when the project was using the poky distro.

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

The logic is similar to how oe-core and poky handle their set of sample
configurations. The core difference is the fact that we only flag
currently (no automatic migrations yet) by providing a helpful build
error before parsing. In this way we can instruct an user to update
their bblayers.conf when the Oniro introduced new lateyers integrations.

The variables of interest here are ONIRO_LAYERS_CONF_VERSION and
ONIRO_REQUIRED_LAYERS_CONF_VERSION. Whenever the project's
bblayers.conf.sample changes, we need to bump both of these values.

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

Each distro configurations are now defining DISTRO and DISTRO_NAME based
on ONIRO_FLAVOUR (which in turn is autogenerated from
ONIRO_FLAVOUR_PRETTY). This reduces duplication but also allows to check
for the flavour at build time via querying ONIRO_FLAVOUR.

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>

* def57bd : ima: Remove disabling CONFIG_IMA_TEMPLATE - He Zhe

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

* 15cdda2 : linux-intel-dev: update to 5.19.0 - Naveen Saini
* 1b7dd7a : linux-intel-rt/5.15: update to v5.15.49 - Naveen Saini
* 54d5b80 : linux-intel/5.15: update to v5.15.49 - Naveen Saini
* 032466f : onednn: turn on PACKAGECONFIG for GPU engine - Anuj Mittal
* 43224e9 : onednn : Upgrade 2.6 -> 2.6.1 - Yogesh Tyagi
* ae72503 : intel-microcode: upgrade 20220510 -> 20220809 - Anuj Mittal
* 3898a44 : intel-compute-runtime: upgrade 22.23.23405 -> 22.31.23852 - Anuj Mittal
* 29ab273 : intel-microcode: update SRCREV for 20220510 - Yongxin Liu
* 3bf3a4b : openvino-inference-engine: enable GPU plugin - Anuj Mittal
* f47a4b0 : intel-graphics-compiler: upgrade 1.0.11378 -> 1.0.11702.1 - Anuj Mittal
* a6a0a70 : linux-intel: fix buildpaths issue - Anuj Mittal
* 9cb16a0 : onevpl-intel-gpu: Fix HEVC 12 bit Encode - Teng, Jin Chung
* 79ca0ec : intel-compute-runtime: upgrade 22.22.23355 -> 22.23.23405 - Anuj Mittal
* 3af3b5c : intel-graphics-compiler: upgrade 1.0.11279 -> 1.0.11378 - Anuj Mittal
* f322d4f : ixgbe : upgrade 5.14.6 -> 5.15.2 - Yogesh Tyagi
* ceb7e22 : ixgbevf : upgrade 4.14.5 -> 4.15.1 - Yogesh Tyagi

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

* acbe748 : cryptsetup: Add support for building without SSH tokens - Peter Kjellerstedt
* ce74ad4 : libwebsockets: Avoid absolute paths in *.cmake files in the sysroot - Peter Kjellerstedt
* 9165fb0 : yasm: fix buildpaths warning - Anuj Mittal
* 73a17ff : frr: fix buildpaths issue - Mingli Yu
* 78e65e7 : apache2: Fix the buildpaths issue - Mingli Yu
* bbfdaf4 : openipmi: Fix buildpaths issue - Mingli Yu
* 055f26c : freeradius: Fix buildpaths issue - Mingli Yu
* fe7250a : postgresql: Fix the buildpaths issue - Mingli Yu
* 2594e97 : net-snmp: set ac_cv_path_PSPROG - Mingli Yu
* 72d3abd : ibus: Swith to use main branch instead of master - Khem Raj
* 3207be5 : polkit: update patches for musl compilation - Marta Rybczynska
* eb9a5dc : polkit: Add --shell /bin/nologin to polkitd user - Akash Hadke
* 5b7f7f3 : polkit-group-rule-udisks2: fix override syntax in RDEPENDS - Yi Zhao
* 64f9534 : polkit: add udisks2 rule - Vyacheslav Yurkov
* a8b879b : glmark2: fix compatibility with python-3.11 - Martin Jansa

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

* 2cafa6e : build-appliance-image: Update to kirkstone head revision - Richard Purdie
* 455acda : lttng-modules: Fix build failure for kernel v5.15.58 - He Zhe
* 5fb62be : lttng-modules: update 2.13.3 -> 2.13.4 - Alexander Kanavin
* 6216cc2 : linux-yocto/5.15: fix reproducibility issues - Bruce Ashfield
* f9c284c : linux-yocto/5.15: update to v5.15.59 - Bruce Ashfield
* 2bca0a8 : linux-yocto-rt/5.15: update to -rt48 (and fix -stable merge) - Bruce Ashfield
* 5a6bc91 : linux-yocto/5.15: update to v5.15.58 - Bruce Ashfield
* 373f857 : linux-yocto/5.10: update to v5.10.135 - Bruce Ashfield
* c6435f0 : glibc: revert one upstream change to work around broken DEBUG_BUILD build - Martin Jansa
* ec5de25 : glibc : stable 2.35 branch updates - Sundeep KOKKONDA
* c33eb7f : openssh: Add openssh-sftp-server to openssh RDEPENDS - Alex Kiernan
* 4d6b260 : strace: set COMPATIBLE_HOST for riscv32 - Mingli Yu
* 9d2f5c1 : kernel.bbclass: pass LD also in savedefconfig - Martin Jansa
* 10bc315 : linux-firwmare: restore WHENCE_CHKSUM variable - Dmitry Baryshkov
* 38fb876 : libgcc: Fix standalone target builds with usrmerge distro feature - Khem Raj
* fd56896 : package_manager/ipk: do not pipe stderr to stdout - Shruthi Ravichandran
* 4eb53b3 : binutils: stable 2.38 branch updates - Sundeep KOKKONDA

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

Signed-off-by: Andrei Gherzan <andrei.gherzan@huawei.com>