The parent of all zephyr jobs is now unified to enable easier
extensibility later on.
Update documentation.

Signed-off-by: Davide Gardenal <davide.gardenal@huawei.com>

The rootfs size is no more affected by the debug mode, the reverted
commit has no purpose now.

This reverts commit 7a5149bc.

Signed-off-by: Davide Gardenal <davide.gardenal@huawei.com>

Enabling debug mode is not the ideal solution for running
tests because it's responsible for enlarging the rootfs size and causing
tests to fail. More detail reported in #673.

This reverts commit 3ddebb37.

Signed-off-by: Davide Gardenal <davide.gardenal@huawei.com>

oniro-image-base-tests and oniro-image-extra-tests needs
an empty root password to correctly run their tests, this
is enabled by debug-tweaks.

Signed-off-by: Davide Gardenal <davide.gardenal@huawei.com>

Use the Yocto class to generate SBOM. Activate on Linux only,
there is a pending issue on Zephyr [1]

[1] https://lists.openembedded.org/g/openembedded-core/message/167450



Signed-off-by: Marta Rybczynska <marta.rybczynska@huawei.com>

Apache-2.0 licensed patches can't be applied to (L)GPL 2.x code
without legal issues.
These patches should have been under the same license as the
upstream project in the first place.

Thanks to shoragan for spotting this.

Signed-off-by: Bernhard Rosenkränzer <bernhard.rosenkraenzer.ext@huawei.com>

* ci: work around zephyr test issues : Jon Mason
* arm-bsp/fvp-baser-aemv8r64: Use secure hypervisor physical timer in EL2 : Jiamei Xie

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

* .github: workflows: meta-rauc: pin to kirkstone : Enrico Jorns
* rauc: move 'streaming' PACKAGECONFIG option to common includes : Enrico Jorns

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

* build-appliance-image: Update to kirkstone head revision : Richard Purdie

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

Building the base test image with debug mode enabled returns the below
error.

```
ERROR: File system image of partition / is larger (2269180 kB) than its
allowed size 2097152 kB.
```

Increasing rootfs size to 2500M solves the issue.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

LAVA needs a writable directory to deploy test cases, and many test
cases only work with root user.

The debug mode can be disabled by overwriting the
CI_ONIRO_BB_LOCAL_CONF_plus_equals_INHERIT variable at build job level.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Make the report generation more customizable. Apart from the CSV report,
add also a summary report including the number of CVEs in each package.

Signed-off-by: Marta Rybczynska <marta.rybczynska@huawei.com>

Marta Rybczynska authored 2 years ago and Pavel Zhukov committed 2 years ago

cve-diff analyses JSON CVE outputs of two builds and shows
the difference between the two. The initial version handles:
added/removed packages and CVEs.

Signed-off-by: Marta Rybczynska <marta.rybczynska@huawei.com>

meta-secure-core provides security features like UEFI secure boot,
key store, TPM, IMA and more. It is also a dependency for the LEDGE
work. This revision supports kirkstone.

Signed-off-by: Marta Rybczynska <marta.rybczynska@huawei.com>

Signed-off-by: Chase Qi <chase.qi@linaro.org>

When the callback not dispatchered correctly, the record can be helpful
for debugging in squad.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Given test scope for new MRs is not defined yet and we only have one
rpi4, b68 and c61 in the warsaw lab which are occupied mostly by daily
scheduled pipeline, starting with boot and smoke tests on qemu devices
should be a good starting point for per MR testing.

Jobs that extend `.lava-test` will be added to MR's pipeline and
schedueld pipeline.

`.lava-test-scheduled` extends `.lava-test` with new scheduled pipeline
only rule. Long run jobs like ltp should extends the job so that they
wouldn't prevent MRs from merging.

Solves #486.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

Unqualified jobs, which rely on the default compiler, are gone.
Qualified jobs explicitly configure either clang or gcc and use the
appropriate suffix. Qualified jobs have needs/depends set to empty to
both avoid waiting for previous stages to start and to avoid pulling in
artifacts from the previous stage.

Qualified jobs inhabit two new lanes: build-gcc and build-clang, to
visually break the already long column of "build" jobs.

Job ordering within a lane is not exactly matching, gcc-clang. This is
noticeable with the jobs using the "extra" suffix. The reason for this
is unclear.

Some jobs are marked as broken as they do not build with clang. Allow
them to fail and make them start manually until more patches arrive.

Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@huawei.com>

* ci: work around zephyr test issues : Jon Mason
* arm-bsp/fvp-baser-aemv8r64: Use secure hypervisor physical timer in EL2 : Jiamei Xie
* arm/fvp-base-r-aem: Upgrade to version 11.18.16 : Peter Hoyes

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

* .github: workflows: meta-rauc: pin to kirkstone : Enrico Jorns
* rauc: move 'streaming' PACKAGECONFIG option to common includes : Enrico Jorns
* rauc: update to 1.7 : Enrico Jorns

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

This revision updates obsolete Licenses

Signed-off-by: Natalia Kovalenko <waykovalenko@gmail.com>

Zephyr-philosophers doesn't use video output but serial console.

Fixes: #docs#109



Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

* b8fd6f5d  server/process: Fix logging issues where only the first message was displayed - Richard Purdie

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

* a5919cb8bc mesa: backport a patch to support compositors without zwp_linux_dmabuf_v1 again - Martin Jansa
* f0770686b3 rootfs-postcommands.bbclass: correct comments - Michael Opdenacker
* bffe06fca6 gtk-doc: Fix potential shebang overflow on gtkdoc-mkhtml2 - Paulo Neves
* 8d646cc4ee systemd: systemd-systemctl: Support instance conf files during enable - Nick Potenski
* a121d2dd5d efivar: add musl libc compatibility - Davide Gardenal
* 8a86bd88f0 python: Avoid shebang overflow on python-config.py - Paulo Neves
* cdb6879b49 python3: Ensure stale empty python module directories don't break the build - Richard Purdie
* 2f93d30fee python3: Remove problematic paths from sysroot files - Richard Purdie
* 8e34686911 python3: use built-in distutils for ptest, rather than setuptools' 'fork' - Alexander Kanavin
* bcc5a22cd2 linux-firmware: upgrade 20220509 -> 20220610 - Dmitry Baryshkov
* 96cd37cff9 linux-firmware: add support for building snapshots - Dmitry Baryshkov
* feabc35372 oeqa/selftest/cve_check: add tests for Ignored and partial reports - Marta Rybczynska
* d76957e425 cve-check: add support for Ignored CVEs - Marta Rybczynska

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

This revision fixes labels for boot and devdata partitions

Signed-off-by: Natalia Kovalenko <waykovalenko@gmail.com>

Create bbclass files in meta-oniro-core
that enable the user to activate the debug mode
in local.conf.

Activating it is equivalent to build -dev images
as of this commit.

Signed-off-by: Davide Gardenal <davide.gardenal@huawei.com>

oniro-user is a class that can be inherited in local.conf
and it adds a user named oniro with default password oniro.
The class also installs sudo and adds oniro to the suders.

Signed-off-by: Davide Gardenal <davide.gardenal@huawei.com>

* b2d10487f8 liberror-perl: Update sstate/equiv versions to clean cache - Richard Purdie
* 7cdaac4a5a systemd: update 0008-add-missing-FTW_-macros-for-musl.patch - Pavel Zhukov
* 6fa49ffcf2 archiver: don't use machine variables in shared recipes - Jose Quaresma
* 7211a6fb51 gcc-source: Fix incorrect task dependencies from ${B} - Richard Purdie
* 025d22e9c9 git: fix override syntax in RDEPENDS - Yi Zhao
* 6168dbc9b2 popt: fix override syntax in RDEPENDS - Yi Zhao
* 8876f33f08 e2fsprogs: add alternatives handling of lsattr as well - Rasmus Villemoes
* 8c74bca4d6 oescripts: change compare logic in OEListPackageconfigTests - Mingli Yu
* d8e454b370 xxhash: fix build with gcc 12 - Kai Kang
* d8cb65b2ae archiver: use bb.note instead of echo - Jose Quaresma
* 3beb0f1d44 meson.bbclass: add cython binary to cross/native toolchain config - Jack Mitchell
* 5e6f4d0d3d devtool: Fix _copy_file() TypeError - Xiaobing Luo
* e150443701 selftest/multiconfig: Test that multiconfigs in separate layers works - Richard Purdie
* ea280917fc uboot-sign: Fix potential index error issues - Richard Purdie
* b85e29de4b vim: Upgrade 8.2.5034 -> 8.2.5083 - Richard Purdie

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

When sysota is built with toolchain-clang broken dynamicaly linked
binary file is produced [1] if shared linking (GO_DYNLINK) is disabled.
As the result strip phase of do_packages fails with [2]
Sysota is built with disabled shared linking because of another bug [3]
The problem with stripping can be fixed with specifying external linker
for clang toolchain (by default Go swutched to internal linker on 64bit
arches if -pie has been specified since version 1.15 [4] ).
Limiting this change to clang only to be safe.

[1] **readelf: Error: no .dynamic section in the dynamic segment**

[2] Subprocess output:x86_64-oniro-linux-llvm-strip: error: SHT_STRTAB
        string table section [index 7] is non-null terminated

[3] eclipse/oniro-core/sysota#7

[4] https://go.dev/doc/go1.15#linker



Fixes: #624

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

With default network settings of runqemu script Oniro images start without
IP address assigned which may cause inconvenience for some users.
Using user network allows network access from the Oniro VM and
enables port forwarding for ssh access.

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

Chase Qi authored 2 years ago and Stevan Radaković committed 2 years ago

Pipeline ID is used as squad project level build ID. However, squad
build ID is the one to use for api calls. It is unique cross the
instance.

Signed-off-by: Chase Qi <chase.qi@linaro.org>

We switched the build id scheme in SQUAD to use pipeline ID instead
of short commit SHA. Now lava-report job has to reflect that as well.

Signed-off-by: Stevan Radaković <stevan.radakovic@linaro.org>

The change (disable systemd+musl warning)  is distro specific
and not going to be upstream'ed.

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

The FTBFS issue is gone and the patch is not needed anymore

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

Pavel Zhukov authored 2 years ago and Andrei Gherzan committed 2 years ago

Gitlab doesn't assign scopped labels if they were not properly quoted

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

Re-allow overriding of TCLIBC via local.conf/shell env.
Upstream part has been merged into kirkstone branch:
oe-core:e30ef926e440b505e93e404c056034d86364a241

Fixes: #608

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

Changes since last update:
* 0f7a8359ba rootfs.py: close kernel_abi_ver_file - Martin Jansa
* 9478e53995 buildhistory.bbclass: fix shell syntax when using dash - Martin Jansa
* 741030ce32 systemd: Correct 0001-pass-correct-parameters-to-getdents64.patch - Jiaqing Zhao
* 92a5fb9138 lttng-modules: fix shell syntax - Martin Jansa
* 48aad396d9 lttng-modules: Fix build failure for 5.10.119+ and 5.15.44+ kernel - He Zhe
* 6c689e1b6f lttng-modules: fix build against 5.18-rc7+ - Bruce Ashfield
* a4b49bdba4 linux-yocto/5.10: update to v5.10.119 - Bruce Ashfield
* 87f0b01ea3 linux-yocto/5.15: update to v5.15.44 - Bruce Ashfield
* 6b82997af3 linux-yocto/5.15: cfg/xen: Move x86 configs to separate file - Bruce Ashfield
* 10bb8f0309 linux-yocto/5.15: Enable MDIO bus config - Bruce Ashfield
* 88ce6da03c linux-yocto/5.10: update to v5.10.118 - Bruce Ashfield
* 3fb0fd6630 linux-yocto/5.15: update to v5.15.43 - Bruce Ashfield
* 8f04684552 linux-yocto/5.15: bpf: explicitly disable unpriv eBPF by default - Bruce Ashfield
* 64ac42262d lttng-ust: upgrade 2.13.2 -> 2.13.3 - wangmy
* c4114d9bfb iso-codes: upgrade 4.9.0 -> 4.10.0 - wangmy
* fb4672a8b4 baremetal-image: fix broken symlink in do_rootfs - Davide Gardenal
* e30ef926e4 bitbake.conf: Make TCLIBC and TCMODE lazy assigned - Pavel Zhukov
* e36a8a22bd glibc: Drop make-native dependency - Richard Purdie
* 6b1bc1366b perl: Add dependency on make-native to avoid race issues - Richard Purdie
* 4b694ded86 sanity: Switch to make 4.0 as a minimum version - Richard Purdie

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>

Add scripts for post-processing the JSON CVE data:
- cve-json-to-csv.py allows to convert the JSON file to CSV
- recipes-with-no-cves.py lists CVE status of all recipes

Signed-off-by: Marta Rybczynska <marta.rybczynska@huawei.com>

This helps with rebases on newer oe-core and helps avoiding
redundant/duplicated patches

Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com>