WIP pipelines

Urgent

• upload should select only uploaded, or a select command must be called after upload (add filter?)

• to handle possible yoctobuild job cancellations: remove build dir if no .success or .failure files found

• create 3 badges depending on the pipeline type (whole, latest, onlyaliens)

  • Unable to find the correct status badge links for the harvest.json files (maybe we suffer from https://gitlab.com/gitlab-org/gitlab/-/issues/20230?)
  • Find working download URLs:
    • https://git.ostc-eu.org/oss-compliance/mirrors/oniro/-/jobs/artifacts/dunfell/raw/latest/harvest-latest-manifest.json?job=aliens4friends_latest
    • https://git.ostc-eu.org/oss-compliance/mirrors/oniro/-/jobs/artifacts/dunfell/raw/onlyaliens/harvest-latest-manifest.json?job=aliens4friends_onlyaliens
    • https://git.ostc-eu.org/oss-compliance/mirrors/oniro/-/jobs/artifacts/dunfell/raw/whole/harvest-latest-manifest.json?job=aliens4friends_whole

• use different session names and different folders for different pipeline types (scheduled=latest snapshot, only uploaded=onlyaliens, whole pool) (only for a4f):

  • for session_id files
  • for .success/.failure files for a4f

NOTE: change the logic when a new pipeline is run against and already processed build dir (eg. because there is a scheduled pipeline but there is no new commit, or an a4f job is manually re-run)

Normal

• meningful names for sessions
• dockerization: repo housecleaning
• more cores for scancode in solda.testingmachine.eu
• create VM on OSTC infrastructure just to test SSTATE_CACHE integration and yocto building (for now)
  • how to use shared cache: mirrors?
  • solve the problem of only partial use of SSTATE_CACHE by bitbake (ask @andrei)
• Test new optimized TinfoilHat, and tag it
• pick up machines and flavours from meta-ohos? (in any case, reconstruct all the build matrix with the new names and machines)

low

• for the $PIPELINE_TYPE folders, be sure that they do not exist in the build directories (whole, latest and onlyaliens) --> maybe we need a parent directory aliens4friends where we put these 3, but also aliensrc, tinfoilhat and the dot-files ???
• test dashboard and discuss with Martin
• a MR should go in a single session even if there are many commits?