858 Commits

Author SHA1 Message Date
Zuul
3cbb93c5bc Merge "debrepack: customize the revision" 2022-11-14 22:26:51 +00:00
Li Zhu
b06996108d Update tag for rvmc to stx.8.0-v1.0.1
Story: 2010144
Task: 46784

Signed-off-by: Li Zhu <li.zhu@windriver.com>
Change-Id: I28a52752b79185bee959a13c6627c13a323231fd
2022-11-10 16:14:36 -05:00
Zuul
a06291a7d6 Merge "downloader: call the interfaces of repo manager in safe way" 2022-11-10 15:52:19 +00:00
Zuul
98783396d6 Merge "update build-pkgs to build all as default" 2022-11-10 01:44:21 +00:00
Yue Tao
4a64688ccb debrepack: customize the revision
In some cases (specially for test patches), we want to force the package
version to be increased, so introduce a new variable "stx_patch" in
"revision", like:

revision:
  dist: $STX_DIST
  PKG_GITREVCOUNT: true
  stx_patch: 1

Test Plan:

Pass: revision is increased by adding "stx_patch: number" in
meta_data.yaml.

Story: 2008862
Task: 46766

Signed-off-by: Luis Sampaio <luis.sampaio@windriver.com>
Signed-off-by: Yue Tao <yue.tao@windriver.com>
Change-Id: I107d3bb5b88cc69c701fa08d22d774728dcf3d06
2022-11-10 08:39:33 +08:00
Zuul
3fdc0c8e54 Merge "Add tag stx.8.0-v1.0.2 to vRAN docker images" 2022-11-09 15:38:05 +00:00
Dostoievski Batista
ac3f6bf773 update build-pkgs to build all as default
This commit updates the build-pkgs tool to
build all packages as default without need
of any args.

This commit also update the license year in
downloader tool.

Test Plan:
	Pass: run build-pkgs without args
	Pass: build-pkgs -a
	Pass: build-pkgs -p -c logmgmt
	Pass: build-pkgs -p logmgmt

Story: 2008846
Task: 46765
Signed-off-by: Dostoievski Batista <dostoievski.albinobatista@windriver.com>
Change-Id: Ic270bbec2e7a8218daf0bb9d00101bbd1526344b
2022-11-09 08:51:50 -03:00
Haiqing Bai
e7550db59c downloader: call the interfaces of repo manager in safe way
The interfaces of repo manager should be called in the block
of 'try...except' to catch some exceptions.

Test Plan:
Pass: downloader -b
Pass: downloader -s

Story: 2008846
Task: 46744

Signed-off-by: Haiqing Bai <haiqing.bai@windriver.com>
Change-Id: Ia401b1663a16b374e3fa7e61d3add73e4e39c327
2022-11-09 11:19:05 +08:00
Zhixiong Chi
245c949be7 Debian: aptly_deb_usage: Add the missing brackets for the method call
Fix the following warning output:
2022-11-08 02:44:21,722 - repo_manager - INFO: Aptly connected, version:
<bound method MiscAPISection.version of <aptly_api.parts.misc.
 MiscAPISection object at 0x7f47d6aa9a00>>

After applying this commit, the output will be as follows:
2022-11-08 08:30:10,753 - repo_manager - INFO: Aptly connected, version:
 unknown

Later I can send another commit to replace the repomgr version value.

TestPlan:
Pass: build-pkgs -p ${packagename}
Pass: Get the correct output

Story: 2008862
Task: 46758

Signed-off-by: Zhixiong Chi <zhixiong.chi@windriver.com>
Change-Id: I2d814924d7560ee49cb428af63769c05da149125
2022-11-08 08:46:58 +00:00
Rogerio Ferraz
e3f044fe1c Add tag stx.8.0-v1.0.2 to vRAN docker images
The images starlingx/stx-debian-dev and starlingx/stx-debian-tools-dev
are static-tagged as stx.8.0-v1.0.2 due to added support of the tools:

- Processor Counter Monitor (PCM) tools
- Open Programmable Acceleration Engine (OPAE) tools

Test Plan:
  - Container image is built successfully on Debian (PASS)
  - PCM and OPAE packages are successfully installed (PASS)
  - Run time testing of the PCM and OPAE tools (WIP)

Story: 2010138
Task: 46732

Depends-On: https://review.opendev.org/c/starlingx/utilities/+/855431
            PCM tools on container image stx-debian-tools-dev

Depends-On: https://review.opendev.org/c/starlingx/utilities/+/862742
            OPAE tools in container image stx-debian-tools-dev

Note: This is fix of commit fbe521201a0c9d3ecb757e4dea25481c0d71ce15.
The images starlingx/stx-debian-dev and starlingx/stx-debian-tools-dev
static-tagged as stx.8.0-v1.0.1 were added support of PCM tools only.

Signed-off-by: Rogerio Ferraz <RogerioOliveira.Ferraz@windriver.com>
Change-Id: Ibdb8334d86621785e5265f04db8f30be155a4030
2022-11-07 13:27:52 +00:00
Dostoievski Batista
276a72e4a7 update build-image to clean as default
This commit updates the build-image tool to
clean image build directories as default and
add argument -k/--keep to keep it.

This commit also remove some white spaces
in downloader tool.

Test Plan:
	Pass: run build-image without args
	Pass: build-image -k
	Pass: build-image -c

Story: 2008846
Task: 46727
Signed-off-by: Dostoievski Batista <dostoievski.albinobatista@windriver.com>
Change-Id: I232045e8456c4dcfb44e80df2096746ffc349268
2022-11-07 08:39:10 -03:00
Zuul
449260a6a1 Merge "Add tag stx.8.0-v1.0.1 to vRAN docker images" 2022-11-04 17:02:31 +00:00
Dostoievski Batista
b743b0ddf1 update downloader to use -b -s as default
This commit updates the downloader tool to
download all binaries and sources as default.

Test Plan:
	Pass: run downloader without args
	Pass: downloader -s
	Pass: downloader -b

Story: 2008846
Task: 46726
Signed-off-by: Dostoievski Batista <dostoievski.albinobatista@windriver.com>
Change-Id: Ibdad5d106cbb81b732da4122e487db80ab0e8cd5
2022-11-04 13:34:13 -03:00
Rogerio Ferraz
fbe521201a Add tag stx.8.0-v1.0.1 to vRAN docker images
The images starlingx/stx-debian-dev and starlingx/stx-debian-tools-dev
are static-tagged as stx.8.0-v1.0.1 due to added support of the tools:

- Processor Counter Monitor (PCM) tools
- Open Programmable Acceleration Engine (OPAE) tools

Story: 2010138
Task: 46732

Signed-off-by: Rogerio Ferraz <RogerioOliveira.Ferraz@windriver.com>
Change-Id: I1003d4bbe2bf1769a5aa858a926f792a5bea6e95
2022-11-04 16:18:43 +00:00
Enzo Candotti
deb03ab484 Add static tags to Debian stx-fm-rest-api image
Update yaml file with new tag for stx-fm-rest-api using the
master-debian-stable-20221102T060000Z.0 build.

Story: 2009831
Task: 46635

Signed-off-by: Enzo Candotti <enzo.candotti@windriver.com>
Change-Id: Ie5511c33b8eb50005bc847c33dbebfcb87e42da6
2022-11-02 14:51:37 -03:00
Zuul
16c646d753 Merge "Add the new repo app-security-profiles-operator to stx/.gitignore" 2022-10-27 17:41:42 +00:00
Zuul
30a726a10c Merge "build-pkgs: Updated to handle reuse on reuse scene" 2022-10-27 16:20:24 +00:00
Haiqing Bai
7a404d7d5d build-pkgs: Updated to handle reuse on reuse scene
This commit updates code to handle the below things:
a. For these reused packages, updates the local debsentry cache
   after successfully copying the reused debs from the shared
   repository, this fixed the issue that the second project can not
   get the subpackages from the shared debsentry of the first reused
   project.
b. If the subpackages can't be got or failed to copy reused debs from
   the shared repository, the reused packages will be reclaimed and
   switch to the local build.
c. Opiton '--dl_reused' is provided to download these reused debs to
   the package's local build directory if this is really needed

Test Plan:
1. Creates project A with reuse disabled and shared the build output
   Creates project B with reuse enabled, the shared project is A
   Creates project C with reuse enabled, the shared project is B
   Project C built successfully

2. Create project D with reuse enabled and '--dl_reused' option:
   $build-pkgs -a --parallel 10 --reuse --dl_reused
   All the resued .deb will be downloaded to the local directory:
   ${MY_WORKSPACE}/reused_debs/downloads/binary

Closes-Bug: 1993224

Signed-off-by: Haiqing Bai <haiqing.bai@windriver.com>
Change-Id: I03267aab66f17afdb540f7d407bb4c9d97805886
2022-10-27 10:16:18 +08:00
Zuul
08dee10ba5 Merge "Debian: add w3m and libgc1 to debian-image.inc" 2022-10-26 13:57:08 +00:00
Zuul
f25034af86 Merge "Debian: Include screen in iso" 2022-10-26 13:06:43 +00:00
Rahul Roshan Kachchap
ff9690c9e5 Add the new repo app-security-profiles-operator to stx/.gitignore
Story: 2010310
Task: 46645
Depends-On: https://review.opendev.org/c/starlingx/manifest/+/862568

Signed-off-by: Rahul Roshan Kachchap <rahulroshan.kachchap@windriver.com>
Change-Id: Id937cf0453b8b46c1bbe8dea70bfb5823bb77857
2022-10-26 03:29:38 -04:00
Luis Sampaio
b195572470 Revert "debian: Add linux-perf-5.10 package"
This reverts commit 8fd070b3f2c58663b90360959eb4ff66a6b6b3e8.

As linux-perf-5.10 is built by the kernel it will be
placed on deb-local-build and not deb-local-binary,
the file that we need to add the package is under
tools repo: stx-std.lst

Signed-off-by: Luis Sampaio <luis.sampaio@windriver.com>
Change-Id: Ic5b335c536ee40b60b2d2b4da12f31fc2da48e26
2022-10-25 11:08:36 -07:00
Zuul
2e0e1a1b21 Merge "debian: Add cloud-init to ISO" 2022-10-25 15:39:57 +00:00
Zuul
69750b82db Merge "debian: Add linux-perf-5.10 package" 2022-10-25 14:36:44 +00:00
Zuul
36fa1d623c Merge "debian: Add sysstat package" 2022-10-25 14:35:22 +00:00
Charles Short
8fd070b3f2 debian: Add linux-perf-5.10 package
Add the linux-perf-5.10 to ISO can run the "perf" command.
Useful for debugging performance issues.

Test Plan
PASS Build ISO
PASS Login with sysadmin user
PASS Run the command "perf"

Story: 2009968
Task: 46573

Signed-off-by: Charles Short <charles.short@windriver.com>
Change-Id: If301b15030fff0be66f11cf8bd4c8af4e294e647
2022-10-25 10:02:14 -04:00
Wentao Zhang
9d0d399aad Debian: add w3m and libgc1 to debian-image.inc
"apachectl status" requires www-browser provided
by w3m which depends on libgc1

TEST PLAN:
PASS: the command "apachectl status" returns no errors.

Closes-bug: 1993484

Depends-On:https://review.opendev.org/c/starlingx/tools/+/861336

Signed-off-by: Wentao Zhang<Wentao.Zhang@windriver.com>
Change-Id: I3be5e9643c2f03afa27ba3431a3a16a3a3200117
2022-10-25 08:40:04 +08:00
Davlet Panech
18fcc0646b build-stx-images: handle "docker push" errors
Add error handling and retries to "docker push".

Closes-Bug: 1920929

Signed-off-by: Davlet Panech <davlet.panech@windriver.com>
Change-Id: Ic5c700f5408f30330ed227ac5d67bb18511d9301
2022-10-24 15:58:42 -04:00
Charles Short
069b7fc6b3 debian: Add cloud-init to ISO
Add support for cloud-init to ISO image, this allows the
image to be used on AWS. However, the systemd units will
be disabled by default.

Test Plan

PASS Build ISO image
PASS Boot ISO
PASS Check the output of 'dpkg -l | grep cloud-init'
PASS Run the 'cloud-init --help'

Story: 2009965
Task: 46608

Depends-On: https://review.opendev.org/c/starlingx/tools/+/861887

Signed-off-by: Charles Short <charles.short@windriver.com>
Change-Id: I356a85875d01fe23d228a4ded904963595612526
2022-10-24 13:15:43 -04:00
Charles Short
ca0127ae1b debian: Add sysstat package
Include the sysstat package on Debian ISO, it includes
tools such as iostat, sar, etc. Useful for debugging
performance issues.

Test Plan
PASS Build ISO
PASS Login with sysadmin user
PASS Run the command "iosstat"

Depends-On: https://review.opendev.org/c/starlingx/tools/+/861380

Signed-off-by: Charles Short <charles.short@windriver.com>
Change-Id: I777cfe4dd10f550b89a0a94fbb28e1553847f2ad
2022-10-24 13:08:47 -04:00
Dan Voiculeasa
19da7d9cf1 Debian: Include screen in iso
On CentOS we had 'screen' included in the iso.
Keep the same behavior on Debian.

Include screen and dependency in iso.

Tests on AIO-SX:
PASS: build-image
PASS: unlocked enabled available controller-0
PASS: screen works inside controller node

Depends-On: https://review.opendev.org/c/starlingx/tools/+/861954
Story: 2010211
Task: 46632
Signed-off-by: Dan Voiculeasa <dan.voiculeasa@windriver.com>
Change-Id: I3675165dd7d61af33e4cc6d62a9f3b7715a59d58
2022-10-24 13:08:20 +03:00
Zuul
451528383d Merge "Update fluxcd manifests build python interpreter" 2022-10-21 17:27:50 +00:00
Zuul
3c382dcc0b Merge "Update static image tags for v2.5.0" 2022-10-21 13:13:20 +00:00
Thales Elero Cervi
b2d1f4e745 Update fluxcd manifests build python interpreter
The build_image_versions_to_fluxcd_manifests function is currently using
python2 interpreter and will throw an error on Debian build
environments:
  build-helm-charts.sh: line 220: python2: command not found
  Failed to update manifest file

This change just replicates what was done on this script for other
python calls that need to decide between python3 and python3.

TEST PLAN:
PASS - build-helm-charts.sh for stx-openstack-helm and
       make sure "stx-openstack-helm" tarball is generated.

Story: 2010317
Task: 46610

Signed-off-by: Thales Elero Cervi <thaleselero.cervi@windriver.com>
Change-Id: Iab330c574c34ba548e3652fb0975e3184c462752
2022-10-20 16:29:07 -03:00
Zuul
1d16cf3fcb Merge "Debian: introduce debian-image.inc as the installing list" 2022-10-20 13:18:40 +00:00
Nidhi Shivashankara Belur
5a41be2bb4 Update static image tags for v2.5.0
Update image-tags.yaml file:
- src_build_tag with latest timestamped image.
- src_ref with latest commit ID.

Test Status:
- PASS: system application apply with latest debian image.

Story: 2010341
Task: 46612

Signed-off-by: Nidhi Shivashankara Belur <nidhi.shivashankara.belur@intel.com>
Change-Id: Ic4baec38077a54f869c3ca231453761381f15e1a
2022-10-19 18:00:04 -07:00
Zuul
679a2b3a47 Merge "Debian: repo_manage.py: optimize download and sync" 2022-10-19 19:30:11 +00:00
Zuul
d57de7db1f Merge "patch-iso script for Debian" 2022-10-19 19:07:11 +00:00
Yue Tao
98ee23180c Debian: introduce debian-image.inc as the installing list
"base-bullseye.lst" is both the download list and installing list. It
can't be implemented if someone wants to download a binary but not
install it to image. According to:

https://docs.starlingx.io/developer_resources/Layered_Build.html#controlling-the-package-content-of-the-iso

In CentOS version, we use the "image.inc" file as the installing list.
Other .lst files are the download lists. Also introducing such file
"debian-image.inc" in Debian.

The purpose of this commit is to separate the 2 lists ASAP, so that we
can add build dependencies into "base-bullseye.lst" right now, that is
requested to fix CVEs. So this commit just copies the
"base-bullseye.lst" to "debian-image.inc", and removes the versions.

A subsequence commit will remove the dependencies from
"debian-image.inc".

Test Plan:

Pass: build-image
Pass: comparing the installing packages after and before
      (No difference of "dpkg-query -l")

Story: 2008846
Task: 46274

Signed-off-by: Yue Tao <yue.tao@windriver.com>
Change-Id: Ic7af95cbefc80dff65b255028c78dc0cd078ac08
2022-10-19 13:42:24 +08:00
Davlet Panech
fc8db4848a Add missinig repos to .gitignore
- /app-kubevirt/
- /app-sts-silicom/

Change-Id: I2d23d04dc3d3c68d55a48c69b5d3977252ac84b2
Signed-off-by: Davlet Panech <davlet.panech@windriver.com>
2022-10-17 14:04:19 -04:00
Zuul
18a7d19c09 Merge "build-pkgs: Prevent copying debs again after reuse" 2022-10-12 19:51:02 +00:00
Zuul
4298ee2ae7 Merge "Update image tags for ptp-notification images" 2022-10-12 14:00:15 +00:00
Haiqing Bai
8791e3c66e build-pkgs: Prevent copying debs again after reuse
If run 'build-pkgs -p <package>' after 'build-pkgs -p <package>
--reuse', the reused package will be copied from the shared
repository again. This commit prevents importing the package
again.

Test Plan:
Pass: export STX_SHARED_REPO="<url of remote shared repository>"
      export STX_SHARED_SOURCE="<url of shared source repository>"
      $build-pkgs -p <package> --reuse
      $build-pkgs -p <package>
      The second build should not trigger to copy the deb packages
      from the shared repository

Story: 2008846
Task: 46481

Signed-off-by: Haiqing Bai <haiqing.bai@windriver.com>
Change-Id: I4f0b9ab941c7f8433c2425ade9f93757620c16be
2022-10-12 11:06:36 +08:00
Cole Walker
23d1ff939b Update image tags for ptp-notification images
This commit updates the image tags for:

notificationservice-base
stx.8.0-v2.0.0

notificationclient-base
stx.8.0-v2.0.0

Performing a major version uprev due to significant API changes.
This also includes using a new src_build_tag for both images to capture
the correct src_ref.

Story: 2010056
Task: 46525

Signed-off-by: Cole Walker <cole.walker@windriver.com>
Change-Id: Ie87eb3dec6d8ae575dc17b33023f2a34fdbea499
2022-10-11 14:14:30 -04:00
Zuul
a834b6be11 Merge "build-pkgs: Only search with stx path for reuse feature" 2022-10-11 17:08:26 +00:00
Gleb Aronsky
abadc16dd6 Add image tag for KubeVirt
Add a new image for KubeVirt.  The image is an init container
responsible for installing the corresponding version of virtctl.

Test Plan: None

Story: 2010096
Task: 46472

Signed-off-by: Gleb Aronsky <gleb.aronsky@windriver.com>
Change-Id: I1d6fcfa2008b8c3f15bb69408b59236b91b94e8e
2022-10-11 08:15:29 -07:00
hbai
4bb8743280 build-pkgs: Only search with stx path for reuse feature
If reuse is enabled, it's wrong to search the complete
source package directory in remote dscs cache, this
commit changes to only search the source package's
relative path in STX repositor, e.g.
"/localdisk/designer/$USER/$PROJECT/cgcs-root/stx/config/tsconfig"
changes to:
"/stx/config/tsconfig"

Test Plan:
Pass: Create two projects: PROJECT='shared', PROJECT='reuse'
      Project 'shared' has been built and shared to
      project 'reuse'
      In project 'reuse':
      build-pkgs -p <package name> --reuse

Story: 2008846
Task: 46479

Signed-off-by: hbai <haiqing.bai@windriver.com>
Change-Id: Iab38b5a24dbc3517db89386ff3e07c1052e4b1bb
2022-10-11 17:53:55 +08:00
Zuul
15de1d5c02 Merge "correct stx-oidc-client image tag" 2022-10-07 19:48:20 +00:00
Zuul
6f242ad44b Merge "Update image tags for ptp-notification images" 2022-10-07 19:46:36 +00:00
Cole Walker
973bbfa0d9 Update image tags for ptp-notification images
This commit updates the image tags for:

notificationservice-base
stx.8.0-v1.0.6

notificationclient-base
stx.8.0-v1.0.5

Story: 2010056
Task: 46525

Signed-off-by: Cole Walker <cole.walker@windriver.com>
Change-Id: I7b9cbc2006dc27c3fbc665ddda46926c67e08749
2022-10-07 11:26:29 -04:00