810 Commits

Author SHA1 Message Date
Eric MacDonald
fc45f66857 Update build image to look for update-iso-centos.sh script
The update-iso.sh script for centos was renamed
to update-iso-centos.sh

This update modifies the name in the centos build-img
script to look for this new modified name.

Test Plan:

PASS: Verify centos build-img and install

Depends-On: https://review.opendev.org/c/starlingx/utilities/+/866398

Story: 2009968
Task: 46977
Signed-off-by: Eric MacDonald <eric.macdonald@windriver.com>
Change-Id: I829ad22b6b5f8a3cb00eb7445757ad215c5d424e
2022-12-07 21:04:22 +00:00
Zuul
98cc0037e3 Merge "Debian: drop some unnecessary binary packages" 2022-11-23 17:24:57 +00:00
Zhixiong Chi
4851b57074 Debian: drop some unnecessary binary packages
With kpatch target build disabled, some binary packages are not
necessary anymore, so we remove these packages from debian-image.inc
to make sure they are not installed into the iso image.

TestPlan:
Pass: build-pkgs -c -a
Pass: build-image
Pass: Jenkins installation

Closes-Bug: 1997340

Depends-On: https://review.opendev.org/c/starlingx/tools/+/865244

Signed-off-by: Zhixiong Chi <zhixiong.chi@windriver.com>
Change-Id: Ic4f6778779b5dff0924880478bb24d5bb4cdac7f
2022-11-23 01:58:46 -05:00
Hugo Brito
0254d28451 Add static tags to Debian stx-keystone-api-proxy
Update yaml file with new tag for stx-keystone-api-proxy
using the master-debian-stable-20221122T070000Z.0 build.

Story: 2009831
Task: 46921

Signed-off-by: Hugo Brito <hugo.brito@windriver.com>
Change-Id: I28ffbc854ef63fb57299d2ac8a8bccc4e467a700
2022-11-22 22:21:55 -03:00
Scott Little
422f89cec1 Add access-token option to branching tools
Github now requires the use of an access token for the
automated push of branches and tags.  The alternative
is a password prompt for each git in the middle of the
tool run.

Closes-bug: 1997483
Signed-off-by: Scott Little <scott.little@windriver.com>
Change-Id: Ife396dfed48a941df4c1e82eef7860017a4ff213
2022-11-22 16:15:21 -05:00
Zuul
a221b7a99a Merge "Add openscap security policies to iso" 2022-11-21 20:39:04 +00:00
Zuul
ebd6aa43af Merge "build-pkgs: Create local repositories with safe way" 2022-11-21 20:37:44 +00:00
Cole Walker
4f445c1515 Update image tags for ptp-notification images
This commit updates the ptp-notification images to use the Debian base
container images instead of Centos.

notificationservice-base
stx8.0-v2.0.1

locationservice-base
stx8.0-v2.0.0

notificationclient-base
stx8.0-v2.0.1

Story: 2010056
Task: 46891

Signed-off-by: Cole Walker <cole.walker@windriver.com>
Change-Id: Ie7df496c7bb650fd8c3c8aeb41a49d3381f20c11
2022-11-21 10:50:10 -05:00
Zuul
609d798767 Merge "Add firmware packages for debian-starlingx" 2022-11-21 01:55:18 +00:00
Zuul
a5f060adec Merge "Debian: Add libvirt runtime dependencies" 2022-11-18 20:05:05 +00:00
Rei Oliveira
579914c5f9 Add openscap security policies to iso
Openscap policy files for debian are missing in the iso.
This commit is adding packages that add the openscap policy files
to /usr/share/xml/scap/ssg/content

Test Plan:
PASS: Run a full build of the iso with build-pkgs -a and build-image.
      Once installed, verify that the new image contain the policy files
      as expected.

Closes-Bug: 1997111
Depends-On: https://review.opendev.org/c/starlingx/tools/+/864929
Signed-off-by: Rei Oliveira <Reinildes.JoseMateusOliveira@windriver.com>
Change-Id: I425a957b8764f1c879c90019fa70ca45171385ed
2022-11-18 17:05:04 -03:00
Zuul
d6290e5617 Merge "Debian: Add qemu runtime dependencies" 2022-11-18 19:59:28 +00:00
Thales Elero Cervi
49bad5a88c Debian: Add libvirt runtime dependencies
Adding to Debian ISO the required  libraries that are runtime
dependencies of libvirt packages.

Test Plan:
PASS: Run "downloader -b -s" successfully
PASS: Run "build-pkgs -c --all" successfully
PASS: Run "build-image" successfully
PASS: Debian ISO bootstrap successfully

Story: 2010317
Task: 46391

Depends-On: https://review.opendev.org/c/starlingx/tools/+/865020/

Signed-off-by: Thales Elero Cervi <thaleselero.cervi@windriver.com>
Change-Id: Ib4b714b6f1e9aa087fb5dc49b49f5eaf0e8d40c6
2022-11-18 10:59:59 -03:00
Rafael Falcao
a50fe86a40 Debian: Add qemu runtime dependencies
This review adds some runtime dependencies that are
required for correct operation of qemu.

Test Plan:
PASS: Run "downloader -b -s" successfully
PASS: Run "build-pkgs -c --all" successfully
PASS: Run "build-image" successfully
PASS: Debian ISO bootstrap successfully

Story: 2010317
Task: 46390

Depends-On: https://review.opendev.org/c/starlingx/tools/+/864904

Signed-off-by: Rafael Falcao <rafael.vieirafalcao@windriver.com>
Co-Authored-by: Thales Elero Cervi <thaleselero.cervi@windriver.com>
Change-Id: I45a204f11834e8e0f7bcd3c8b9ed5ceae042165f
2022-11-18 10:59:40 -03:00
Zuul
8faf58540f Merge "Update stx-platformclients image to version stx.8.0-v1.5.9" 2022-11-17 17:56:43 +00:00
Haiqing Bai
458bf27643 build-pkgs: Create local repositories with safe way
The interface 'upload_pkg(name, None)' of repo manager is used
to create needed local repositories, This commit updates the way
'upload_pkg' is called, wrapping it in a 'try/except' code block.
If an exception occurs, the creation attempt will be retried up
to REPOMGR_MAX_RETRY times, with an interval of REPOMGR_RETRY_INTERVAL
seconds between attempts.

Test Plan:
Pass: build-pkgs -c -p <package>
Pass: build-pkgs -c -a

Story: 2008846
Task: 46743

Signed-off-by: Haiqing Bai <haiqing.bai@windriver.com>
Change-Id: I4c7d0032df7b1a4bdb4fe0b038ec27443114a7fe
2022-11-17 21:49:19 +08:00
Jiping Ma
8a2eea9cd4 Add firmware packages for debian-starlingx
We add 22 firmware related packages for Debian-based StarlingX
after comparing the list of firmware (from /lib/firmware) that
is included in Debian-based StarlingX and that is included in
CentOS-based StarlingX.

firmware-amd-graphics
firmware-ath9k-htc
firmware-atheros
firmware-bnx2
firmware-bnx2x
firmware-brcm80211
firmware-cavium
firmware-intel-sound
firmware-iwlwifi
firmware-libertas
firmware-linux-free
firmware-linux-nonfree
firmware-linux
firmware-misc-nonfree
firmware-myricom
firmware-netronome
firmware-netxen
firmware-qcom-soc
firmware-realtek
firmware-samsung
firmware-siano

Test Plan
PASS: Built an ISO and verified the presence of the package
PASS: Verify the file was added to the ISO

Closes-Bug: 1996553

Depends-On: https://review.opendev.org/c/starlingx/tools/+/864458

Signed-off-by: Jiping Ma <jiping.ma2@windriver.com>
Change-Id: I97fde31bb47bbe1d9ca359e0d344d4046c943190
2022-11-17 00:33:22 -05:00
Rahul Kachchap
ea936f7779 Included apparmor_utils package in Debian
dependent packages included:
 - python3-apparmor
 - python3-libapparmor

Tests on AIO-SX:
PASS: downloader -b -s && build-image successfully
PASS: installed image successfully
PASS: unlocked enabled available controller-0
PASS: apparmor_utils installed & works inside controller node

Depends-On: https://review.opendev.org/c/starlingx/tools/+/864677

Story: 2010310
Task: 46827

Signed-off-by: Rahul Kachchap <rahulroshan.kachchap@windriver.com>
Change-Id: If826cff67bd33a975c844e145d236bb6c9616ece
2022-11-16 02:41:28 -05:00
Zuul
3cbb93c5bc Merge "debrepack: customize the revision" 2022-11-14 22:26:51 +00:00
Luiz Felipe Kina
4dec881ec4 Update stx-platformclients image to version stx.8.0-v1.5.9
Updated image with the new fixes since the last build

Partial-bug: 1995020

Signed-off-by: Luiz Felipe Kina <LuizFelipe.EiskeKina@windriver.com>
Change-Id: If884ae9075a4b02033fa49f0fea45ef8d0a1bea8
2022-11-13 14:33:24 -05:00
Li Zhu
b06996108d Update tag for rvmc to stx.8.0-v1.0.1
Story: 2010144
Task: 46784

Signed-off-by: Li Zhu <li.zhu@windriver.com>
Change-Id: I28a52752b79185bee959a13c6627c13a323231fd
2022-11-10 16:14:36 -05:00
Zuul
a06291a7d6 Merge "downloader: call the interfaces of repo manager in safe way" 2022-11-10 15:52:19 +00:00
Zuul
98783396d6 Merge "update build-pkgs to build all as default" 2022-11-10 01:44:21 +00:00
Yue Tao
4a64688ccb debrepack: customize the revision
In some cases (specially for test patches), we want to force the package
version to be increased, so introduce a new variable "stx_patch" in
"revision", like:

revision:
  dist: $STX_DIST
  PKG_GITREVCOUNT: true
  stx_patch: 1

Test Plan:

Pass: revision is increased by adding "stx_patch: number" in
meta_data.yaml.

Story: 2008862
Task: 46766

Signed-off-by: Luis Sampaio <luis.sampaio@windriver.com>
Signed-off-by: Yue Tao <yue.tao@windriver.com>
Change-Id: I107d3bb5b88cc69c701fa08d22d774728dcf3d06
2022-11-10 08:39:33 +08:00
Zuul
3fdc0c8e54 Merge "Add tag stx.8.0-v1.0.2 to vRAN docker images" 2022-11-09 15:38:05 +00:00
Dostoievski Batista
ac3f6bf773 update build-pkgs to build all as default
This commit updates the build-pkgs tool to
build all packages as default without need
of any args.

This commit also update the license year in
downloader tool.

Test Plan:
	Pass: run build-pkgs without args
	Pass: build-pkgs -a
	Pass: build-pkgs -p -c logmgmt
	Pass: build-pkgs -p logmgmt

Story: 2008846
Task: 46765
Signed-off-by: Dostoievski Batista <dostoievski.albinobatista@windriver.com>
Change-Id: Ic270bbec2e7a8218daf0bb9d00101bbd1526344b
2022-11-09 08:51:50 -03:00
Haiqing Bai
e7550db59c downloader: call the interfaces of repo manager in safe way
The interfaces of repo manager should be called in the block
of 'try...except' to catch some exceptions.

Test Plan:
Pass: downloader -b
Pass: downloader -s

Story: 2008846
Task: 46744

Signed-off-by: Haiqing Bai <haiqing.bai@windriver.com>
Change-Id: Ia401b1663a16b374e3fa7e61d3add73e4e39c327
2022-11-09 11:19:05 +08:00
Zhixiong Chi
245c949be7 Debian: aptly_deb_usage: Add the missing brackets for the method call
Fix the following warning output:
2022-11-08 02:44:21,722 - repo_manager - INFO: Aptly connected, version:
<bound method MiscAPISection.version of <aptly_api.parts.misc.
 MiscAPISection object at 0x7f47d6aa9a00>>

After applying this commit, the output will be as follows:
2022-11-08 08:30:10,753 - repo_manager - INFO: Aptly connected, version:
 unknown

Later I can send another commit to replace the repomgr version value.

TestPlan:
Pass: build-pkgs -p ${packagename}
Pass: Get the correct output

Story: 2008862
Task: 46758

Signed-off-by: Zhixiong Chi <zhixiong.chi@windriver.com>
Change-Id: I2d814924d7560ee49cb428af63769c05da149125
2022-11-08 08:46:58 +00:00
Rogerio Ferraz
e3f044fe1c Add tag stx.8.0-v1.0.2 to vRAN docker images
The images starlingx/stx-debian-dev and starlingx/stx-debian-tools-dev
are static-tagged as stx.8.0-v1.0.2 due to added support of the tools:

- Processor Counter Monitor (PCM) tools
- Open Programmable Acceleration Engine (OPAE) tools

Test Plan:
  - Container image is built successfully on Debian (PASS)
  - PCM and OPAE packages are successfully installed (PASS)
  - Run time testing of the PCM and OPAE tools (WIP)

Story: 2010138
Task: 46732

Depends-On: https://review.opendev.org/c/starlingx/utilities/+/855431
            PCM tools on container image stx-debian-tools-dev

Depends-On: https://review.opendev.org/c/starlingx/utilities/+/862742
            OPAE tools in container image stx-debian-tools-dev

Note: This is fix of commit fbe521201a0c9d3ecb757e4dea25481c0d71ce15.
The images starlingx/stx-debian-dev and starlingx/stx-debian-tools-dev
static-tagged as stx.8.0-v1.0.1 were added support of PCM tools only.

Signed-off-by: Rogerio Ferraz <RogerioOliveira.Ferraz@windriver.com>
Change-Id: Ibdb8334d86621785e5265f04db8f30be155a4030
2022-11-07 13:27:52 +00:00
Dostoievski Batista
276a72e4a7 update build-image to clean as default
This commit updates the build-image tool to
clean image build directories as default and
add argument -k/--keep to keep it.

This commit also remove some white spaces
in downloader tool.

Test Plan:
	Pass: run build-image without args
	Pass: build-image -k
	Pass: build-image -c

Story: 2008846
Task: 46727
Signed-off-by: Dostoievski Batista <dostoievski.albinobatista@windriver.com>
Change-Id: I232045e8456c4dcfb44e80df2096746ffc349268
2022-11-07 08:39:10 -03:00
Zuul
449260a6a1 Merge "Add tag stx.8.0-v1.0.1 to vRAN docker images" 2022-11-04 17:02:31 +00:00
Dostoievski Batista
b743b0ddf1 update downloader to use -b -s as default
This commit updates the downloader tool to
download all binaries and sources as default.

Test Plan:
	Pass: run downloader without args
	Pass: downloader -s
	Pass: downloader -b

Story: 2008846
Task: 46726
Signed-off-by: Dostoievski Batista <dostoievski.albinobatista@windriver.com>
Change-Id: Ibdad5d106cbb81b732da4122e487db80ab0e8cd5
2022-11-04 13:34:13 -03:00
Rogerio Ferraz
fbe521201a Add tag stx.8.0-v1.0.1 to vRAN docker images
The images starlingx/stx-debian-dev and starlingx/stx-debian-tools-dev
are static-tagged as stx.8.0-v1.0.1 due to added support of the tools:

- Processor Counter Monitor (PCM) tools
- Open Programmable Acceleration Engine (OPAE) tools

Story: 2010138
Task: 46732

Signed-off-by: Rogerio Ferraz <RogerioOliveira.Ferraz@windriver.com>
Change-Id: I1003d4bbe2bf1769a5aa858a926f792a5bea6e95
2022-11-04 16:18:43 +00:00
Enzo Candotti
deb03ab484 Add static tags to Debian stx-fm-rest-api image
Update yaml file with new tag for stx-fm-rest-api using the
master-debian-stable-20221102T060000Z.0 build.

Story: 2009831
Task: 46635

Signed-off-by: Enzo Candotti <enzo.candotti@windriver.com>
Change-Id: Ie5511c33b8eb50005bc847c33dbebfcb87e42da6
2022-11-02 14:51:37 -03:00
Zuul
30a726a10c Merge "build-pkgs: Updated to handle reuse on reuse scene" 2022-10-27 16:20:24 +00:00
Haiqing Bai
7a404d7d5d build-pkgs: Updated to handle reuse on reuse scene
This commit updates code to handle the below things:
a. For these reused packages, updates the local debsentry cache
   after successfully copying the reused debs from the shared
   repository, this fixed the issue that the second project can not
   get the subpackages from the shared debsentry of the first reused
   project.
b. If the subpackages can't be got or failed to copy reused debs from
   the shared repository, the reused packages will be reclaimed and
   switch to the local build.
c. Opiton '--dl_reused' is provided to download these reused debs to
   the package's local build directory if this is really needed

Test Plan:
1. Creates project A with reuse disabled and shared the build output
   Creates project B with reuse enabled, the shared project is A
   Creates project C with reuse enabled, the shared project is B
   Project C built successfully

2. Create project D with reuse enabled and '--dl_reused' option:
   $build-pkgs -a --parallel 10 --reuse --dl_reused
   All the resued .deb will be downloaded to the local directory:
   ${MY_WORKSPACE}/reused_debs/downloads/binary

Closes-Bug: 1993224

Signed-off-by: Haiqing Bai <haiqing.bai@windriver.com>
Change-Id: I03267aab66f17afdb540f7d407bb4c9d97805886
2022-10-27 10:16:18 +08:00
Zuul
08dee10ba5 Merge "Debian: add w3m and libgc1 to debian-image.inc" 2022-10-26 13:57:08 +00:00
Zuul
f25034af86 Merge "Debian: Include screen in iso" 2022-10-26 13:06:43 +00:00
Luis Sampaio
b195572470 Revert "debian: Add linux-perf-5.10 package"
This reverts commit 8fd070b3f2c58663b90360959eb4ff66a6b6b3e8.

As linux-perf-5.10 is built by the kernel it will be
placed on deb-local-build and not deb-local-binary,
the file that we need to add the package is under
tools repo: stx-std.lst

Signed-off-by: Luis Sampaio <luis.sampaio@windriver.com>
Change-Id: Ic5b335c536ee40b60b2d2b4da12f31fc2da48e26
2022-10-25 11:08:36 -07:00
Zuul
2e0e1a1b21 Merge "debian: Add cloud-init to ISO" 2022-10-25 15:39:57 +00:00
Zuul
69750b82db Merge "debian: Add linux-perf-5.10 package" 2022-10-25 14:36:44 +00:00
Zuul
36fa1d623c Merge "debian: Add sysstat package" 2022-10-25 14:35:22 +00:00
Charles Short
8fd070b3f2 debian: Add linux-perf-5.10 package
Add the linux-perf-5.10 to ISO can run the "perf" command.
Useful for debugging performance issues.

Test Plan
PASS Build ISO
PASS Login with sysadmin user
PASS Run the command "perf"

Story: 2009968
Task: 46573

Signed-off-by: Charles Short <charles.short@windriver.com>
Change-Id: If301b15030fff0be66f11cf8bd4c8af4e294e647
2022-10-25 10:02:14 -04:00
Wentao Zhang
9d0d399aad Debian: add w3m and libgc1 to debian-image.inc
"apachectl status" requires www-browser provided
by w3m which depends on libgc1

TEST PLAN:
PASS: the command "apachectl status" returns no errors.

Closes-bug: 1993484

Depends-On:https://review.opendev.org/c/starlingx/tools/+/861336

Signed-off-by: Wentao Zhang<Wentao.Zhang@windriver.com>
Change-Id: I3be5e9643c2f03afa27ba3431a3a16a3a3200117
2022-10-25 08:40:04 +08:00
Davlet Panech
18fcc0646b build-stx-images: handle "docker push" errors
Add error handling and retries to "docker push".

Closes-Bug: 1920929

Signed-off-by: Davlet Panech <davlet.panech@windriver.com>
Change-Id: Ic5c700f5408f30330ed227ac5d67bb18511d9301
2022-10-24 15:58:42 -04:00
Charles Short
069b7fc6b3 debian: Add cloud-init to ISO
Add support for cloud-init to ISO image, this allows the
image to be used on AWS. However, the systemd units will
be disabled by default.

Test Plan

PASS Build ISO image
PASS Boot ISO
PASS Check the output of 'dpkg -l | grep cloud-init'
PASS Run the 'cloud-init --help'

Story: 2009965
Task: 46608

Depends-On: https://review.opendev.org/c/starlingx/tools/+/861887

Signed-off-by: Charles Short <charles.short@windriver.com>
Change-Id: I356a85875d01fe23d228a4ded904963595612526
2022-10-24 13:15:43 -04:00
Charles Short
ca0127ae1b debian: Add sysstat package
Include the sysstat package on Debian ISO, it includes
tools such as iostat, sar, etc. Useful for debugging
performance issues.

Test Plan
PASS Build ISO
PASS Login with sysadmin user
PASS Run the command "iosstat"

Depends-On: https://review.opendev.org/c/starlingx/tools/+/861380

Signed-off-by: Charles Short <charles.short@windriver.com>
Change-Id: I777cfe4dd10f550b89a0a94fbb28e1553847f2ad
2022-10-24 13:08:47 -04:00
Dan Voiculeasa
19da7d9cf1 Debian: Include screen in iso
On CentOS we had 'screen' included in the iso.
Keep the same behavior on Debian.

Include screen and dependency in iso.

Tests on AIO-SX:
PASS: build-image
PASS: unlocked enabled available controller-0
PASS: screen works inside controller node

Depends-On: https://review.opendev.org/c/starlingx/tools/+/861954
Story: 2010211
Task: 46632
Signed-off-by: Dan Voiculeasa <dan.voiculeasa@windriver.com>
Change-Id: I3675165dd7d61af33e4cc6d62a9f3b7715a59d58
2022-10-24 13:08:20 +03:00
Zuul
451528383d Merge "Update fluxcd manifests build python interpreter" 2022-10-21 17:27:50 +00:00
Zuul
3c382dcc0b Merge "Update static image tags for v2.5.0" 2022-10-21 13:13:20 +00:00