Commit Graph

1226 Commits

Author SHA1 Message Date
Dan Voiculeasa
f15d12a123 Add debian package for puppet-rabbitmq-8.5.0
Aligned with Debian Bullseye version puppet-rabbitmq-8.5.0-6.

Did build puppet-rabbitmq-8.5.0 + starlingx patches(adapted from
CentOS7).
Did build an iso.

Story: 2009101
Task: 43300
Signed-off-by: Dan Voiculeasa <dan.voiculeasa@windriver.com>
Change-Id: I4f859b16e719e0a48c45e99906893362833bddaa
2021-09-23 18:17:53 +03:00
Zuul
5997bdc453 Merge "Clear pods in OutOfhugepages* state" 2021-09-15 14:12:05 +00:00
Daniel Safta
3b397cd14b Clear pods in OutOfhugepages* state
Following an upgrade, some pods using
hugepages will still be in Running
state, but will have a replica that stays in
OutOfhugepages state.

k8s-pod-recovery can detect those pods and
delete them.

Closes-bug: 1943113
Signed-off-by: Daniel Safta <daniel.safta@windriver.com>
Change-Id: Idba510cabd66cd8b796563e3e6efa9baa5b4401e
2021-09-14 17:55:56 +00:00
Zuul
bf0481fb48 Merge "Add pylint py3 portability checks for the integ repo" 2021-09-14 00:51:08 +00:00
Zuul
c4898b0bd9 Merge "Uprev linuxptp to version 3.1.1-1" 2021-09-13 18:16:41 +00:00
Bernardo Decco
3264055bfe Add pylint py3 portability checks for the integ repo
A lot of work has gone into making sure that StarlingX is python3
compatible. To ensure future compatibility, enable the python3
portability checks. Disable the checks that are raising errors.
Another set of commits will address the offending code.

Story: 2006796
Task: 43273
Signed-off-by: Bernardo Decco <bernardo.deccodesiqueira@windriver.com>
Change-Id: Ic4b51f71f1680b78b70e05785aca15150e7e5b2a
2021-09-13 09:57:53 +00:00
Zuul
3e9fe9cbb1 Merge "Add .yamllint file" 2021-09-09 18:54:01 +00:00
Dan Voiculeasa
30b0924f28 Add .yamllint file
Debian packaging contains a control file called meta_data.yaml.
In that file the download path of the source packages is needed and
is usually long.

Change long line errors to warnings for yaml linter.
Define long line starting from 160 characters for yaml linter.

Story: 2009101
Task: 43223
Signed-off-by: Dan Voiculeasa <dan.voiculeasa@windriver.com>
Change-Id: I05999d2ce9bd52e317f951ec76688538ef5d7c9b
2021-09-09 19:05:36 +03:00
Jim Somerville
8445cd91a1 Uprev linuxptp to version 3.1.1-1
We use the CentOS 8 version of the source package
and apply the same six patches that we applied to
the previous version, with one caveat.  Patch 3
had an additional test in it of the uncalibrated
state, and this test does not exist in the upstream
version of the patch.  Now patch 3 is identical
to the upstream version.

All five upstream patches have been refreshed to
what was actually accepted upstream and thus now
contain proper git headers.  The logic of those
five patches remain as they were, with the one
exception noted in the previous paragraph.

Patch 6 has also now been given a proper git header.

Change-Id: Ifd44680d2f190dc0c5662bd05bd214fccf50a2fd
Story: 2009130
Task: 43199
Signed-off-by: Jim Somerville <Jim.Somerville@windriver.com>
2021-09-03 17:24:27 -04:00
Zuul
0b01978dcf Merge "Add staged versions of kubernetes 1.18.1 and 1.19.13" 2021-09-02 19:50:45 +00:00
Zuul
2bbf68961d Merge "tftp: roll over block counter to prevent timeouts with data packets" 2021-09-02 14:37:44 +00:00
Jiping Ma
572cd24c49 tftp: roll over block counter to prevent timeouts with data packets
The block number is a 16-bit counter which only allows to fetch
files no bigger than 65535 * blksize. To avoid this limit, the
counter is rolled over. This behavior isn't defined in RFC 1350
but is handled by many TFTP servers and it's what GRUB was doing
before implicitly due an overflow.

Closes-Bug: #1938559

Signed-off-by: Jiping Ma <jiping.ma2@windriver.com>
Change-Id: I4a0c04cf15b87f6f40c7a979d20fb3c57657cefd
2021-09-01 20:57:18 -04:00
Jim Gauld
229ecb0d99 Add staged versions of kubernetes 1.18.1 and 1.19.13
Multiple versions of kubernetes are required to support upgrade.

This adds staged versions of kubernetes 1.18.1 and 1.19.13, each are
built with a specific version of golang.

All subpackage versions are included in the iso image without collisions.

The following patches are included upstream in kubernetes 1.19 and are no
longer required:
Patch1: 0001-Fix-pagesize-check-to-allow-for-options-already-endi.patch
Patch3: fix_http2_erringroundtripper_handling.patch
Patch8: Fix-exclusive-CPU-allocations-being-deleted-at-conta.patch

The following patches are ported to specific kubernetes version:
kubelet-cpumanager-disable-CFS-quota-throttling-for-.patch
kubelet-cpumanager-keep-normal-containers-off-reserv.patch
kubelet-cpumanager-infrastructure-pods-use-system-re.patch
kubelet-cpumanager-introduce-concept-of-isolated-CPU.patch
kubeadm-create-platform-pods-with-zero-CPU-resources.patch
enable-support-for-kubernetes-to-ignore-isolcpus.patch

Depends-On: https://review.opendev.org/c/starlingx/ansible-playbooks/+/806912
Story: 2008972
Task: 43055

Signed-off-by: Jim Gauld <james.gauld@windriver.com>
Change-Id: I90871451c361e4d855098adbf0c9f4f0fddcc461
2021-09-01 16:51:45 -04:00
Kyle MacLeod
e2ab5cc2c8 Patch watch.py in python-kubernetes package
Patch the python2-kubernetes-8.0.0-8.el7.noarch.rpm with recent
bug fix commits required for proper kubernetes watch functionality.

Patches watch.py up to commit 10ae476 in the 'base' repo
(kubernetes-client/python-base).

Commits are taken from the cloned github repo, saved in patch format,
and applied as a patch to the source RPM.

Reference:
https://github.com/kubernetes-client/python-base/commits/master/watch/watch.py

This patch includes commits beginning with d56fdbc, up to and including 10ae476

Testing:
- Built and testing on local distributed cloud system
- Similar testing to this patch but  ased on locally modified package
  has been done on 1000 subcloud system
- Examine/compare contents of installed package vs. expected
- Generating events which trigger the watch conditions
- Monitor watches for proper behaviour on expiry

Story: 2008960
Task: 43053

Signed-off-by: Kyle MacLeod <kyle.macleod@windriver.com>
Change-Id: I7ad78957b6ef61e7204c45f482f201d5c281385b
2021-08-25 17:05:03 -04:00
Zuul
7a14a9a2e0 Merge "Disable isolcpu-device-plugin debug package" 2021-08-19 14:08:24 +00:00
Zuul
6c5ab51017 Merge "remove /data which is not being used" 2021-08-19 02:28:02 +00:00
Charles Short
d0e6ef6a14 Disable isolcpu-device-plugin debug package
Disable the building of a debug package for isolcpus-device-plugin. It
causes grief with regards to centos8. As seen below:

RPM build errors:
error: Empty %files file /builddir/build/BUILD/isolcpus-device-plugin-1.0/debugsourcefiles.list
    line 23: second Summary
    Empty %files file /builddir/build/BUILD/isolcpus-device-plugin-1.0/debugsourcefiles.list
Child return code was: 1

Story: 2006796
Task: 42945

Signed-off-by: Charles Short <charles.short@windriver.com>
Change-Id: Ia239704de1b08909f2ef84d4aadd1fe240bf1e75
2021-08-18 21:41:33 -04:00
Douglas Henrique Koerich
2dcc4bd8a3 Customize fpga_5gnr config for 1 VF
Instead of using the distribution of UL/DL queues between 2 VFs like in
the original fpga_5gnr/fpga_5gnr_config_vf.cfg file, all of them are
set for usage by the first VF, only.

Task: 43044
Story: 2009036
Signed-off-by: Douglas Henrique Koerich <douglashenrique.koerich@windriver.com>
Change-Id: Ie7524eea807e7a49a304475e3451f717954c3ea5
2021-08-18 12:27:14 -04:00
Zuul
0a6dd52d96 Merge "uprev the containernetwork-plugins" 2021-08-17 20:15:05 +00:00
Zuul
829a3ad6ed Merge "Modify go package to be compatible with golang 1.16.6" 2021-08-17 19:09:30 +00:00
Zuul
bc4c422094 Merge "Split kubernetes into versioned stages and unversioned package" 2021-08-17 16:04:35 +00:00
Jim Gauld
8e7ce96e0e Split kubernetes into versioned stages and unversioned package
This packages kubernetes in versioned subdirectories to be able to
support upgrading multiple versions of kubernetes without collisions.
Common configuration/environment files are moved to the new
kubernetes-unversioned package.

This creates directories:
/usr/local/kubernetes/<version>/stage1
/usr/local/kubernetes/<version>/stage2

The binaries and configuration or kubernetes-node, kubernetes-kubeadm,
and kube-client are placed in new locations, e.g.,
/usr/local/kubernetes/1.18/stage1/usr/bin/kubeadm
/usr/local/kubernetes/1.18/stage2/usr/bin/{kubelet,kubectl}

A new package kubernetes-unversioned contains directories:
/usr/local/kubernetes/current/stage1
/usr/local/kubernetes/current/stage2

This package contains symlinks of all the expected binaries and
configuration needed to run kubernetes. For example, /usr/bin/kubelet
is a symlink to /usr/local/kubernetes/current/stage2/user/bin/kubelet.

At ansible install time and during subsequent boots, there is code in
place to bind-mount /usr/local/kubernetes/<version>/stageX onto
/usr/local/kubernetes/current/stageX .

This removes redundant doc and man pages from the production rpms.

Story: 2008972
Task: 43002
Depends-On: https://review.opendev.org/c/starlingx/ansible-playbooks/+/802898
Signed-off-by: Jim Gauld <james.gauld@windriver.com>
Change-Id: I74dc867faea6759906a687cef0b0ebf9555829ee
2021-08-17 11:19:21 -04:00
Charles Short
277d10417b Fix py3 issues
- Update popen to use universal_newlines=True to enable newlines
  for calls that we parse or consume output for. Without universal_newlines=True,
  the output is treated as bytes under python3
  which leads to issues later where we are using it as
  strings.
- The division operator in Python 3 results in a float, not an integer
  like in Python 2. Use the truncation division operator instead.
- Use python builtins since the behavior of round has changed between
  python2 and python3.
  (https://docs.python.org/3/whatsnew/3.0.html#builtins)

Story: 2006796
Task: 42695

Signed-off-by: Charles Short <charles.short@windriver.com>
Change-Id: I9c9a4fdfd8a65cf6a3034a2c80c3a620ab138d22
(cherry picked from commit 9ced50cf38)
2021-08-16 14:15:42 +00:00
Bin Qian
7b92dbb403 remove /data which is not being used
Remove /data dir.

Closes-Bug: https://bugs.launchpad.net/starlingx/+bug/1940088

Change-Id: Ief68967da15ef142b5a24b0fb3b6ca04ad5d939d
Signed-off-by: Bin Qian <bin.qian@windriver.com>
2021-08-16 09:50:38 -04:00
Scott Little
6c2e809c92 Modify go package to be compatible with golang 1.16.6
Most packages will compile using the new default golang version (1.16.6).
For some packages it is a transparent change, but those reliant on
the old GOPATH method require the addition of  ...

    go env -w GO111MODULE=auto

... to their build instruction to restore GOPATH compatibility.

For Kubernetes version 1.18.1, I explicitly set to compile using
golang version 1.13.9 as this is the version recommended by Kubernetes.

Story: 2008972
Task: 42655
Depends-On: https://review.opendev.org/c/starlingx/compile/+/804123
Signed-off-by: Scott Little <scott.little@windriver.com>
Change-Id: I0d813cd245cb46932bf2096b641c4972f8a49efc
2021-08-16 09:45:48 -04:00
Steven Webster
a59d1553d5 uprev the containernetwork-plugins
This commit upgrades the containernetwork plugins to version 0.9.1

As there is no existing upstream package for this version for
StarlingX, it is being built based on the downloaded source and
centos7 spec file.

Note: previous commit 303ed35 was reverted because of an issue
with the centos_tarball-dl.lst and the autosetup command of the
spec file.  The second parameter of the centos_tarball-dl.lst
specifies the top level directory name of the package. If the
dl_tarball script detects that this TLD differs from that of
the downloaded tarball, the TLD is changed to that of the
2nd parameter.  In this case, the TLD of the downloaded package
was 'plugins-0.9.1', while the centos_tarball-dl.lst had
specified 'containernetworking-plugins-v0.9.1'.  The two options
to fix this incompatibility are to either change the TLD in the
centos_tarball-dl.lst to match the downloaded version, or to
modify the .spec file to run the autosetup command against the
re-named TLD.  This commit chooses the 2nd option, which allows
for the package to built against any mirror dl that already has
the containernetworking-plugins download present in it.

Plugins tested:

bridge
vlan
host-device
dhcp
host-local
static
tuning
portmap
bandwidth

Story: 2008972
Task: 42977

Signed-off-by: Steven Webster <steven.webster@windriver.com>
Change-Id: Ice12cbeacaeadc8beaa22152ca2a6104d31eec8b
2021-08-13 11:35:07 -04:00
Zuul
2ff8374037 Merge "Revert "uprev the containernetwork-plugins"" 2021-08-12 22:02:05 +00:00
Steven Webster
d801ea657d Revert "uprev the containernetwork-plugins"
This reverts commit 303ed359c7.

Reason for revert: The v0.9.1 tarball referenced in the centos_tarball-dl.lst is extracting to 'plugins-0.9.1' rather than the previous 'containernetworking-plugins-0.9.1'.  This seems to have happened in the last couple of days and will need to be investigated.

Change-Id: I9116cfa133d8e582740c7a9dbee873f3be939b13
2021-08-12 21:34:32 +00:00
Zuul
930a109283 Merge "uprev the containernetwork-plugins" 2021-08-12 19:20:56 +00:00
Davlet Panech
4a94f0496b intel-device-plugin: use clearlinux v34900
Upstream's Docker file uses the latest clearlinux/golang image, and
also updates all packages while building. As of this writing latest
packages in clearlinux are broken and make the docker image unusable
after the upgrade.

This fix uses a specific version of clearlinux (34900) known to work.

Change-Id: Ied58e50972cd38489fc1d341f74642dfc87712fa
Closes-Bug: 1939448
Signed-off-by: Davlet Panech <davlet.panech@windriver.com>
2021-08-10 16:05:01 -04:00
Steven Webster
303ed359c7 uprev the containernetwork-plugins
This commit upgrades the containernetwork plugins to version 0.9.1

As there is no existing upstream package for this version for
StarlingX, it is being built based on the downloaded source and
centos7 spec file.

Plugins tested:

bridge
vlan
host-device
dhcp
host-local
static
tuning
portmap
bandwidth

Story: 2008972
Task: 42977
Signed-off-by: Steven Webster <steven.webster@windriver.com>
Change-Id: Ia29df16aacec35dbda79a2f10a44eab90192dd6f
2021-08-10 11:41:04 -04:00
Zuul
8d4adc7c9f Merge "Fix python3 incompatibility" 2021-07-29 01:53:16 +00:00
Douglas Henrique Koerich
7fb6fca841 Patch pf-bb-config to return -1 on failed config
Current implementation of pf-bb-config utility (tag 21.6) does not check
the result of configure_device() function. Thus, if pf-bb-config is
running in a script or automated procedure (like when applying a puppet
manifest), any configuration failure cannot be detected unless the
output is parsed.
This change patches the source code of pf-bb-config in the same way that
was proposed by the PR: https://github.com/intel/pf-bb-config/pull/3. If
that change is merged, then in the future when pf-bb-config is upgraded
the patch can be removed.

Task: 42877
Story: 2009036
Signed-off-by: Douglas Henrique Koerich <douglashenrique.koerich@windriver.com>
Change-Id: Ic0ec0c7b9088a573cadf468839be1c4445d7abb2
2021-07-27 13:39:19 -03:00
Charles Short
0acb956dce Fix python3 incompatibility
- socket requires bytes and we need to explicitly convert str to bytes.
- check_output() returns bytes, while python2 returns str, passing
  universal_newlines=True it will return str no matter what python
  version is used.

Story: 2006796
Task: 42297

Signed-off-by: Charles Short <charles.short@windriver.com>
Change-Id: Ie3921c4ae6211a8b0d290bdbdb195ce07036afbc
(cherry picked from commit 26c16b3eb8)
2021-07-26 14:35:12 -04:00
Zuul
6279c4122c Merge "Upversion OPAE SDK to 1.3.7-5" 2021-07-15 21:47:37 +00:00
Thiago Brito
efb459cf14 Applying patch with -p1 for docker-py
Leftover from review 799708.

Partial-Bug: #1934397

Signed-off-by: Thiago Brito <thiago.brito@windriver.com>
Change-Id: Ibff2750390d1b5585b35632e9dea97c727f5131e
2021-07-12 13:26:37 -04:00
Zuul
490f07afc4 Merge "Add auth_config to api.image.inspect_distribution" 2021-07-12 17:08:14 +00:00
Zuul
c4b528b21b Merge "Worker node slow to become online after power out" 2021-07-09 16:49:16 +00:00
Zuul
df2e8d6701 Merge "Add pf-bb-config configuration file for N3000" 2021-07-09 16:46:36 +00:00
Zuul
f43b05efa8 Merge "drbd: Ensure compatibility with kernel versions >= v5.2" 2021-07-08 18:11:45 +00:00
M. Vefa Bicakci
b2c04a8fab drbd: Ensure compatibility with kernel versions >= v5.2
Prior to this commit, the Ansible bootstrap procedure on StarlingX would
fail with drbd-related errors when a v5.10-based kernel was in use. The
error reported by the kernel was "invalid argument".

Upon further debugging, it was discovered that generic-netlink (genl)
messages generated by drbdsetup would be rejected by the v5.10 kernel.
After looking at the git history of the drbd-utils repository, the
following two commits were found:

$ git log -2 --pretty=ref 859151b228d3b3aacefb09d06d515a2589c22e35
859151b228d3 (netlink: Add NLA_F_NESTED flag to nested attribute, 2019-07-12)
92ade5989027 (netlink: prepare for kernel v5.2, 2019-07-12)

This issue appears to be caused by kernel versions >= 5.2 being more
strict with the validation of nested netlink attributes. The patches
required very minor context adjustments and enable the Ansible bootstrap
procedure to succeed.

Story: 2008921
Task: 42787

Change-Id: I573d0caafc741c7668be8ee8e494fde826437a98
Signed-off-by: M. Vefa Bicakci <vefa.bicakci@windriver.com>
2021-07-07 15:30:15 -04:00
Thiago Brito
3c49987fba Add auth_config to api.image.inspect_distribution
This is an excerpt from docker-py 4.4.4 needed to check if a given image
exists in an authenticated registry.

Test scenario:

- Generated a new build with this change
- Installed the platform without errors
- Installed stx-openstack without errors
- Changed the docker-registry url and called a sm-restart for
sysinv-conductor to force the upgrade-static-images.yml to run
- Log: http://paste.openstack.org/show/807236/

Partial-Bug: #1934397
Signed-off-by: Thiago Brito <thiago.brito@windriver.com>
Change-Id: I35325ea579c53abbfaa96ed8de5417d32aba0578
2021-07-07 15:39:05 +00:00
Andre Fernando Zanella Kantek
f923505ad3 Worker node slow to become online after power out
During a DOR (Dead Office Recovery) procedure, the worker nodes are
taking longer than expected to become online, if the cluster network
is IPv6. This is related to an extra reboot occurring during the
bring-up process. Today only one DHCPv6 attempt is done, and, as the
controllers are still booting up, no response is available.
Eventually, this lack of a management IPv6 address will lead to an
extra reboot.

The correction is to make the DHCPv6 client continuously attempt to
get a management IP address from the server. If the management
network is IPv4, the DHCPv6 client is not called and will not
trigger continuous DHCPv6 requests.

Closes-bug: 1934676

Signed-off-by: Andre Fernando Zanella Kantek <AndreFernandoZanella.Kantek@windriver.com>
Change-Id: Ife5b06c5294e0014918073e9f6ee8bd372b85a78
2021-07-06 17:18:24 +00:00
Douglas Henrique Koerich
3f8401fe26 Add pf-bb-config configuration file for N3000
In the context of starting usage of pf-bb-config tool to configure the
N3000 (Intel FPGA) FEC device, it is necessary to include in the utility
package the corresponding file with the parameters set into the device.

For now, it is only fpga_5gnr/fpga_5gnr_config_vf.cfg from pf-bb-config
GitHub site (https://github.com/intel/pf-bb-config/tree/v21.6) that is
being taken for N3000 configuration, and used as is.

Task: 42784
Story: 2009036
Signed-off-by: Douglas Henrique Koerich <douglashenrique.koerich@windriver.com>
Change-Id: I219ddcf639f0ac80644b6f25cd50b883752c012e
2021-07-06 13:48:16 -03:00
Mihnea Saracin
5935f2a65f Update containerd to 1.4.6 (with fixed paths)
This updates containerd from 1.3.3 to 1.4.6,
runc from 1.0.0-rc10 to 1.0.0-rc95 and crictl from 1.18 to 1.21
to align with what was used upstream for Kubernetes 1.21 testing.

We could also remove the "no_btrfs" build flag by adding the
btrfs-progs-devel RPM to the CentOS mirror.  But we don't use btrfs
anyway, so this way we make the package a bit smaller.

Story: 2008972
Task: 42640

Change-Id: I3dc5465a80209eab34224e9e6e2d5aee49a8266e
Signed-off-by: Chris Friesen <chris.friesen@windriver.com>
Signed-off-by: Mihnea Saracin <Mihnea.Saracin@windriver.com>
2021-06-30 15:06:59 +00:00
Zuul
145e0d5756 Merge "Upgrade pf-bb-config to 21.6 and new config file" 2021-06-29 21:30:12 +00:00
Zuul
8ef19f9428 Merge "Revert "Update containerd to 1.4.6"" 2021-06-29 20:36:14 +00:00
Zuul
0f497f800e Merge "On AIO-DX only start Ceph MON and MDS via MTC" 2021-06-29 20:19:03 +00:00
Mihnea Saracin
883860da4e Revert "Update containerd to 1.4.6"
This reverts commit 4c682e9c43.

Change-Id: I18950de2f06e42c45b19f0f8d5cca058216c68f6
2021-06-29 20:04:44 +00:00
Douglas Henrique Koerich
a5071d6937 Upgrade pf-bb-config to 21.6 and new config file
After some reports of Mt.Bryce hang with the current version (21.3) of
pf-bb-config and from Intel's feedback this utility is being upgraded
to latest version tagged as 21.6.

Also, another configuration file is taken from the official repo at
GitHub, which is supposed to fit better with the new version and the
current device usage requirements.

Partial-Bug: #1933372
Signed-off-by: Douglas Henrique Koerich <douglashenrique.koerich@windriver.com>
Change-Id: If175cc5b33b59fa2095d1b466dcbc8b724287817
2021-06-29 16:45:14 -03:00