2945 Commits

Author SHA1 Message Date
MCamp859
012f5b82ee Remove SNMP APIs from user doc
Deleted APIs for SNMP Communities and Trap Destinations.
Added pointers to Fault Management guide.

Story: 2008132
Task: 41396

Change-Id: Ic2c52bf1b11d1793d57c78264e757795af1deff3
Signed-off-by: MCamp859 <maryx.camp@intel.com>
2021-03-30 10:40:44 -04:00
Zuul
c446cb5862 Merge "Make the placeholder db entry unique for remote URLs." 2021-03-30 12:51:53 +00:00
Zuul
d6c1c667dd Merge "Update psp migration script used in upgrade" 2021-03-30 12:31:13 +00:00
Zuul
115f877fac Merge "Progress adjust metadata refactoring" 2021-03-30 06:40:49 +00:00
Zuul
245440d262 Merge "Add support for AIO-SX to DX migration on subcloud" 2021-03-29 21:58:44 +00:00
Zuul
3288716d04 Merge "Remove oslo-incubated version" 2021-03-29 21:43:57 +00:00
Melissa Wang
7343c40f99 Add support for AIO-SX to DX migration on subcloud
This update allows the user to change the system_mode on a subcloud
from simplex to duplex using the system modify command. The sysinv DB
and the platform.conf will be updated with the new system mode. The
semantic checks were modified to ensure that changing from duplex to
simplex is prohibited. The changes also include support for updating
the OAM networking config using the oam-modify command.

Story: 2008587
Task: 41885

Signed-off-by: Melissa Wang <melissa.wang@windriver.com>
Change-Id: If7c14222ca66323225400ed88f214655f33fe615
2021-03-29 14:00:52 -04:00
Zuul
6c51808ffd Merge "Regenerate the correct plugins path." 2021-03-29 15:01:52 +00:00
Zuul
2a00374b61 Merge "Allow modification of OAM IP addr, in AIO-SX, without locking the host" 2021-03-29 14:56:31 +00:00
Andrei Grosu
3d42b28c77 Make the placeholder db entry unique for remote URLs.
The original solution removed the  'app-name-placeholder' dummy
entry if download failed but it was not approved because
sysadmins expect this and manually removing the dummy placeholder
app is advised.

This patch simply sets an unique name for the placeholder using
the first 16 characters for the URL md5sum as a postfix in case
there are multiple application-upload performed in sequence (
by a script, for example)

Closes-Bug: 1917374
Signed-off-by: Andrei Grosu <andrei.grosu@windriver.com>
Change-Id: Ib5db12bb23a0e7cce52596532e661d12092ea1d1
2021-03-26 15:19:57 +00:00
Andre Fernando Zanella Kantek
f8f826f960 Allow modification of OAM IP addr, in AIO-SX, without locking the host
Users will be able to change the OAM IP address without a lock/unlock
cycle. To achieve this some services will be restarted (sm, sm-api,
haproxy and vim-webserver) to reopen the L4 ports using the old IP
address as part of the socket.

Some config files in /etc are being updated also with the new address.

Story: 2008531
Task: 42060
Depends-On: https://review.opendev.org/c/starlingx/stx-puppet/+/780955
Change-Id: I9e77fc60882f20d4f31c3e38b5305b1f207f40d9
Signed-off-by: Andre Fernando Zanella Kantek <AndreFernandoZanella.Kantek@windriver.com>
2021-03-26 07:12:04 -04:00
Carmen Rata
c11bd71fb1 Update psp migration script used in upgrade
This commit updates the migration script used to apply the
pod security policy (psp) configuration during an upgrade.
The change is necessary to accommodate newly added psp
ClusterRoleBinding configurations.

Closes-Bug: 1885716
Depends-On: https://review.opendev.org/c/starlingx/ansible-playbooks/+/782325

Change-Id: Ibfdfd51e588eb2ad47c9f1c116875d01a2f06502
Signed-off-by: Carmen Rata <carmen.rata@windriver.com>
2021-03-25 23:37:17 -04:00
Zuul
26d65c3ed7 Merge "Fix dcorch subcloud audit issue after the upgrade" 2021-03-25 16:47:31 +00:00
Andrei Grosu
3f6c732939 Regenerate the correct plugins path.
For some reason, if the application to be uploaded is a (remote) URL,
parsing the manifest if deferred (presumably not to block for large
files and/or slow networks) and a dummy 'app-name-placeholder' is used
until later, when the file is unpacked and its manifest read.

Closes-Bug: 1915518
Signed-off-by: Andrei Grosu <andrei.grosu@windriver.com>
Change-Id: Ic3929965ea931b117c3e5aab6f8e3f128bbbeb56
2021-03-25 13:49:22 +00:00
Tao Liu
e2e7d45d0e Fix dcorch subcloud audit issue after the upgrade
Dcorch-engine stops auditing the subclouds after the upgrade.
This is because audit_status of subcloud_sync data was not
set during data migration.

This update sets audit_status to initial state of “none”.

Test: Upgrade controller-1, and then swact to controller-1.
      Verify the dcorch-engine audits subclouds.

Closes-Bug: 1920962

Signed-off-by: Tao Liu <tao.liu@windriver.com>
Change-Id: If8fa6c5e1c1d1a81104976cb3e527c4095dd97f7
2021-03-25 09:00:23 -04:00
Charles Short
ed127df6ad Remove oslo-incubated version
A long time ago oslo-incubated code was used to build the
individual projects the same way. Now the openstack projects
use pbr to build the python projects.

Remove oslo-incubated version code, it is not being used anywhere
so just remove it. Unit tests run fine when this module has been
removed.

Story: 2006796
Task: 42010

Signed-off-by: Charles Short <charles.short@windriver.com>
Change-Id: Ib11d69210878f38febf2d031b083a1ad85fec30c
2021-03-24 09:12:33 -04:00
Teresa Ho
08c14894f3 Add bond option primary_reselect
This update is to allow the option primary_reselect configurable for
aggregated ethernet interface. The option is to prevent reverting
between the primary slave and other slaves.

Story: 2008706
Task: 42057

Change-Id: Icacc0bd2d5e42bf2e5db1505fd676c628dbe3ed1
Signed-off-by: Teresa Ho <teresa.ho@windriver.com>
2021-03-23 12:10:02 -04:00
Andrei Grosu
7dcdfaae89 Progress adjust metadata refactoring
Changed the name of the constant and the yaml key to better reflect
the purpose. Now the value is an integer which represents the
adjustment value used to compute the percentage completion when
applying charts. Cleaned up the code around the usage of the value
and computing the percentage.

Story: 2007960
Task: 41959

Signed-off-by: Andrei Grosu <andrei.grosu@windriver.com>
Change-Id: Ia3b07b83762cdf20f6809222dc687f67c15deee5
2021-03-22 13:08:25 +00:00
Zuul
7a2a54c2b7 Merge "Enhance maintenance semantic checks with app hooks" 2021-03-17 16:00:54 +00:00
Dan Voiculeasa
368f5ce321 Enhance maintenance semantic checks with app hooks
Let apps run semantic checks for lock and unlock actions.
Let forced actions not run the app semantic check.
Create unit tests for allowing and rejecting the action by an app.

Story: 2007960
Task: 41842
Signed-off-by: Dan Voiculeasa <dan.voiculeasa@windriver.com>
Change-Id: Ibe35c917cd5702031a56baf3059b70e0e2e59480
2021-03-17 10:58:44 +02:00
Zuul
9e6cb84816 Merge "Implement algorithm for reapply evaluation priority" 2021-03-16 16:32:46 +00:00
Zuul
7c63abb20d Merge "Force remove or delete application" 2021-03-16 14:48:04 +00:00
Zuul
d61bb252ec Merge "Prevents critical apps from being removed" 2021-03-16 14:47:21 +00:00
Suvro Ghosh
b3b28f56e8 Force remove or delete application
Adding the functionality of using the flag -f or --force with
system application-remove or system application-delete

Story: 2007960
Task: 42016
Signed-off-by: Suvro Ghosh <suvrojeet.ghosh@windriver.com>
Depends-On: Ia1017b7eff0d9bd73b6448f2c4790f7e2b89c828
Change-Id: If68d66d799addcd996da4b146d092c855b455aa3
2021-03-15 23:03:29 +00:00
Zuul
0cbc9f2b54 Merge "Introducing GEO location new fields for System" 2021-03-15 18:51:42 +00:00
Zuul
aa2a387a8d Merge "Change enable_secured_etcd.yml variable in upgrade" 2021-03-15 18:35:18 +00:00
Zuul
f6aa3dbe69 Merge "Remove unsafe umask usage" 2021-03-12 20:50:34 +00:00
Daniel Pinto Barros
8f0312b518 Introducing GEO location new fields for System
New fields was created for the system object.
Changes was made to include GEO location attributes (latitude,
longitude) to the system object and adding a way to retrieve and
modify those attributes using the API and CLI.
Updates on: DB system model; DB migration; System object fields;
API fields; CLI fields; API documentation.

Story: 2008570
Task: 41721

Signed-off-by: Daniel Pinto Barros <DanielPinto.Barros@windriver.com>
Change-Id: I86f124c44d80896427e3ac1bc799fe34588ae942
2021-03-12 13:15:40 -05:00
Zuul
e3a97fc267 Merge "Rework platform managed apps" 2021-03-12 17:45:51 +00:00
Suvro Ghosh
fa1622ef5f Prevents critical apps from being removed
If an app has a metadata stating remove is prevented/forbidden then
"system application-remove" for that app  will be rejected

Story: 2007960
Task: 42005
Signed-off-by: Suvro Ghosh <suvrojeet.ghosh@windriver.com>
Change-Id: Ia1017b7eff0d9bd73b6448f2c4790f7e2b89c828
2021-03-11 12:00:42 -05:00
Mihnea Saracin
da2bc95fbc Change enable_secured_etcd.yml variable in upgrade
The enable_secured_etcd.yml playbook will use the
cluster_floating_address variable instead of
default_cluster_host_start_address. So we change
the upgrade script accordingly to use the new
variable.

Closes-Bug: 1918130
Depends-On: I8fecc1e5e54b5a9a9a72a54c069f79f5f2d434ba
Change-Id: I8c9fd36e1104d4713bb748a57193530a0c4b458a
Signed-off-by: Mihnea Saracin <Mihnea.Saracin@windriver.com>
2021-03-11 17:20:38 +02:00
Charles Short
cc27551a8e Remove unsafe umask usage
The sysinv code runs under eventlet that causes the
running greenthread to swap out the original umask. This
results in the sysinv code running with the incorrect umask.

This can be demonstrated by the "system dns-modify" command,
the agent process starts with a umask of 022, switched to 0,
and is never restored.

This simple fix is to audit where os.umask is being used and
replace os.umask with os.chmod.

Testing has been done locally by:

1. Running the "system dns-modify nameservers=8.8.8.8,8.8.4.4" command
   and checking the results/permissions of /etc/resolv.conf. Also,
   cheked to see if the umask flag have been changed in /proc/XXX/status
   before and after running the command.
2. Running an "system applicaton-upload" command on an installed helm
   armada package, these are located in /usr/local/share/application/helm.
   After the application upload, the application-apply should be
   "applied" without error/failure as shown in "system
   application-list".
3. Running a distributed-cloud and checking for any errors. The command
   "dcmanager subcloud show <subcloudname>" should show the identity
   service in sync after the dcmanager subcloud manage <>".

Closes-Bug: 1915955

Signed-off-by: Charles Short <charles.short@windriver.com>
Change-Id: I16ce695cfc4f6fb496ac0b3287906cc968ec5e98
2021-03-11 08:46:20 -05:00
Zuul
ad33b9ac9c Merge "Use http_port from conf file for fpga-agent" 2021-03-09 17:01:41 +00:00
Dan Voiculeasa
c72417aede Implement algorithm for reapply evaluation priority
Implement algorithm to determine app priorities for reapply evaluation.
Use information provided in metadata to create a directional graph.
Detect cycles and abort.
Unit tests added.

Tests: AIO-SX, AIO-DX
Apps are correctly ordered for reapply evaluation.
Applications reapply order: [u'cert-manager', 'rook-ceph-apps',
'platform-integ-apps', 'oidc-auth-apps', u'stx-openstack']

Story: 2007960
Task: 41781

Signed-off-by: Dan Voiculeasa <dan.voiculeasa@windriver.com>
Change-Id: I375a90b746a0ff4c970305a26c2e3e061b14454e
2021-03-09 18:24:44 +02:00
Dan Voiculeasa
4face8a656 Rework platform managed apps
At the moment the managed apps are hardcoded.
This behavior needs to be changed.

Let apps specify in the metadata if they want to be managed or not.
Let apps specify in the metadata the state they want to achieve.
Create column in kube_app table to store metadata. This will be read
when conductor is restarted.

Tests:
Install AIO-SX and AIO-DX, apps achieve the state described in their
metadata file.
Restart conductor, metadata gets picked up from the database.
Do system application-remove, app gets auto-applied.
Do system application-delete, app gets auto-uploaded.

Story: 2007960
Task: 41780
Signed-off-by: Dan Voiculeasa <dan.voiculeasa@windriver.com>
Change-Id: I881716049471183cfd1179ab0558a557c8d104d8
2021-03-09 18:24:44 +02:00
Teresa Ho
a87694bf5e Use http_port from conf file for fpga-agent
The sysinv-fpga-agent is modified to use the http_port parameter
from the platform.conf file.
If a device image update operation is in progress, the http_port
service parameter modification cannot be applied.

Story: 2007875
Task: 41969

Change-Id: I41e795606535d91131b96a014b07bf18f0032d57
Signed-off-by: Teresa Ho <teresa.ho@windriver.com>
2021-03-08 20:09:57 -05:00
Zuul
34e23b5407 Merge "Notify dcmanager when upgrade completed" 2021-03-08 19:42:58 +00:00
Zuul
10661df727 Merge "Upgrade activation interrupted by host-swact" 2021-03-05 17:05:23 +00:00
Chris Friesen
ff3ce494ee Notify dcmanager when upgrade completed
When an upgrade has been completed we want to notify dcmanager
so that it can do a load audit of the subclouds rather than
waiting up to an hour for the normal load audit to run.

Story: 2007267
Task: 41967
Depends-On: https://review.opendev.org/c/starlingx/distcloud/+/778338
Change-Id: I0c03bbfa16745fa297e159256a284e8862ff926a
Signed-off-by: Chris Friesen <chris.friesen@windriver.com>
2021-03-05 10:27:23 -06:00
David Sullivan
b9cd8ec6de Upgrade activation interrupted by host-swact
During an upgrade-activate the upgrade scripts can be interrupted by a
swact. We need to block the swact during the activation. If a swact does
occur we need to reset the upgrade state so the activate can be
attempted again.

Closes-Bug: 1917779
Change-Id: I9274319375296b2334533e386629d185e2b472ac
Signed-off-by: David Sullivan <david.sullivan@windriver.com>
2021-03-05 08:54:27 -06:00
Zuul
5c326dc997 Merge "Update api-ref with modified interface configuration" 2021-03-05 13:43:07 +00:00
Litao Gao
69b62362c7 Update api-ref with modified interface configuration
1. allow creation of ethernet interface using sriov interface
2. max_tx_rate options for sriov vf interface configuration

Story: 2008470
Task: 41987

Signed-off-by: Litao Gao <litao.gao@windriver.com>
Change-Id: Id64248060b57d1778a455637ba9cf70d680456e5
2021-03-04 20:27:24 -05:00
Zuul
8606a6df3d Merge "config: Add global service parameter to set cri handler" 2021-03-04 22:36:50 +00:00
Zuul
36053ee7d8 Merge "Fix handling of expired watch event in cert-mon." 2021-03-04 19:53:44 +00:00
Zuul
d309c482c2 Merge "Allow routes to be configured on oam interfaces" 2021-03-04 12:33:19 +00:00
Isac Souza
505e93b4c0 Fix handling of expired watch event in cert-mon.
The old code did not account for a type='ERROR'
being received by the watch stream. The new code
checks if the received event is an error and returns
from the infinite loop to start the watch from scratch.

Closes-Bug: 1914408
Signed-off-by: Isac Souza <IsacSacchi.Souza@windriver.com>
Change-Id: I7feabe5b550979d3761427ae501f1a94903a8983
2021-03-03 21:17:02 -03:00
Zuul
f12cd07917 Merge "Config API documentation for Kubernetes cluster" 2021-03-03 20:48:12 +00:00
Zuul
62f18d3cce Merge "Retrieve device image over lighttpd" 2021-03-03 19:34:06 +00:00
Zuul
408c3533db Merge "Upgrade script to create device_images directory" 2021-03-03 19:12:47 +00:00
Zuul
4ed2ab3d61 Merge "Migrate to database backend for backup and restore" 2021-03-03 19:12:42 +00:00