183 Commits

Author SHA1 Message Date
Drew Walters
4e0a5c1259 airskiff: Remove --show-all from kubectl commands
This change removes the --show-all flag from kubectl commands in the
debug report, as it's no longer supported. The data gathered without
this flag is sufficient for debugging.

Change-Id: Iac9515f99f5e4bc123500602094e70683dd73cb4
Signed-off-by: Drew Walters <andrew.walters@att.com>
2020-03-02 16:49:24 +00:00
Zuul
3bdab87baa Merge "Add missed commits from AIAB repo" 2020-02-24 20:42:57 +00:00
James Gu
40a01b2c4c Fix pyyaml load call error
yaml.load(input) is deprecated in pyyaml 5.1. This causes the
manifests_lookup function to append the python warning message
to the look up results. The pegleg cmd fails to launch container
due to extra strings after the image url. Added code to specify
the loader if the pyyaml version is 5.1 or newer.

Change-Id: I4765df28eedf99a8e823e192cf2f2f2b38434f2c
Signed-off-by: James Gu <james.gu@att.com>
2020-02-14 00:24:26 -08:00
Alexander Noskov
0314ee27a2 Add missed commits from AIAB repo
* https://review.opendev.org/#/c/704168/
  * https://review.opendev.org/#/c/651659/
  * https://review.opendev.org/#/c/701272/
  * https://review.opendev.org/#/c/697565/
  * https://review.opendev.org/#/c/697457/

Change-Id: Id004c3cd81b35037b98c95b1ccf96326700d1f37
2020-02-13 09:27:20 -06:00
Prateek Dodda
88dd435a79 Upadting the prefix numbering
apparmor must be configured before minikube so we can see the apparmor changes

Change-Id: I94d5e6fefaad4256b0611a09c014d79893260daa
2020-02-12 15:57:15 -06:00
Zuul
b215e56a85 Merge "Move deployment scripts from AIAB to Treasuremap" 2020-02-07 19:30:07 +00:00
Alexander Noskov
7853db4f36 Move deployment scripts from AIAB to Treasuremap
* Last AIAB commit ID: d7d345f
* Also moving from Quagga to FRRouting for bgp router script.
* Synced the recent changes in aiab and removed the frrouting change
which is still open in aiab

Change-Id: If5e4e030dacaa7fcf525f9767f50c82b07516e27
2020-02-06 19:54:59 +00:00
Zuul
962370a1a3 Merge "Update 'airship' tool default Pegleg password and salt" 2020-02-04 15:24:44 +00:00
Zuul
e0de23a786 Merge "Updated openstack-helm-infra for Ubuntu 18.04" 2020-02-03 21:41:23 +00:00
Ahmad Mahmoudi
37ab579227 Updated openstack-helm-infra for Ubuntu 18.04
Updated the commit id for openstack-helm-infra to include fix for
name resolution issue for Ubuntu 18.04
Also, updated deploy k8s script to remove local dns address
from /etc/resolv.conf.

Change-Id: I32e691696b72c67e88df83b0d511aece380faa46
2020-02-03 13:53:36 -06:00
Drew Walters
406aff9c5c airskiff: Add AppArmor
This change adds AppArmor to airskiff in order to test apparmor changes
to Airship charts.

Change-Id: I642275a9d5d6d44110298356d7be51cf711c8fe3
Signed-off-by: Drew Walters <andrew.walters@att.com>
2020-01-28 16:40:11 +00:00
Roman Gorshunov
77a6d76ca2 Update 'airship' tool default Pegleg password and salt
Pegleg requires for a password and salt to be longer than 24 characters. This
patch updates 'tools/airship' wrapper script with default Pegleg password and
salt to be longer than required.

Fixes error:
> pegleg.engine.exceptions.PassphraseInsufficientLengthException:
>   PEGLEG_PASSPHRASE must be at least 24 characters long.

Change-Id: I31e7694970281ae992e918b67ff3d7f97d3c9bc5
2020-01-03 14:35:54 +01:00
Roman Gorshunov
f00f35a2ab Airskiff: Update armada bootstrap image version
Update Armada bootstrap script used by Airskiff to use latest Bionic
image ':latest-ubuntu_bionic', instead of older unsuppoerted
':latest' image.

This should solve the following issue:
> RequestsDependencyWarning: urllib3 (1.25) or chardet (3.0.4)
> doesn't match a supported version!

Change-Id: Ic7b1b0a53c307e5416415aeb59767bcb33f753bb
Story: 2006939
Task: 37609
2020-01-03 13:15:51 +00:00
Kaspars Skels
425bba963b Uplift all charts/images and fixes
Change-Id: I82c3bb2bbcf890df61c63359b1492ae349114a34
2019-12-12 12:31:08 -06:00
IPATOV, DENIS (di0361)
8a1fdb960c Monitoring PVC-PV-RBD and mapping them
The script allows to monitor if PVC has associated PV and RBD associated with PV.

usage: 001-pvc_rbd_monitoring.py [-h] [--rbd] [--pvc] [--all] [--pv] [--bin]
                                 [--config] [--debug | --silent]

optional arguments:
  -h, --help    show this help message and exit
  --debug, -d   enable debugging (default: False)
  --silent, -s  don't log into console (default: False)

monitoring settigns:
  --rbd, -r     check rbd (default: False)
  --pvc, -p     check permanent volume claim (default: False)
  --all, -a     all checks (default: False)
  --pv          check permanent volumes (default: False)
  --bin, -e     path to kubecl binary (default: None)
  --config, -c  path to kubecl config (default: None)

Change-Id: If88979d645c543ff778201c597f898b7c7aa0388
2019-11-15 19:26:55 +00:00
Kaspars Skels
4f8b9788ce Streamline Seaworthy use of servers
Change-Id: Ic16a4f20b45c5037783627efe872cfe773f24716
2019-10-24 10:41:38 -05:00
Nishant Kumar
aaf4f9dc9f Forceful deletion of Stateful set pods
Statefulset pods in kubernetes are not evicted automatically
if a node goes down. Those pods would go to an 'unknown' status.

This script should be used in cases where we would want to forcefully
evict a stateful set pods.

Change-Id: I2f84b04b41d9c40201406dd540b595ff3422a83d
2019-09-20 16:05:37 +00:00
Zuul
4664740afc Merge "Add airskiff_suse site" 2019-09-10 20:36:24 +00:00
James Gu
f3a4cebcb4 Add airskiff_suse site
Added airskiff_suse site that deploys the ucp and openstack containers on openSUSE
images. Also renamed the previous airskiff site repo to airskiff-ubuntu. Added new
gates for airskiff-suse lint and deployment.

Change-Id: I5672e8db556ef02c3d74a598d2772fbebccf6f77
2019-09-10 17:00:27 +00:00
Egorov, Stanislav (se6518)
0857054f83 Extract hyperkube binary before running promenade
Change-Id: I5fcce1f969de9c6c2d918bdbb813ee3c74050f7b
2019-09-09 04:54:16 +00:00
Drew Walters
b2e59561bd airskiff: Remove package installation script
The OpenStack-Helm Infra minikube script installs all necessary package
dependencies prior to deploying Kubernetes, so the airskiff package
installation script is redundant. It also causes incompatibility with
OpenStack-Helm's minikube gate script.

This change removes the 000-install-packages.sh script in order to
mitigate the aforementioned issues.

Change-Id: I82aa4bbd69b29dd3760a4418f7455f9d7ddc5a4c
Signed-off-by: Drew Walters <andrew.walters@att.com>
2019-08-22 17:25:14 +00:00
Zuul
2a61af8e2a Merge "Use Jenkinsfile from git instead of static file." 2019-08-21 22:54:35 +00:00
James Gu
e28d0a1313 Add new airskiff type
Create a site type called skiff and point airskiff site to be based on
the new type. This will help to reduce the duplication when creating
airskiff-suse site in subsequent commit.

Change-Id: Ie9cd6d0e572a4556ee6ff5c3d37f20349c2d7de3
2019-08-21 16:20:01 +00:00
Daniel Pawlik
4aafdf3462 Stop systemd-resolved to fix DNS configuration
Docker uses DNS configuration from systemd-resolved,
when its running [1], stop it before starting docker
to use /etc/resolv.conf instead.

The issue has been introduced with Ubuntu Bionic,
because it brings systemd-resolved service for DNS
management.

[1] https://github.com/moby/moby/commit
      /e353e7e3f0ce8eceeff657393cba2876375403fa

Change-Id: I8cabbc6b49383e3ac4e5596e574ffbe59ec1ee67
2019-08-20 00:09:25 +00:00
Evgeny L
d5d5481422 Fix wait script to wait for Processing actions
The script must wait for Processing actions if they exist,
it also needs to fail if it failed to retrieve a list of
actions from Shipyard.

Change-Id: I806a2c5c2e05fa768c6c3434c5c6d9bd102c6c92
2019-08-15 18:06:48 +00:00
Zuul
390f98784a Merge "Set permissions of kube config like airskiff.yaml" 2019-08-12 19:40:43 +00:00
Steven Fitzpatrick
def39706da Set permissions of kube config like airskiff.yaml
This script mounts ~/.kube/config to a volume in the armada container,
however this file is not readable by the armada user with its' default
permissions. This change sets the permissions on the file to 0644 before
mounting it, then sets the permissions back to the original values
afterwards.

Change-Id: I60ee02b7edfd763e826488e787f02cda7f73eb92
2019-08-12 12:26:32 -05:00
Steven Fitzpatrick
19b9cecb77 Prefix package installation commands with sudo
This file calls either rpm, dpkg or apt to install a YAML module for
python. This change removes the need for this file to be run as root.

Change-Id: I77590d24e82f0ced69db97ef946fa7202d1f0a7a
2019-08-09 13:22:33 -05:00
Steven Fitzpatrick
3f5af67768 Update OSH_INFRA_COMMIT for Xenial Compatibility
Recently, changes in openstack-helm-infra have introduced and remedied
compatibility issues with Ubuntu Xenial. This change updates the
specified OSH_INFRA_COMMIT to one which is compatibile with Xenial.

OpenStack-Helm still supports Ubuntu Xenial, so this script should too.

Change-Id: I7eed51db24a3e6488615034e7f21ee3b4242e6c1
2019-08-09 11:23:31 -05:00
Daniel Pawlik
aea332029a Fix infinity loop when all actions are already completed
Wait-for-shipyard sctipt was just checking actions that are
in "Processing" state, but if some actions are "Complete",
it comes to infinity loop.

Change-Id: I9c007a60227159af561f5ceacf5fc3dd469fce0c
2019-08-08 13:16:09 +00:00
Zuul
5d375ff8bd Merge "Change permissions for generated airskiff.yaml file" 2019-08-08 11:59:07 +00:00
Alexander Noskov
142dd1e491 Use Jenkinsfile from git instead of static file.
Change-Id: I37b2e2f77810a8f84e6c57c2a0e19d957da9b64a
2019-08-05 12:05:22 -05:00
Alexander Noskov
7f6a63909b Pipeline reordering
In order to utilize CI/CD more efficiently, it's better to execute
automatic uplift only on Seaworthy and keep Airsloop job for daily
PatchSet's.

Change-Id: I19983c9b95d78c32c667766eceaca234025fc625
2019-08-05 15:41:12 +00:00
Soujanya R M
f4644a3399 Display correct password at end of deploy script
Instead of printing a string constant "password" use
password from Horizon secret file to display at end of
deploy script.

Change-Id: I620a328eacfdbe6400648703938d16b83f165d5b
2019-08-05 08:42:19 +00:00
Daniel Pawlik
05e7672a84 Change permissions for generated airskiff.yaml file
Generated file has superuser owner and it is set with permissions
that other users are not able to read the file, so later it can't be used
by Armada.

Change-Id: I571a3af0fa8f3a482e0a8e9726f92cc39a670e91
2019-08-01 06:46:47 +00:00
Alexander Noskov
d59c51ef10 Add tools dir for gerrit trigger
We need to test changes in tools dir
because it uses during pipeline execution.

Change-Id: I0e9016609277475759f43e0591aa011279452abb
2019-07-30 10:51:29 -05:00
Zuul
f24e098b4d Merge "Leave docker.io package" 2019-07-30 15:04:57 +00:00
HUGHES, ALEXANDER (ah8742)
8d0b847a03 Standardize Treasuremap code with YAPF
From recently merged document updates in [0] there is a desire to
standardize the Airship project python codebase.  This is the effort
to do so for the Treasuremap project.

[0] https://review.opendev.org/#/c/671291/

Change-Id: Icd45f1b99a90e6c934a84fdd91f2f7f8af5a8ddb
2019-07-24 17:58:10 +00:00
Daniel Pawlik
d2eef36c07 Leave docker.io package
Minikube is now supporting docker 18.09, so we don't need to install
docker-ce.
Change-Id: Iaa33e41954a0203c4ba7243ea66d08928cf68b9d
2019-07-24 11:44:50 +00:00
Kaspars Skels
ae6b1c360b Fix Seaworthy/Airsloop to use tools/airship for Pegleg
Change-Id: I60b598268d5ad6334dc21c2dd1e2818850cdfc9e
2019-07-18 14:12:29 -05:00
Drew Walters
598929e476 CI: Use Ubuntu Bionic for nodeset
Currently, treasuremap CI uses Ubuntu-Xenial. This change moves to
Ubuntu-Bionic in order to use the version of Docker requested by the
OpenStack-Helm minikube script.

Change-Id: Iba9bfda21c5a9995c775ff9bdc6bc9e0e2260d1b
2019-07-18 12:52:20 +00:00
Matt McEuen
16cdf842d2 Incorporate HA PostgreSQL
This change integrates changes related to the new Patroni-enabled
high availability included in the postgresql helm chart.

1. Updates the version of the postgresql chart
2. Adds users/passphrases for the postgresql replication and exporter users
3. Sets the default number of replicas to 3 (except for skiff & sloop)
4. Adds documentation/scripting for upgrading the chart

Co-Authored-By: Evgeniy L <eli@mirantis.com>
Change-Id: I51e63fb2444610cfb144bc587a6a179fa4830809
2019-07-15 19:39:38 +00:00
Roman Gorshunov
f995e9e7c4 Remove nagios and prometheus exporter images from updater
Nagios and prometheus-openstack-exporter images and charts are sourced
from OpenStack-Helm project and do not need to be updated separately
here anymore.

Change-Id: I939329e1b602b465e4d43f19ec4b853dd07acee0
2019-07-12 16:32:08 +02:00
Jiří Suchomel
206759c304 Use public keystone endpoint instead of internal
Also, if specific shipyard password is defined,
pass it on to shipyard component instead of OS_PASSWORD
(which might be defined with the value for another cloud).

Change-Id: I42d9797c8177ad4da2b401f874fb21a00e045883
2019-07-09 15:29:03 +00:00
Roman Gorshunov
00cbd30abf Enhance skip list
This patch enhances skip list, so that images matching skip pattern are
skipped. Previous behavior was to skip only images ending with pattern.

Change-Id: Ic6548048412b6ab4e62398c66fedb888489bd605
2019-07-05 20:39:43 +00:00
Roman Gorshunov
5d02307117 Add cross-verification of Git commit ID'd and image tags
Versions updater utility will cross-verify latest Git commit ID's and
latest container image tags. It will print useful information on
possibly missing references in versions.yaml and Git <-> image tag
mismatches.

Slightly increase timeouts to reach quay.io.

Wrap lines and use double quotes everywhere.

Logger is declared out. Global variables are still global if declared
at the top level.

Change-Id: I267ca57182d54d26f4e75d143ad273cb6c30060e
2019-07-05 18:26:30 +00:00
Roman Gorshunov
29e92a499c Fix: git module requires user to exist
Git module used by Pegleg requires user to exist in /etc/passwd file,
or at least to have USER environment set to something. This patch
sets the variable.

Change-Id: I7fbb60b856c6ee7c26ff0dcec5778687836bb8b3
2019-07-02 15:53:55 +00:00
anthony.bellino
91f606357b Update docker to 18.06.3
This updates docker from 17.03.3 to 18.06.3

Change-Id: I30921dc1ccb9333c81a0b14e483a689656c4b6c5
2019-07-02 00:06:22 +00:00
Zuul
ff8a00725a Merge "Use zypper for package install on SUSE based distros" 2019-06-28 20:49:29 +00:00
Zuul
b45efc4d33 Merge "Using tools/airship wrapper in airsloop Jenkins jobs" 2019-06-28 19:34:20 +00:00