141 Commits

Author SHA1 Message Date
Roman Gorshunov
f995e9e7c4 Remove nagios and prometheus exporter images from updater
Nagios and prometheus-openstack-exporter images and charts are sourced
from OpenStack-Helm project and do not need to be updated separately
here anymore.

Change-Id: I939329e1b602b465e4d43f19ec4b853dd07acee0
2019-07-12 16:32:08 +02:00
Jiří Suchomel
206759c304 Use public keystone endpoint instead of internal
Also, if specific shipyard password is defined,
pass it on to shipyard component instead of OS_PASSWORD
(which might be defined with the value for another cloud).

Change-Id: I42d9797c8177ad4da2b401f874fb21a00e045883
2019-07-09 15:29:03 +00:00
Roman Gorshunov
00cbd30abf Enhance skip list
This patch enhances skip list, so that images matching skip pattern are
skipped. Previous behavior was to skip only images ending with pattern.

Change-Id: Ic6548048412b6ab4e62398c66fedb888489bd605
2019-07-05 20:39:43 +00:00
Roman Gorshunov
5d02307117 Add cross-verification of Git commit ID'd and image tags
Versions updater utility will cross-verify latest Git commit ID's and
latest container image tags. It will print useful information on
possibly missing references in versions.yaml and Git <-> image tag
mismatches.

Slightly increase timeouts to reach quay.io.

Wrap lines and use double quotes everywhere.

Logger is declared out. Global variables are still global if declared
at the top level.

Change-Id: I267ca57182d54d26f4e75d143ad273cb6c30060e
2019-07-05 18:26:30 +00:00
Roman Gorshunov
29e92a499c Fix: git module requires user to exist
Git module used by Pegleg requires user to exist in /etc/passwd file,
or at least to have USER environment set to something. This patch
sets the variable.

Change-Id: I7fbb60b856c6ee7c26ff0dcec5778687836bb8b3
2019-07-02 15:53:55 +00:00
anthony.bellino
91f606357b Update docker to 18.06.3
This updates docker from 17.03.3 to 18.06.3

Change-Id: I30921dc1ccb9333c81a0b14e483a689656c4b6c5
2019-07-02 00:06:22 +00:00
Zuul
ff8a00725a Merge "Use zypper for package install on SUSE based distros" 2019-06-28 20:49:29 +00:00
Zuul
b45efc4d33 Merge "Using tools/airship wrapper in airsloop Jenkins jobs" 2019-06-28 19:34:20 +00:00
Jiří Suchomel
07210faee7 Use zypper for package install on SUSE based distros
Change-Id: I86a97a42530df6bc92da0951c90a9ca0cf23c463
2019-06-28 19:47:35 +02:00
Alexander Noskov
9fc755f166 Using tools/airship wrapper in airsloop Jenkins jobs
In order to test new changes for promenade https://review.opendev.org/657953
need to adjust airsloop pipeline.

Change-Id: Idd23e06182b67fee5675a504f2b87e7c2caeb685
2019-06-28 10:33:53 -05:00
Alexander Noskov
9ca7dfd06b Uplift Promenade
Uplifts the Promenade image as well as other modifications required
because of recent changes to Promenade, namely:
  * HostSystem schema changes for new image and new key under packages
  * New chart configuration to utilize new source for hyperkube
  * Refactoring names to make more sense and added new monitoring_image

Change-Id: I6c8e0c9f7c51438aa1d911c5fcd0d2f197ca37cf
2019-06-27 22:51:19 +00:00
Alexander Noskov
44f22f08d3 Move Airship Seaworthy pipeline to the folder.
It is more clear when all pipelines are in their directories.

Change-Id: I6d1098b8c478214b378fc34334f93355e623cb87
2019-06-21 16:16:39 -05:00
Alexander Noskov
92c43b00ce Use exact Ubuntu Xenial release.
By specifying exact ubuntu release as a tag for `updater.py` script, it prevents
downloading ubuntu with a higher release, for example, ubuntu bionic.
Changing bionic to xenial for armada chart.

Change-Id: I1864c3f8db2d90ab63d7d923de8f2ac0ecd20e31
2019-06-20 02:14:03 +00:00
Zuul
f355cebd09 Merge "[aiab] Add a site linting gate to Zuul" 2019-06-19 23:04:23 +00:00
Evgeny L
f69f3af5f4 [aiab] Fix a path to scripts directory
dev_single_node directory has been removed [1],
update gate script to point to correct a directory.

[1] https://review.opendev.org/#/c/664709/

Change-Id: I90d4dc3e5d1d4e73316bdfef750d829fea0a1e5e
2019-06-17 23:56:19 +00:00
Evgeny L
82467b9453 [aiab] Add a site linting gate to Zuul
Lint site manifests for Airship in a Bottle when publishing
and merging patches.

The patch adds a pre-run step that generates a new set of
certificates that is required for the validation.

Change-Id: Iebd23dacb424953b95527dd90938f6b6aba93c21
2019-06-17 23:49:16 +00:00
Zuul
2e67179721 Merge "[aiab] Allow to run aiab deployment from any directory" 2019-06-14 17:30:24 +00:00
Zuul
ca497a1ed7 Merge "Seaworthy pipeline fixes" 2019-06-14 17:06:14 +00:00
Evgeny L
f97a2c53f8 [aiab] Allow to run aiab deployment from any directory
Make aiab scripts to use relative paths, this fixes a problem
when the user runs the script from a different from `/root/deploy`
directory, or runs it from outside of `tools/deployment/aiab`.

Change-Id: If539812390253c720f47aacbda666de8acfd0fda
2019-06-14 14:04:02 +00:00
Kaspars Skels
fb00035a49 Seaworthy pipeline fixes
Change-Id: Iac05842eb7c3e63625aea582e50f1f35e1c297ce
2019-06-13 20:57:11 -05:00
Evgeny L
f70db0a39f [aiab] Fix readme formatting
RST formatting does not support the usage of '#' for
comments, fix it to hide license header in the
rendered document.

Change-Id: Iceef20281a8da91fa485a4fc6304c7ffabb6a214
2019-06-12 21:05:23 +00:00
Zuul
d7d827f97e Merge "[aiab] Update readme" 2019-06-12 18:53:02 +00:00
Zuul
b06a2f7439 Merge "Airsloop/Seaworthy pipeline fixes" 2019-06-12 18:32:55 +00:00
Evgeny L
463ef31bd8 [aiab] Update readme
Add instruction into aiab readme on installation and
HW requirements.

Change-Id: I434103f9bb10b8f136ad3f0dea2d5d40d10eebf5
2019-06-12 18:27:53 +00:00
Zuul
6d32c695af Merge "[aiab] Move dev_single_node content to aiab" 2019-06-12 18:02:12 +00:00
Zuul
0dfa69e9c9 Merge "[AIAB] Use airship command line for AIAB scripts" 2019-06-12 17:46:49 +00:00
Evgeny L
a209b3c720 [aiab] Move dev_single_node content to aiab
`dev_single_node` directory is inherited from an old
aiab repo and does not have much meaning in the current
directories layout, move all the scripts to aiab directory.

Change-Id: Ib59e14a81727104b66e372a2c61c5040282f2dc9
2019-06-11 21:37:42 +00:00
Evgeny L
5254785f57 [AIAB] Use airship command line for AIAB scripts
Refactor Airship in a bottle scripts to use `airship`
command line tool instead of relying on hardcoded values
with the versions of images and repositories.

The patch includes additional fixes:
1. Allow to specify credentials for wait-for-shipyard
   script without assuming some specific set of creds.
2. Fix a path to common-addresses file.

Change-Id: I59d0a0e1758a6575a84abb22045e08437aa51466
2019-06-11 20:39:31 +00:00
Kaspars Skels
31d1b2a013 Airsloop/Seaworthy pipeline fixes
Match arguments to latest CI/CD libraries

Change-Id: I5f630900b4ada92a8484e5820ed3a93d3d1649da
2019-06-11 20:23:10 +00:00
Zuul
317ec40825 Merge "Move airship-seaworthy to seaworthy" 2019-06-11 18:12:01 +00:00
Zuul
b68ce4a7af Merge "Add Airship-in-a-Bottle cicd gate jobs" 2019-06-11 10:28:07 +00:00
Kaspars Skels
3bc31be4b2 Move airship-seaworthy to seaworthy
Change-Id: Ide71456d1484b43ea434a23da858418adf51f23b
2019-06-10 17:41:33 -05:00
Michael Beaver
c78975c8c9 Add vars to Airskiff to not clone specific repos
This adds new variables to the 005-clone-dependencies script in
Airskiff to be able to turn off cloning for the Airship repositories.
The intended use case of this is so the Airskiff gate can avoid cloning
the repository it is currently testing.

Change-Id: I629ce9373b1b68f7e5fb6b134d9ea063a344a70c
2019-06-07 09:54:12 -05:00
Evgeny L
f9077a20d5 Add Airship-in-a-Bottle cicd gate jobs
Change-Id: I367cae5bae964c7ce0f0427c8bff0d9694e46db7
2019-06-05 21:31:59 +00:00
Zuul
e0991fba7f Merge "Add Airship-in-a-Bottle site manifests and scripts" 2019-05-30 17:24:12 +00:00
Zuul
5dc8777abc Merge "Update Jenkinsfile's to use Ubuntu-based images" 2019-05-29 19:44:43 +00:00
Zuul
b7fb90d5b0 Merge "[seaworthy gate] Explicitly configure auth parmaters" 2019-05-29 18:58:14 +00:00
Roman Gorshunov
f1369bde8c Update Jenkinsfile's to use Ubuntu-based images
Update Jenkinsfile's to use Ubuntu-based images to deploy airskiff and
seaworthy sites.

Change-Id: I1b33493081f8618d91c66088e943f6033d71e3c5
2019-05-29 17:26:11 +00:00
Zuul
bf4e245787 Merge "Fix: tools/airship permissions and directories issues" 2019-05-29 17:06:00 +00:00
Zuul
332a6d9e6b Merge "Add tag filter parameter to the updater tool" 2019-05-29 17:03:18 +00:00
Roman Gorshunov
74779ac6d8 Fix: tools/airship permissions and directories issues
The UID:GID under which commands from within containers are run does not
necessarily match UID:GID set in container. This patch enforces run of
containers with process UID:GID matching current user's UID:GID.

Creation of directories is documented, so that user's wouldn't get
unambigious error.

Change-Id: I122afc29e0968391574b74f330e5a3a4beb8ed52
2019-05-27 16:07:22 +02:00
Evgeny L
99f44cc1f3 [seaworthy gate] Explicitly configure auth parmaters
Configure Airship Seaworthy site specific parameters
when running tests. This would allow to make required
changes to default values in ./tools/openstack script
which are currently Seaworthy specific.

Change-Id: Ieb1b412436627604fc6597dadfb5d83dd8944355
2019-05-24 17:14:41 +00:00
Evgeny L
c88eb575b8 Add Airship-in-a-Bottle site manifests and scripts
Note: all scripts in tools/deployment/aiab directory have been
moved into this repository as is (except a few changes to make
them work), they require a heavy refactoring that will be done
in separate patch-sets.

* Add a virtual single node manifests that are based on a sloop type.
* Use NFS provisioner instead of Ceph.
* Update tools/openstack to be non-seaworthy specific, use a default
  region name and auth url.
* Make type/sloop/config/common-software-config.yaml to be site specific,
  to allow to configure custom region_name.
* Remove max-pods-per-cpu parameter for kubelet, treasuremap needs
  to support a diverse set of environments, without constraints
  on the number of available cores. Max pods configuration parameter
  is still present and helps to mitigate problems when kubernetes
  unexpectedly starts a large number of pods.

Change-Id: I379a50d810b91b989f039dbb7c691f5ceec0cc67
2019-05-24 16:23:07 +00:00
Matt Carter
264f21976f 030-armada-boostrap.sh: make --target-manifest env var driven
Currently the manifest targeted by armada in the
030-armada-bootstrap.sh script is hard-coded to "ucp-bootstrap". This
patch set updates the 030 script to make drive the target manifest
off of a new environment variable "TARGET_MANIFEST". By default
"ucp-bootstrap" is still used, and existing functionality should not
be altered.
The motivation behind this, is it allows us to use the armada
bootstrap script to do more than just bootstrap the ucp components,
which may prove useful in zuul gate jobs that use treasuremap.

Change-Id: If3cf11f0d5701e273f5e626bff673a2b164284e3
2019-05-23 14:47:49 -05:00
Roman Gorshunov
07f287c77c Add tag filter parameter to the updater tool
New parameter allows to prefer image tags from quay.io matching filter,
e.g. "opensuse" or "ubuntu".

Change-Id: I75091645ea4492c0db0facfcb3e95f18a54a76c8
2019-05-23 14:22:43 +00:00
Matt Carter
df620b7712 Fix dpkg/apt commands in tools/airship script
One of the first things the tools/airship utility script does is run
dpkg and apt. Because these commands were not being ran with sudo,
the airship script could only be ran as the root user. Adding sudo
so any user can run the tools/airship script.

Change-Id: Ia13321fcc7436931d82da274682bc700cf802d33
2019-05-21 09:07:43 -05:00
Kaspars Skels
df24b1853b Stability workarounds for ceph/cgroups issues
- Add stale rbd cleanup fix
 - Add cleaning of cgroups mounts

Change-Id: I9950496416fbbb572eb5775032305e18fee1f026
2019-05-17 20:09:31 +00:00
Matt McEuen
376e3882f9 Fix airskiff endpoint catalog
This cleans up the Airskiff endpoints by basing them off of the
sloop version.

Change-Id: I9207315a03469e59b205d74097ac83e56d1a9772
2019-04-28 22:56:21 -05:00
Matt McEuen
d006cc4867 Airskiff: add deps needed for a fresh install
When running the 020-setup-client.sh script on a new ubuntu 16.04 VM,
the gcc, python-dev, and python-setuptools  apt packages are required
for pip to install the cmd2 package.

Change-Id: Id4f46e7e0c6c607ffc660b8a26f17dbbbb340f4c
2019-04-28 11:33:22 +00:00
Zuul
0ebc90577a Merge "Airskiff: update packages prior to delete" 2019-04-27 23:05:24 +00:00