Commit Graph

10688 Commits

Author SHA1 Message Date
Mark Goddard
e46d602536 Use local python interpreter for keystone cron generator
We generate the keystone cron schedule via a python script on localhost.
Currently this always uses 'python', however this may not be available
on some systems.

This change switches to use the same python interpreter as used by
ansible-playbook.

Partially-Implements: blueprint python-3

Change-Id: I6007f8d6880f418a503766cec21a330c44e5b80f
2019-12-09 17:07:10 +00:00
Mark Goddard
a5408f425b CI: Use python 3 for local kolla-ansible execution
This change switches the CI jobs to use python 3 for local execution of
the kolla-ansible commands.

For upgrades, we use python 2 for the previous (Train) deploy, then
reinstall using python 3 for the (Ussuri) upgrade.

NOTE: This is separate from the python interpreter used on remote hosts,
which is configured via ansible_python_interpreter.

Partially Implements: blueprint python-3
Related: blueprint drop-py2-support

Change-Id: I5bdc165f68b7bde1f9ef30fe8216f2a44e6d4706
2019-12-09 17:06:19 +00:00
Mark Goddard
c320077f08 CI: Move ansible installation & configuration to Ansible
Continue to reduce the scope of setup_gate.sh. Allows us to more easily
select python 2 or 3.

Change-Id: If2eeeacbbbdf58afb765b4a39772b5a1af7b952b
Partially Implements: blueprint python-3
2019-12-09 13:30:35 +00:00
Mark Goddard
3a6577bada Support python 3 in kolla-ansible script
The kolla-ansible script uses a python interpreter to detect the
location of playbooks and to check that the kolla_ansible python module
is importable. This change updates the script to support a python
interpreter named python or python3.

Partially Implements: blueprint python-3

Change-Id: Id5dcc53cc5dd9780632c04b6b73c56ea5da484a2
2019-12-09 13:29:43 +00:00
Zuul
f52082abf7 Merge "Fix Swift with kernel 4.19 and later" 2019-12-04 10:16:10 +00:00
Zuul
f8862c6cc2 Merge "[Train] Fix Tacker config for the local Glance store" 2019-12-03 10:21:34 +00:00
Radosław Piliszek
21488710d6 Fix Swift with kernel 4.19 and later
We mount Swift volumes with xfs.
The 'nobarrier' option we used was made noop [1]
and deprecated [2] (with warning) in kernel 4.10.
In 4.19 it was removed [3] resulting in an error
when using e.g. Debian Buster as host.
The noop patch was backported to CentOS 7 so
it is safe to remove this option with no behavior
change and backport to where needed.
Ubuntu Bionic uses 4.15 which only warns.
CentOS 8 uses 4.18 which only warns as well.
Debian Buster uses 4.19 exactly which breaks.

[1] https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=2291dab2c9d1880efd19469df2042e2277c8b7a4
[2] https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=4cf4573d899cd80d8578c050061dc342f99f3a32
[3] https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=1c02d502c20809a2a5f71ec16a930a61ed779b81

Change-Id: I006dea21321146c7fc738d0b41c401b72d271a99
Closes-bug: #1800132
2019-11-30 12:56:36 +01:00
Zuul
baef98a232 Merge "CI: Refactor a lot" 2019-11-28 12:16:18 +00:00
Zuul
734e86a02f Merge "Split out OVS/Linuxbridge agent configs from ml2_conf.ini" 2019-11-27 18:14:43 +00:00
Zuul
296fdfad46 Merge "Fix 'nova_cephx_raw_key' is undefined" 2019-11-27 16:02:17 +00:00
Michal Nasiadka
0947974ff6 Split out OVS/Linuxbridge agent configs from ml2_conf.ini
Change-Id: I799993728112a525e34cfbc4e786a10f0ed03be9
2019-11-27 13:42:48 +00:00
Mark Goddard
692d176cd5 Fix kolla_ansible python module check
The kolla-ansible script now (Train+) checks whether the kolla_ansible
python module is installed, and emits the following message if not:

ERROR: kolla_ansible has to be available in the PYTHONPATH (e.g.
installed)

It is supposed to exit 1 if this check fails, but does not.

This change fixes this by removing a subshell from the kolla-ansible
script.

Change-Id: I2c1a7398f2b8f876abcf2508874835154cb4ce57
Closes-Bug: #1854049
2019-11-26 17:50:15 +00:00
Radosław Piliszek
a2fc684164 CI: Refactor a lot
Separate upgrade logic to is_upgrade job var and rename
scenarios to match.

Rename "ACTION" to "SCENARIO" (as it is a scenario).

Separate testing of dashboard (aka Horizon) and increase
its timeout to 5 minutes (CentOS 7 slow as always).

Separate initialization of core OpenStack.

Use gate setup script from ./tests/

Remove useless tox setupenv.

Do not deploy Heat when not really necessary.

Change-Id: I4fca319ccc3de7188f8b7b44c9c71321e3899467
2019-11-26 17:30:14 +01:00
Mark Goddard
cacf308170 Add python3-dev[el] to bindep.txt
We should probably have had this in previously.

Change-Id: I14f690194085729bf500ed707d3bb99b1c055845
2019-11-26 10:59:31 +00:00
Radosław Piliszek
c5f9ea9590 [Train] Fix Tacker config for the local Glance store
It turned out the previous fix ([1]) was incomplete.
Additionally, it seems we have to limit Tacker server
to one instance co-located with conductor.

[1] https://review.opendev.org/684275
commit b96ade3cf0

Change-Id: I9ce27d5f68f32ef59e245960e23336ae5c5db905
Closes-bug: #1853715
Related-bug: #1845142
2019-11-25 20:13:15 +01:00
Zuul
119523fd5b Merge "CI/Debian: Push images after building" 2019-11-25 17:09:30 +00:00
Andrei Nistor
6ff6337230 Fix 'nova_cephx_raw_key' is undefined
When using external ceph without nova integration, kolla-ansible fails
because 'nova_cephx_raw_key' is undefined.
This patch fixes the issue by applying the 'default' filter to
prevent failure on undefined.
The change in behavior was introduced by [1].

[1] https://review.opendev.org/689753
commit 44709f4132

Change-Id: I2fdca1a6a78e78623733a387a2d8c7e29d449083
Closes-Bug: #1853862
Co-Authored-By: Mark Goddard <mark@stackhpc.com>
2019-11-25 16:33:22 +00:00
Zuul
f8ec9f714b Merge "Remove endpoint_type from neutron.conf [DEFAULT] group" 2019-11-25 14:27:55 +00:00
Zuul
83eff5f493 Merge "Fix hard-coded admin project name and username in blazar task" 2019-11-25 12:38:03 +00:00
Pierre Riteau
c697dc98bc Remove endpoint_type from neutron.conf [DEFAULT] group
This option appears to have been removed in 2015 in Neutron change
I9cf36e1fd3a009c175e0d475af407a30f4e5c408.

Change-Id: Ib2d94743aeeff328c900ab1607900844acb4462b
2019-11-25 12:02:55 +01:00
Zuul
e04d03e764 Merge "Default to disabling haproxy for memcached" 2019-11-25 10:30:48 +00:00
Zuul
6fc3d762d6 Merge "CI: Wait for Zun to delete the test container" 2019-11-24 16:47:41 +00:00
Radosław Piliszek
6ab144aae4 CI/Debian: Push images after building
This fixes Debian job failures during image building.

See https://github.com/docker/for-linux/issues/711
for upstream details.

Change-Id: Icf3ffb261605ffe5d8f2618c2ed4cb97db97dd49
2019-11-24 15:36:48 +00:00
Zuul
cfdcaf3ab2 Merge "Fixes the compatibility issue at HAProxy role with Ansible 2.9" 2019-11-23 17:02:25 +00:00
Zuul
a876f3b972 Merge "Use valid_interfaces instead of os_interface for placement" 2019-11-22 18:42:13 +00:00
Zuul
25e98f9047 Merge "Change local_action to delegate_to: localhost" 2019-11-22 18:35:54 +00:00
Pierre Riteau
96590822de Use valid_interfaces instead of os_interface for placement
The [placement].os_interface option was replaced by
[placement].valid_interfaces in Queens and was removed in Rocky.

Change-Id: I306c57305b9088159dd18af4aa373bbc39a8b881
Closes-Bug: #1853621
2019-11-22 16:39:04 +01:00
Michal Nasiadka
1009931162 Change local_action to delegate_to: localhost
As part of the effort to implement Ansible code linting in CI
(using ansible-lint) - we need to implement recommendations from
ansible-lint output [1].

One of them is to stop using local_action in favor of delegate_to -
to increase readability and and match the style of typical ansible
tasks.

[1]: https://review.opendev.org/694779/

Partially implements: blueprint ansible-lint

Change-Id: I46c259ddad5a6aaf9c7301e6c44cd8a1d5c457d3
2019-11-22 15:04:44 +00:00
Zuul
22cc65aafc Merge "Allow region setting for ironic-neutron-agent" 2019-11-22 12:21:21 +00:00
Zhuo Zhen
7f457cd928 Allow region setting for ironic-neutron-agent
The "os_region" param is missing in the ironic_neutron_agent.ini.j2
file. Without specifying the region, the neutron service will randomly
pick a region for the ironic-neutron-agent. Therefore, a list of
incorrect agents might be created in the neutron database "agents"
table for nodes from other regions. To list all neutron agents, use
'openstack network agent list'.

Change-Id: Idec265230d0ab63b7559d94690c059608dc2617e
Closes-bug: #1853464
2019-11-21 08:48:18 -06:00
Zhuo Zhen
f2d32d2e01 Fix hard-coded admin project name and username in blazar task
In one of the blazar ansible tasks in "bootstrap.yml", the admin
project name and username are hard-coded as "admin". OpenStack
users can define their admin project name and username differently
and the hard-coded names would cause authentication errors.

In addition, keystone identity api version 3 uses "os-project-name"
instead of "os-tenant-name". Although "os-tenant-name" might be
still accepatable, it's better to keep the latest.

Change-Id: Ie5c1016f9ce6f402ef208f3c295e6883a9edd8ab
Closes-bug: #1853462
2019-11-21 08:39:11 -06:00
Zuul
a1cd432630 Merge "Fix deployment of Qinling" 2019-11-21 13:50:53 +00:00
Radosław Piliszek
a3c8a84834 CI: Wait for Zun to delete the test container
We fail randomly on check-failure.sh which checks for
containers being down.
Since we share Docker with Zun, the script sees Zun test container
and may fail when it is stopped but not yet removed.

Change-Id: If8b001f7507663e49e8e535f1889592e5f428ab5
Closes-bug: #1853452
2019-11-21 14:02:05 +01:00
Zuul
2f75313063 Merge "CI: Reconfigure deployment after checking health" 2019-11-21 10:56:57 +00:00
Zuul
7856e72ba8 Merge "CI: Add more service list checks to OS "smoke testing"" 2019-11-21 10:56:56 +00:00
Zuul
c641096ea6 Merge "Parse MariaDB log messages in different formats into Fluentd" 2019-11-20 21:21:22 +00:00
Zuul
6d63ed6d2b Merge "Fix missing environment variable for Qinling" 2019-11-20 21:07:56 +00:00
Zuul
58968223db Merge "Remove Neutron integration with ONOS" 2019-11-20 18:57:36 +00:00
Gaëtan Trellu
78153195b0 Fix missing environment variable for Qinling
Remove "environment" variable from check-containers.yml task.

Change-Id: Id1e1abfb10df1eb6c8f4f3c7d2f5a0dd94c0a2cc
Closes-bug: #1853336
2019-11-20 11:40:33 -05:00
Radosław Piliszek
73649aeaac Fix deployment of Qinling
Qinling could not be deployed due to use of an undefined variable
(you guessed it, it was a typo).

Change-Id: Iadbf269e66decc0a4c6b24b3d828ac560adeb7a7
Closes-bug: #1853201
2019-11-20 14:08:39 +01:00
Marcin Juszkiewicz
e0f4613622 CI: Switch to Ussuri jobs and drop py27 one
Change-Id: Ie42e4f96df38888b3f64515cfe84504727d3def3
2019-11-19 15:33:57 +01:00
Zuul
28e082ea02 Merge "Use internal API for heat -> keystone communication" 2019-11-19 11:14:34 +00:00
Zuul
e5149cbcc2 Merge "Fix local_action and line_length>160 in common role" 2019-11-19 11:14:33 +00:00
Zuul
7c17c3c45e Merge "Vitrage: typo in precheck task" 2019-11-18 17:58:08 +00:00
Michal Nasiadka
2a5532c9a9 Fix local_action and line_length>160 in common role
- transitional handling of fluentd_binary var is no longer required

Change-Id: Ic2978252fb981fe15e600aa486e8af585d05c402
2019-11-18 17:31:52 +00:00
Michal Nasiadka
865ac24fc5 Remove Neutron integration with ONOS
Change-Id: Ie35ea07b8b6f95cbb56eb722ae2366c00243e562
2019-11-18 15:39:19 +00:00
Zuul
82c22c9050 Merge "Attempt to pull image before stopping and removing container" 2019-11-18 15:39:14 +00:00
Zuul
c4818ffd16 Merge "Remove OpenDaylight role" 2019-11-18 15:30:39 +00:00
Viktor Michalek
0217ebb82f Vitrage: typo in precheck task
Change-Id: If45d4877c3fa125a3abc71f0a84883fad0a0cf6e
Closes-Bug: 1853011
2019-11-18 15:39:13 +01:00
Radosław Piliszek
7758fe436e CI: Reconfigure deployment after checking health
Change-Id: I27507816e3fe62df2a043dad96e7d1bb4b439869
Closes-bug: #1847331
2019-11-18 14:39:56 +01:00