5707 Commits

Author SHA1 Message Date
Markos Chandras
6e3e63c0be playbooks: healthcheck-infrastructure: Ensure netcat is installed
The netcat package is required to perform the HAProxy tests so make
sure it is installed.

Change-Id: Ic2202164c224db6f24674f294a203f08165823fe
2018-09-12 15:25:26 +01:00
Zuul
f36835adf2 Merge "Allow openstack healthcheck and tempest to co-exist" 2018-09-04 16:00:08 +00:00
Zuul
7b0d39cb7e Merge "scripts: Fix getting external role SHA when working on master" 2018-09-04 11:37:58 +00:00
Zuul
080c6da716 Merge "Gather facts for host healthcheck" 2018-09-04 09:53:32 +00:00
Zuul
bb490bf767 Merge "Fix issues with infrastructure healthcheck" 2018-09-04 03:14:37 +00:00
Zuul
f447651543 Merge "ansible-role-requirements: Unpin ceph-ansible role" 2018-09-03 17:36:45 +00:00
Zuul
5261ac8565 Merge "Track master branch for tempest" 2018-09-03 15:00:24 +00:00
Jesse Pretorius
77f5506078 Allow openstack healthcheck and tempest to co-exist
We adjust the defaults and allow the same variable names to be
used for overrides. Neutron defaults to using .1 in a subnet
for the gateway, so we don't need to set it. Neutron will also
manage the allocation pool by default, so we don't need to
set those either.

Change-Id: Id7bce7072292423f2e2dac290e16e83ae7a94693
2018-09-03 15:41:21 +01:00
Jesse Pretorius
c5dbad487b Gather facts for host healthcheck
If the facts for the hosts are stale, or not present,
the playbook fails unless facts are gathered from the
container hosts. They are required because the "Ensuring
containers creation, connection and good behavior" play
uses host vars from the hosts.

Change-Id: Id4daf24f10e61a1800d73093c2aa5b9724a1c615
2018-09-03 13:49:02 +01:00
Zuul
de0b98b483 Merge "Remove molteniron playbook mistakenly left behind" 2018-09-03 11:54:28 +00:00
Jesse Pretorius
cd667c5884 Fix issues with infrastructure healthcheck
1. If the load balancer host is not the same as the control
   plane hosts, then 'Ensuring haproxy runs' fails unless
   facts are gathered.

2. The value for 'repo_release_path' is set in the vars file
   'defaults/source_install.yml', so the repo check fails
   without reference to that vars file.

3. When running 'Sanity checks for all containers' not all
   host and container facts are gathered, so the play fails
   due to missing facts unless facts are set to gather.

4. Instead of verifying both localhost and the utility
   containers for being ready to run the os_* modules, we
   only need to verify whichever one is the designated
   'openstack_service_setup_host'.

5. The memcache server connectivity test should have a short
   timeout, otherwise the task hangs for ages if it isn't
   working.

6. The rabbitmq vhost name is corrected and set consistently,
   otherwise those tests do not work.

7. The rabbitmq test venv fails to build for two reasons. One
   is that the venv creation fails, because virtualenv tries
   to download the latest pip/setuptools and fails due to the
   pip.conf restricting it. The second is that the python
   package 'pika' is not on the repo server. The task is changed
   to make use of the common python_venv_build role and to make
   use of pypi as an index when building the wheel.

Change-Id: I6f5f4a1bd55abc78ad5993076719a3ac5914af1d
2018-09-03 12:47:56 +01:00
Zuul
f9cf7f5533 Merge "Update ansible to 2.5.8" 2018-09-02 18:52:43 +00:00
Jesse Pretorius
1c6e80974c Remove molteniron playbook mistakenly left behind
In https://review.openstack.org/587586 we removed everything
except the playbook. This closes that loop.

Change-Id: Iea81197e10d6e85b723b719ca704421a7f45d927
2018-09-02 17:50:23 +01:00
Zuul
d2325c20d0 Merge "docs: Add links to very useful Galera recovery docs" 2018-08-31 22:06:18 +00:00
Zuul
6ba0a6b43c Merge "Add networkd prefix when creating networks" 2018-08-31 22:06:17 +00:00
Jesse Pretorius
528a163ec6 docs: Add links to very useful Galera recovery docs
These docs are very useful for full cluster recovery.

Change-Id: I05554dc8bc537087c3dc3977e338c8560eba479c
2018-08-31 20:20:50 +01:00
Zuul
2b0ece67d3 Merge "Bind mount glance cache directory" 2018-08-31 15:42:13 +00:00
Zuul
ef20db80b2 Merge "Add missing congress_oslomsg_rpc_password" 2018-08-31 15:42:11 +00:00
Zuul
b44e1becd1 Merge "Add aio host conf for barbican role" 2018-08-31 15:42:10 +00:00
Zuul
0f1cc17769 Merge "Introduce OpenStack Healthchecks" 2018-08-31 15:19:51 +00:00
Jesse Pretorius
24bd4a781f Update ansible to 2.5.8
It also seems that Ansible became more strict about the permissions of
the current working directory[1] so we need to either move our ansible.cfg
to a better location, or get rid of it. In the zuul test environment, the
location is world-writable.

Given that this is an ansible.cfg used for tests only, that its content is
(mostly) duplicated in the wrapper's RC file and that implementation of
avoiding the wrapper was done when we had vars plugins (which we no longer
have), I think it's safe to remove it and use the wrapper instead.

Using the wrapper ensures that everything is set in one place, so it's
easier to find. In the AIO bootstrap we then just make sure we override
things that we do not want to interfere with the AIO bootstrap - then unset
them later so that the defaults get applied from then on.

To also reduce the duplication of the bootstrap-aio.sh script in the
gate-check-commit script, we source bootstrap-aio from gate-check-commit.

[1]: ff980afefd

Change-Id: I6a673c3c4f228d11a9d93766021409a5b1672f63
2018-08-31 14:02:57 +01:00
Markos Chandras
69cf1a56e9 scripts: Fix getting external role SHA when working on master
When force_master == true, the code did not try to get tag information
from external roles but it tried to get the SHA for the specified
$osa_branch. External roles do not have stable/* branches, so the result
was an empty version. We fix that by simply falling back to master
branch if 'force_master' is set to True.

Depends-On: https://review.openstack.org/#/c/598246/
Change-Id: I73b8591217298511132d67f7a83ef27b093c02e4
2018-08-30 18:42:58 +01:00
Markos Chandras
ac8e917339 ansible-role-requirements: Unpin ceph-ansible role
The upstream PR[1] has been merged so we can switch back to using the
master branch for ceph-ansible

[1] https://github.com/ceph/ceph-ansible/pull/3015

Change-Id: Ibca788d304e67cd5a73283a9bc420d1772139b78
2018-08-28 15:30:07 +01:00
Matthew Thode
fb5a5cff7f
Bind mount glance cache directory
By default glance has ~10GB available to cache images on within it's
container.  Some images exceed that size causing image uploads to fail.
To work around this we can mount the image cache directory on the host.

This has the same danger as bind mounting the image directory (filling
up the host disk), so it's not a new danger, just one to be called out.

Change-Id: I887180b165a802a8d3635c2ad5b2284a123e230d
2018-08-27 18:21:55 -05:00
Jean-Philippe Evrard
59275230dc Track master branch for tempest
This also adds a git track branch for tempest master, so that
tempest gets bumped by the releasing tooling, like the other
files [1].

[1]: https://review.openstack.org/#/c/596391/

Change-Id: I5d20ec377cc610090bcda75593e16093b7046c4a
2018-08-27 16:25:41 +02:00
Mohammed Naser
1297b96a63 Update VNC path to correct one
The VNC path has been /vnc.html which means that no backends will
ever go up with the default option.

Change-Id: I7065fb3aa627c80655f0e1cf01742a6115a09678
2018-08-26 04:13:21 -04:00
Jesse Pretorius
cad69ee25e Add missing congress_oslomsg_rpc_password
This variable is not defined, causing implementations
of congress in the integrated build to fail.

Change-Id: Iaf2880866d1cc3780fec47fdf429c64227db914f
2018-08-25 19:15:58 +01:00
Zuul
7842f5841b Merge "Make sure the branch to track is in YAML" 2018-08-25 17:50:28 +00:00
Frank-ZhangXin
d65906c486 Add aio host conf for barbican role
Adding this example conf file would guide user to set correct host
name in AIO case. An experimental test for barbican has been added
which uses the barbican tempest plugin.

Depends-On: https://review.openstack.org/596408
Depends-On: https://review.openstack.org/596541
Change-Id: I10a07d5e4b2b3fbf122a79f15e27a9ca34799221
2018-08-25 16:19:37 +00:00
Zuul
98039e7759 Merge "Refactor jobs to use project-templates" 2018-08-25 06:45:49 +00:00
Zuul
1ddd941b62 Merge "Add octavia_service_region to octavia_all vars" 2018-08-24 21:12:09 +00:00
Zuul
bf9b0c927d Merge "Add pinned SHA for networking-ovn repo" 2018-08-24 19:57:02 +00:00
Zuul
2f1b0d3a25 Merge "Fix nspawn bind mount register process" 2018-08-24 19:57:01 +00:00
Jean-Philippe Evrard
2a288e1b1e Make sure the branch to track is in YAML
There is no reason to rely on comments in the files
used to bump the SHAs of upstream repositories.

Without this, a contributor can easily add a comment
and break the tooling, which relies on regexps and
well formated files to behave.

Instead, as this is a YAML file, we should rely on
a YAML parser in the release tooling, for more
robustness.

This fixes the issues by adding an extra key
(_git_track_branch) per repository, showing what to track.
This could be used in release tooling, and is not hurting
the existing code, as the extra keys are not loaded:
Those files are only consumed by the py_pkgs lookup, which
won't read this extra key.

Change-Id: I8fe08f389160e7be17dd56afde22173778540855
2018-08-24 19:00:30 +00:00
Jesse Pretorius
4383ae312d Add pinned SHA for networking-ovn repo
Currently the role defines the repo, but there is no SHA pin
in the integrated repo, so the repo always builds from the
head of master. This will cause inconsistency with deployments
but, more important, will eventually fail to build due to
inconsistent requirements with the requirements repo SHA pin.

Also, due to their being no group assigned in the role, this
repo and its wheels are built regardless of whether neutron
is, which causes build failures.

Change-Id: Ie27d10026600ae189790c03a8d380dc0b09131d2
2018-08-24 16:11:53 +01:00
Mohammed Naser
7d061c7d2a Refactor jobs to use project-templates
The patch does a few things to clean up our job management:

- Refactor all jobs into project-templates in order to very
  clearly identify which jobs are voting and non-voting.
- Drop all `voting: false` stanza in jobs, the infrastructure
  team suggests that we place those in job assignment, not
  in definition.
- Set CentOS 7 job to voting for metal, as it is finally passing
  now.

Change-Id: Iaad7a3b50e14d5f0ef25c52bcc070b7601d46a8f
2018-08-24 12:06:31 -03:00
Zuul
38513bf330 Merge "switch documentation job to new PTI" 2018-08-23 06:25:23 +00:00
Zuul
afc4ae8fde Merge "import zuul job settings from project-config" 2018-08-23 06:25:21 +00:00
Zuul
2756f14d38 Merge "Disable verbose output of log collection" 2018-08-22 16:48:06 +00:00
Zuul
dda0674306 Merge "Add test for Ubuntu Bionic" 2018-08-22 09:34:08 +00:00
Zuul
7959348db3 Merge "Remove bonds from AIO network config" 2018-08-22 09:19:27 +00:00
Zuul
7d8f503f55 Merge "Ensure that tests fail early if network interfaces are down" 2018-08-22 09:10:17 +00:00
Jesse Pretorius
703da30eda Disable verbose output of log collection
The verbose output is far too verbose, making it hard to
find the results of the test in the console log.

Change-Id: I540aba6beb536ac589100ee9374cc2a157fa621d
2018-08-21 20:28:44 +00:00
Zuul
fe3f2161a6 Merge "Add lxc3 compatibility" 2018-08-21 20:01:51 +00:00
Kevin Carter
348e406d9c
Fix nspawn bind mount register process
Updates to the container common task file were made to correct an issue
which would result in a new container not getting restarted when a bind
mount was added.

Change-Id: I29948d54a015e367fbdef4d10360c1a5f544b550
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2018-08-21 11:06:36 -05:00
Jonathan Rosser
c194535fd6 Remove bonds from AIO network config
On bionic the network bridges refuse to be up, because the underlying
bond interfaces do not come up.

This change removes the bonds which were really only decorative, and plugs
a dedicated dummy interface into each bridge. This simplifies the config
and the bridges should come up as soon as the dummy interface is attached.

Change-Id: I2662df94929c30190cd5d303588fdc9a99370e87
2018-08-21 14:56:53 +00:00
huang.zhiping
50712078a0 switch documentation job to new PTI
This is a mechanically generated patch to switch the documentation
jobs to use the new PTI versions of the jobs as part of the
python3-first goal.

See the python3-first goal document for details:
https://governance.openstack.org/tc/goals/stein/python3-first.html

Change-Id: I7388eb65c2925c497d0fce808cb439c2970648b4
Story: #2002586
Task: #24319
2018-08-21 13:21:44 +00:00
huang.zhiping
066a5c0c19 import zuul job settings from project-config
This is a mechanically generated patch to complete step 1 of moving
the zuul job settings out of project-config and into each project
repository.

Because there will be a separate patch on each branch, the branch
specifiers for branch-specific jobs have been removed.

Because this patch is generated by a script, there may be some
cosmetic changes to the layout of the YAML file(s) as the contents are
normalized.

See the python3-first goal document for details:
https://governance.openstack.org/tc/goals/stein/python3-first.html

Change-Id: Ic8ca6ccdfa0b6706ef3dbd49284482a741e78fa2
Story: #2002586
Task: #24319
2018-08-21 12:38:46 +00:00
Zuul
ae70643e50 Merge "Remove the last remnants of get-pip.py" 2018-08-21 12:31:04 +00:00
Jonathan Rosser
4b0f18d870 Add test for Ubuntu Bionic
We require:

* lxc3 compatibility 589146
* remove bonds from AIO networks 594085
* ensure network fail makes test fail + flush handlers 593546

Depends-On: https://review.openstack.org/589146
Depends-On: https://review.openstack.org/594085
Depends-On: https://review.openstack.org/593546
Change-Id: I36dcb74f93064cc5c06600d0595c1d6484e1d774
2018-08-21 10:59:05 +00:00