Change-Id: I8d7ec66670fee56b2da83e7e7101e44d57d25408

This change adds manila to our playbook lineup and will allow deployers
to use the shared filesystem as a service solution in their deployments.

Depends-On: I4d95bfc15d09b7b7c0b997d7eab91509b0c63885
Change-Id: I63ee785d3241d92ea94c07f89882000cae7a0ff6
Signed-off-by: cloudnull <kevin@cloudnull.com>

In order to enable the testing of the complete telemetry
stack, we add panko to the integrated build.

Change-Id: Ica12e3c0a586609bf5a3e5b50905922932a0bbce

This patch removes all references and stops using repo_build as
all the integrated roles have their wheels and virtualenvs
built inside the role.

This patch removes all references and usage of pip_install as we
no longer need to do this.

Change-Id: Ie48b738c9281578e48b1811481d2a8da3832dc1b

This commit adds experimental deployment of Masakari role.
It requires existing corosync/pacemaker cluster on compute nodes
for hostmonitors to operate correctly.
Corosync/pacemaker deployment stays out of OSA scope for now.

Depends-On: Ib33d7bc83f1428763f873e1155fd9e3eb4c937e4
Change-Id: Ie543885a52f013635b9f553982c3d6448e3cc3aa

Change-Id: Id330f6ac229373a775c680c745d005dc694fbf78

This reverts commit 84cb3ff052, but keeps
the release notes, to continue the development cycle.

Change-Id: Ibe28ada430970401a9c5a1c4049a265305d9ce18

This would be the first milestone release of OpenStack-Ansible Stein.

Change-Id: Iff5235b6e11a6586f0836fd550331efbe4151de0

This patch introduces the qdrouterd role for deployment as
a direct messaging bus for oslo.messaging rpc communications.
The qdrouterd is deployed as infrastructure in a manner similar
to the rabbitmq server.

This patch:
* Add to role requirements
* Add to inventory
* Add to playbooks
* Add experimental aio job

Change-Id: If9eed3d5848939eac005651336a1305433d96dbf

In additin to adding mistral role we also
include os-mistral-install.yml to deploy
mistral to the appropriate hosts.

Change-Id: I9c93e82ec655459c45baf91ed6e6130f2735f61f

The config_template action module has now been moved into its own git
repository (openstack/ansible-config_template). This has been done to
simplify the ability to use the plugin in other non OpenStack-Ansible
projects.

This implements the changes necessary to ensure that all integrated
build tests now make use of the new git repository, rather than the
old location in the openstack-ansible-plugins repository. The
config_template repo is placed first in the list of library/action
plugin locations to use to ensure that any other version of the plugin
(eg: ceph) is not used.

Related-Bug: 1791258
Depends-On: https://review.openstack.org/635838
Change-Id: I22fd0ef19b32ff8d949effcfe7fd7f4a653d8e08

http://docs.ceph.com/ceph-ansible/master/ states: "The master branch
should be considered experimental and used with caution." So that
really can't be considered a solid basis for building a cloud on. Use
a stable branch instead.

At the time of this patch, the stable-3.2 branch in ceph-ansible is at
the v3.2.0rc1 tag, so not currently considered fully ready for
production deployments either. However, per discussion with odyssey4me
this is OK for the OSA master branch at this stage in the cycle.

Change-Id: Ibd8f64d9889009cf6e80b92254fd580ff559b1be
Related-Bug: 1802195

Change-Id: I27874f755bcef493165877a24e284c493d99cb2a

The upstream PR[1] has been merged so we can switch back to using the
master branch for ceph-ansible

[1] https://github.com/ceph/ceph-ansible/pull/3015

Change-Id: Ibca788d304e67cd5a73283a9bc420d1772139b78

A fix [1] was introduced in openstack-ansible to use tempest from
the master branch in the AIO, but respecting the installation
from PyPI everywhere else. This allowed users to chose
the appropriate behaviour for their use cases.

This patch [1] also made sure we didn't have anything else to do
when the patch would land on stable branches, as this would
automatically get disabled.

However, as of today, there is still no new version of tempest,
and our stable/rocky branch has been cut. Therefore the fix that
was in place is useless and another approach needs to be
taken.

We will move to use tempest master for master and stable/rocky
branch until the fix that caused this series of patch to
happen is released [2] for tempest on PyPI.

A temporary workaround was also added to ensure ceph can still
be built, by freezing the ceph-ansible role sha.

The checksum fill option, was useful a long time ago, but at this point
its just some lovely technical debt that we carry around like an old
dirty security blanket. This change sets us free from the sins of our
past.

We seem to have a lot of jobs that timeout but seem to be very
close to completing, so let's bump the timeout by 20 minutes.

To make up for it, we drop most of our non-voting jobs because
they are taking up resources and always failing.  This should
decrease the amount of resources we're consuming.

Also, instances are failing to launch when jobs hit any nodepool
VMs inside OVH.

[1]: abe0b22c76
[2]: 7d2b636a30 (diff-5c9acbc10dc9d27b47985cd74ab100f6)

Change-Id: I42e0cefb28184964a50f66b18d8eba6d2a04eca7
Closes-Bug: 1786095
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>

The molteniron service appears to be largely for testing purposes
and both the service and role have not had much activity for over
a year. As such, it is removed from OSA's integrated build.

Change-Id: I94b1be326935f7006027b4a437ff3b2b0a6f9a69

The ceph-ansible project has created a new library which
is held in the root folder. We need to ensure that the
library path is included.

Additionally, a callback plugins directory exists within ceph-ansible
that we should also import.

Depends-On: https://review.openstack.org/550747
Depends-On: https://review.openstack.org/578736
Change-Id: Ic70d0e9eb57be9a9a1d8a658ceacc50c47ab9c02
Co-Authored-By: Jean-Philippe Evrard <jean-philippe@evrard.me>

Now that master has a patch for releasing milestone 2, we can
unfreeze the ansible-role-requirements to allow role iterations.

The version of OSA has been bumped at the same time to be ready
for the next freeze.

Change-Id: Ibfd14d2113ff41d8548551881846cdfaa927d6d6
Depends-On: https://review.openstack.org/#/c/573394/

Change-Id: Ia5a65510c58972c07a74c74eec3ab52aa82eedec

In order to continue testing from the head of the role repositories
to prepare for milestone 2, we revert the role freeze and set the
release to 18.0.0.0b2

Change-Id: I35b2eef362a0a53f2236cd2dab11778e44c85d48

This freezes the roles and copy each role releases notes for
preparing the first Milestone of the Rocky release.

Change-Id: I6b1343863eb27a5753ddbfcc3c1e2b063618ae50

In order to allow tests to work as the use of the common
role is implemented in the various roles, we pre-implement
the addition of the role into the a-r-r file.

Change-Id: I69d9d1b8b5ea7c62425e1d38e7f551ebe3cc57c3
Implements: blueprint python-build-install-simplification
Signed-off-by: Jesse Pretorius <jesse.pretorius@rackspace.co.uk>

This removes the systemd service templates and tasks from this role and
leverages a common systemd roles instead. This change removes a lot of
code duplication across all governed projects without sacrificing features
or functionality. The intention of this change is to ensure uniformity and
reduce the maintenance burden on the community when sweeping changes are
needed.

* To ensure we're using the extra data-disks correctly the bootstrap role
  has been updated to correctly handle mounts using systemd mount units
  and oneshot services.

* This change sets the container path accordingly allowing an extra
  physical datadisk to be used for all of our container backends.

* The gate test functionality can now be used with all of our container
  storage backends. This makes it possible for folks using all of our
  available options, [dir, machinectl, btrfs, lvm, zfs] to test an integrated
  build of OSA by simply setting the `lxc_container_backing_store` just as it
  would be done in a production deployment.

Depends-On: https://review.openstack.org//555614
Change-Id: I0dc6daabad6c071ec7f9013a1e1eb0b3e594b544
Co-Authored-By: Markos Chandras <mchandras@suse.de>
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>

- Tests minimum tempest's congress tests.

Change-Id: Id0c4a4bb4c01757da671a495613141ad738573dd
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

To normalise the role name to conform with the same standard
used with lxc_hosts, and to reduce confusion, we rename the
role name to include the plural suffix.

Change-Id: Ib6793512703e45cb000727125c31f667156932f9

1. The OpenStack infrastructure provides us with a list of mirrors
   which are already templated so this will simply the process of
   using those mirrors instead of the previous implementation which
   tries to derive the right URL's.
2. Instead of rewriting the host's sources file for Ubuntu, we leave
   it alone.
3. We place the overrides into a new override file to simplify the
   implementation and no longer require a bunch of conditionals in
   the user_variables template. Some more clean-up can be done, but
   it will follow on later.
4. The ceph-ansible project has created a new library which is held
   in the root folder of the repo. We need to ensure that the library
   path is included, but that results in other breakages. To help
   get patches moving through the system again we pin the SHA to just
   prior the upstream changes.
5. The MariaDB mirror setting has been removed due to the default
   MariaDB setup being done via a specific pin. The apt repo setup
   for MariaDB is no longer being used.

Co-Authored-By: Jesse Pretorius <jesse.pretorius@rackspace.co.uk>
Change-Id: Ib908e5503ecc93255d554d027ec62539c6316099

We've now imported the roles into the OpenStack
namespace, so let's use them from there.

Change-Id: I62aec92df9d40ef7e9c942c91e00055f9c8f0b08

This patch unfreezes all the roles to the master branch,
updates all the OpenStack Service SHA's for Rocky, and
updates the appropriate python requirements pins.

Change-Id: Iccfdb575774cdba93772c82a580cd815b58a4625

With the change to allow volumes to dynamically grow we need to define
the default volume size to contain a valid size modifier. At present the
value is creating a sparse file that is 1024 bytes. This change sets the
size to gigabytes.

The role pin is updated to include the changes in the lxc_hosts role
which use this method of configuration. Without it the quota setting
end up with a GG at the end, which is invalid and the command fails.

Change-Id: Ib9b23b023d2ad03ce72c4abce5dc9e51d4643ac0
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>

This change adds an nspawn container driver which will enable deployers
to run clouds with systemd-nspawn instead of LXC. This adds "nspawn" to
as an option to the `container_tech` variable. To support this change,
The inventory generation tools have been updated to allow for a
new group named `nspawn_hosts`. All of the container connectivity and
setup are stored within the integrated repo under the new templates
directory.

The addition of "nspawn" container driver enables the ability for
deployers to change, or mix container technologies within a single
deployment without needing to change our well defined network
topology or storage layout.

Depends-On: I13d05ba8bcfe785257a9cf98dbdb6024ec937816
Change-Id: I41cfec63c423cd56a91c25dabae9aa1031c27e03
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>

This patch updates all the roles to the latest available stable
SHA's, copies the release notes from the updated roles into the
integrated repo.

The OpenStack services SHA's will be manually updated in another
patch.

Change-Id: I78d85f33926bc979f7d0df0adc8e8245bf1223ad

Now that milestone 3 is release, we can move back to using master
for the roles, to see fast changes.

Change-Id: Idce198cf45a49857b64cc13a0a7476b2d4e632ae

This patch updates all the roles to the latest available stable
SHA's, copies the release notes from the updated roles into the
integrated repo, updates all the OpenStack Service SHA's, and
updates the appropriate python requirements pins.

Change-Id: I5fea16a84c881d0e66b713cdb55c8dcabcb80491

In order to continue Queens development, the role
SHA pins are removed.

Change-Id: I77945703fc8ed511a7d6dafe4f37ef004897f6b9

All the ceph roles are generated from the central ceph-ansible
repository. However, it appears that the script (or CI) that
generates these roles has been broken for a while. The last update
for generated roles was nearly 2 months ago. This means that we
are missing a lot of ceph features and fixes that exist in the central
repo but not on the generated roles. Lets switch to the main
ceph-ansible repository for our Ceph deployments in order to ensure
that we are always using the latest code.

Change-Id: Ic907ee734a95e8af7c4c51568cc0870607b7b2f9

This patch updates all the roles to the latest available stable
SHA's, copies the release notes from the updated roles into the
integrated repo.

Change-Id: Iebe2dfd5b1a1fd8977d13075dfe7f841e6e416a0

Cloning from the official ODL git repository fails far too often with
the following error

fatal: unable to access 'https://git.opendaylight.org/gerrit/p/integration/packaging/ansible-opendaylight.git/': gnutls_handshake() failed: Error in the pull function

Lets switch to the github mirror which may be more reliable.

Change-Id: Ic73d92ad0535389a301d7cdedb6b167762cb416c

This reverts commit 0620efaf11.
Now that release can be tagged, we revert the freeze.

Change-Id: I92378448a04df5c338bd121a9e585a10fe892b95

Prepare for Release Queens-1

Change-Id: Iec908af26572323065132aa964ec25d71989bf2b

ceph-ansible has undergone significant refactoring in their v3
development, adding new required roles such as ceph-defaults and
ceph-config, which are used to provide vars and configuration to
the ceph service roles. These roles must be executed before the
service roles to avoid missing vars[1][2].

During the v3 refactoring, ceph-common was removed as a galaxy-style
role dependency in the service roles meta files[3]. This means we
will need to explicitly execute ceph-common from now on also.

This change adds the defaults and config roles and executes them.
Also some minor cleanup such as alphabetizing the OpenStack roles
list is done.

Also added is an upgrade playbook, reno, and docs to assist in
cleaning up the older galaxy-named ceph common roles which are
no longer galaxy namespaced in our cloning configuration.

[1] http://jenkins-logs.objects-us-dfw-1.cloud.lstn.net/osa-ci/490192/1/21/logs/console.log
[2] https://github.com/ceph/ceph-ansible/issues/1737
[3] https://github.com/ceph/ceph-ansible/pull/1727

Change-Id: Ia8c0cb0a23f331fce7914afbfc05ef54ee3ffb0e

The Pike UCA repo has been bumped to include the recently released
Ceph LTS, Luminous (12.x). Since the UCA repo is installed almost
globally in our deployment, this creates package conflicts when we
attempt to deploy the former Ceph LTS, Jewel (10.x) releases.

We will bump our Ceph stable release to the Luminous release for Pike
and later to avoid the package conflicts with UCA.

This also adds the ceph-mgr role execution since the ceph-mgr service
is required in Luminous. See http://docs.ceph.com/docs/master/mgr/ for
more information.

Change-Id: Ia3e2cd4eccf19f37442978ffe90cb54806b0a14b

Add a role which implements a general "Manage LB" listener which
will manage endpoint states in the haproxy servers when restarts
are notified for the mariadb servers.

Change-Id: I13c1e726cd9d182f0652c37f57adf36a3b2ad3aa

This patch provides the necessary files and changes in existing files to
deploy tacker component. Tacker is an orchestrator and VNF manager, which
is widely used as MANO component in NFV type of deployments

Change-Id: I339c9cc032f871766a89e24c2ada38063fc7ac39

 - Added dependency to 'opendaylight' role
 - New 'opendaylight' target group
 - Configuration of networking-odl version that matches neutron

Change-Id: I45ca9135341d7cc9e86776196c60bbfe7d7a4ed5

Change-Id: I8a738a3bce3134e7b9ed322ae7477fab0d771f47

This is needed to include the fix for virtualenv-tools on openSUSE

Change-Id: I79202fd5738943acc88112ae5624e243d8241fae

We may need a few more bumps - specifically for some upstream projects
that don't have a stable/pike branch yet. Namely:

swift
magnum
magnum_dashboard
nova-lxd
ceilometer
aodh
dragonflow

We should move to a SHA-bump approach from now to allow us to release
RC1 and further RCs without having to re-pin role SHA's.

Additionally, since the endpoint for placement has changed to / instead
of /placement the healthchk needs to anticipate a "401 - Unauthorized".

Change-Id: Iccc4d4b7aa3a69eb3c87e50aaae9ccb7b4b7135e

A massive refactor of ceph-ansible merged about 18 hours ago in
https://github.com/ceph/ceph-ansible/pull/1727, which breaks our
ceph gate. A patch already exists[1] which will adjust our ceph
deployment according to the upstream changes, however there is some
work to be done upstream[2] before our fix can merge. Until then,
to keep the OSA master gate unblocked, we should pin the ceph-ansible
roles immediately prior to the refactor commits.

[1] https://review.openstack.org/#/c/490476/
[2] https://github.com/ceph/ceph-ansible/pull/1740

Change-Id: Ie96984d207163404bb7f98cc10aa02a3035a362c

Now that Pike-3 has been released we should unpin the SHA's moving
towards a final release of stable/pike.

Change-Id: I3b3a84f0f2375783c1a181c8b6a0d07d635b26db
Depends-On: I0bd79b1b91bc45e84f300174a468ddcbfd60c647

For Pike Milestone 3 we need to fix the SHA's before we release.

Change-Id: I471a426442cf6913b21eb21b7e50138557bd6cfd