403 Commits

Author SHA1 Message Date
Major Hayden
20801aa010
Suppress rsync warnings w/command
Ansible throws warnings when we use rsync with the command
module. This patch suppresses those warnings.

Change-Id: I42652318f128120b1ecec4781066c89ee9023636
2017-09-01 09:39:40 -05:00
Jenkins
38c6379524 Merge "Flag service for restart if the venv changes" 2017-08-22 17:23:28 +00:00
Nolan Brubaker
49b82a3573 Flag service for restart if the venv changes
Depends-On: I73ff5c97de03cab0cc040f7869379f18c1448b0a
Change-Id: I837e31e5f17b31d4cd6191df196acd3c91bfc91e
2017-08-22 14:50:07 +00:00
b4330eaa56 Update reno for stable/pike
Change-Id: I1ff7d69550a8080441906704130499052efea4ba
2017-08-21 10:34:17 +01:00
Markos Chandras
546378a730 tasks: swift_install: Fix virtualenv-tools issue on openSUSE
openSUSE is also suffering from the same virtualenv-tools issue so
we need to remove the existing python-2.7 symlink.

Link: https://github.com/fireteam/virtualenv-tools/issues/5
Related-Bug: #1637509
Partial-Bug: #1644629
Change-Id: I9011007d949ba4848c4e767b6cfab42e10eb1128
2017-08-17 11:09:03 +00:00
OpenStack Proposal Bot
3ad1be916f Updated from OpenStack Ansible Tests
Change-Id: Ic964ca1e38425dc799b1f50ef339c57702395f96
2017-08-17 05:00:39 +00:00
Major Hayden
76bdb799bf Add dnf support
This patch adds dnf support for CentOS.

Implements: blueprint centos-and-dnf
Change-Id: I8114ce7105ba252539c71c0b7fe1ddf73a672d29
2017-08-15 03:11:49 +00:00
Jenkins
4bd2bea7ec Merge "Use a list instead of a dict for filtered_services" 16.0.0.0rc1 2017-08-14 23:42:44 +00:00
Major Hayden
fa9f41f823
Optimize swift gate
This patch contains five combined improvements.

1) Remove RabbitMQ from the gate

RabbitMQ is only needed in the swift gate if the ceilometer
middleware is being deloyed. This isn't enabled in the gate
job, so let's save some time and deploy memcached/galera
without RabbitMQ.

2) Bindep pyOpenSSL change

This commit also includes the pyOpenSSL bindep change in the
hopes that we can get the swift gate moving along again. ;)

3) Disable erasure code test for CentOS

Due to #1707220 we are running into issues with CentOS 7 running Erasure
Code storage policies on RAX hardware.

This patch temoprarily disables EC testing for CentOS 7, but we can
re-enable that once the package is backported to stable/ocata branch.

4) Pass packages as a list

This patch passes a list of packages to the package module
rather than using "with_items" and it should speed up the
package installation process.

5) Set package state to present

Change-Id: Ic7b13853ce00b0f8ac2181e46e2bd8dea5ce377e
Co-Authored-By: Andy McCrae <andy.mccrae@gmail.com>
2017-08-09 08:43:25 -05:00
OpenStack Proposal Bot
7799a534b7 Updated from OpenStack Ansible Tests
Change-Id: I7de6a24013a06897176adffb86cd1a9f7f8ff5be
2017-07-31 19:11:31 +00:00
Andy McCrae
d860153400 Use a list instead of a dict for filtered_services
Swift should mirror other roles and use a list instead of a dictionary
for it's filtered_services.

This patch makes that change.

Change-Id: Ie6bf282a36ed63d73996447a88c3c5f6056465a7
2017-07-31 17:24:34 +01:00
OpenStack Proposal Bot
1e7f5220a4 Updated from global requirements
Change-Id: I9ab063f9b36e5ab52fa263c85b2882e4dd9d1f62
2017-07-28 21:44:48 +00:00
OpenStack Proposal Bot
e76f0c79f2 Updated from OpenStack Ansible Tests
Change-Id: I872b9a1644c5ba3bc8d708ea1d5c12e1ec7f5a7b
2017-07-28 15:00:55 +00:00
Charles Farquhar
8b2fc7afc7 Fix ordering of swift3 in middleware pipeline
Beginning with commit 6ffcc29 of swift3, the swift3 and s3token middlewares
must come between authtoken and keystoneauth in the swift proxy pipeline.

When 6ffcc29 was committed, reordering was optional at the expense of an
unneceessary call to keystone.  However, the change becomes mandatory when using
keystone v3 tokens.  Without this change, authtoken will strip the necessary
headers that s3token just added to the environment.

Change-Id: Ic7d07d869aa617ee00190a9aedf411017539b97b
2017-07-27 15:52:58 -05:00
Jenkins
3d615b3b92 Merge "Update URLs in documents according to document migration" 16.0.0.0b3 2017-07-17 16:32:27 +00:00
Markos Chandras
5a3ee5489b Add support for the openSUSE Leap distributions
Add support for the openSUSE Leap distributions. Nothing special is
required for this except for adding the appropriate distro variables
file and also update the zypper cache before package installation.
Moreover, the syslog user belongs to the 'users' group instead of a
dedicated 'syslog' group so we adjust the defaults for openSUSE.

Depends-On: I96c02fb2ee26691f1d7dd449d7205baa231795fe
Change-Id: I86beac2b3e038a0a4a3bf9618218bc1e393bdf08
2017-07-14 10:37:58 +01:00
ZhongShengping
1f717c9065 Update URLs in documents according to document migration
Change-Id: Iec0908b8a4db3faa9dc4bf40082f0f898e8b779b
2017-07-14 14:08:15 +08:00
Jesse Pretorius
01c3728efc Optimise the execution of the role
This patch implements the use of dynamic includes,
the filtered service list and the elimination of
redundant tasks in order to optimise the role
execution.

Change-Id: Ia957bd80ec6a97a29b4b3a1c28bf37dfc9226ab1
2017-07-07 17:52:12 +01:00
OpenStack Proposal Bot
5f65131dae Updated from OpenStack Ansible Tests
Change-Id: Iaeed811ccbcd7e668c6ba25aecbbee8e1791ff00
2017-07-06 21:08:54 +00:00
Jenkins
2b4f6a3a4d Merge "Don't run sync in upgrades" 2017-07-06 17:00:27 +00:00
OpenStack Proposal Bot
dc8603a931 Updated from OpenStack Ansible Tests
Change-Id: Ic8bb76ea569984673145f250a76dea4640a7628d
2017-07-06 13:03:06 +00:00
Nolan Brubaker
176452bebf Don't run sync in upgrades
When running a rolling upgrade, each swift node is addressed
individually. This can result in undefined variables when a node doesn't
have the necessary SSH and ring information.

For minor upgrades, these changes are not necessary. They are only
necessary in fresh installs, or modifying storage capacity. Thus, this
patch checks to see if it's a new install (no swift venv_tag previously
defined) or it's the same version (current venv tag matches the previous
one) and only does syncs in those cases.

Change-Id: Ice3b4526609f5a5fd4472c8408de9ed08aea29e6
2017-07-05 15:10:01 +00:00
ZhongShengping
52228ba571 Fix openstackdocstheme settings
To use openstackdocstheme 1.11.0 properly, this patch fixes
some settings according to follow[0].

[0]https://docs.openstack.org/openstackdocstheme/latest/

Change-Id: I7ef76fd6e6fe79d12bc57eabe0b120ab10d6d429
2017-07-03 16:22:24 +08:00
OpenStack Proposal Bot
3b91c62e1d Updated from global requirements
Change-Id: I85faa158df291a669ddbb1ce1553392b218e410e
2017-06-27 12:18:39 +00:00
ZhongShengping
0c1373609b Switch from oslosphinx to openstackdocstheme
As part of the docs migration work[0] for Pike we need to switch to use the
openstackdocstheme.

[0]https://review.openstack.org/#/c/472275/

Change-Id: Ia3d468d5ed5c31314a20cf1c7b4b6a9829628064
2017-06-26 11:39:11 +08:00
Charles Farquhar
14c57dd419 Add support for swift3 middleware
This commit adds support for the swift3 middware, which allows S3-compatible
clients to use swift for object storage.

Change-Id: I56cd63057cc771310b69c311d975e06f73c773f7
Related-Bug: 1625053
2017-06-23 18:26:46 +00:00
OpenStack Proposal Bot
ec7448f57c Updated from OpenStack Ansible Tests
Change-Id: I2887e9bda1f6ce462c66f849133639f263a42248
2017-06-22 15:20:04 +00:00
OpenStack Proposal Bot
9654dbf49e Updated from global requirements
Change-Id: I2e62ba68e0761e396694069b7244ea29d165cf25
2017-06-12 12:59:51 +00:00
OpenStack Proposal Bot
8e1da2c912 Updated from global requirements
Change-Id: I6bb1d046c4c93481f2d6a4c877301c52e30a4dff
2017-06-10 21:45:17 +00:00
Jenkins
f4ac852490 Merge "Ensure that role tests pin pip/setuptools/wheel" 2017-06-07 22:11:18 +00:00
Jenkins
03c69f191e Merge "Add Swift API availability test during upgrade" 2017-06-07 21:27:30 +00:00
Jesse Pretorius
b14497f8aa Switch to Cryptography over pycrypto
The keystonemiddleware library recently switched to using the
cryptography library over pycrypto, which was unmaintained. See
Iced7f5115e49ccf4f7f5bf6813cb5988b95c248b

Change-Id: Ib492bce6df005e8b4e824352e523d2d80c1a8839
Co-Authored-By: Nolan Brubaker <nolan.brubaker@rackspace.com>
2017-06-07 17:58:32 +00:00
Nolan Brubaker
e8388fd4cb Add Swift API availability test during upgrade
Run API tests while upgrading the service and report the results once
finished.

Change-Id: I02339d0ae182c07fb2f136ad23f0ec02672cdbe8
2017-06-06 16:47:03 -04:00
Jesse Pretorius
062260a55f Ensure that role tests pin pip/setuptools/wheel
Currently the role tests use whatever versions of pip,
setuptools and wheel are already installed on the host.

When a version of these tools changes it often causes
problems for our testing.

This will ensure that we use a known good set of pins
which is maintained in the general SHA bumping process.

Change-Id: Ib62f4c84bcfe62442e94671422860b5eec1222a3
2017-06-04 11:22:59 +01:00
OpenStack Proposal Bot
e931454b7d Updated from global requirements
Change-Id: Ib220bc81fd0904022667c3e177dd0dac65b30806
2017-06-02 22:03:44 +00:00
Andy McCrae
5de40ebea4 Use upper constraints when installing test requirements
Change-Id: I78dcbcd59c298ac165eab9e15788d408cc344115
16.0.0.0b2
2017-06-02 12:34:51 +01:00
Andy McCrae
33fc6b7673 Allow the developer constraints to be adjusted
In order to do a developer mode that allows installation of packages
from local file, which take precedence over the developer_mode
constraints, we need to allow the order of the constraints to be
changed.

This patch adds a "pip_install_developer_constraints" var which is used
to set the developer mode constraints. By default this will leave the
same behaviour but will allow additional constraints to be added, or the
developermode constraints file to be overriden altogether.

Change-Id: I67f880def4b16e519865cc18937807e80b0b82c8
2017-05-26 11:59:33 +01:00
Jesse Pretorius
39c16e1148 Add venv_tag local fact
In order to make it easier to detect the currently deployed
venv for a service, and therefore allow smarter decisions
for things like upgrading, we implement the venv tag as a
local fact.

The file used to store facts will be the same for all
OpenStack services, with each service using its own section.

Example:

"ansible_local": {
    "openstack_ansible": {
        "swift": {
            "venv_tag": "14.2.1"
        }
    }
}

Change-Id: I54f6317ba1b82c29a2b64c59e64cc7a34a82e880
2017-05-22 14:51:58 +00:00
OpenStack Proposal Bot
e568e120f1 Updated from global requirements
Change-Id: I48845edf33014f7abb57a72e97e69cc9bd607c38
2017-05-17 03:55:18 +00:00
Rick Box
14d1a2feb8 Fix for lookup and get_url occuring in different places
We use an SSH bastion host which we do our deployment through. The
deployment host doesn't have direct access to the same network as the
host. As a result the venv local checksum lookup fails.

I have described this here:

https://bugs.launchpad.net/openstack-ansible/+bug/1689283

This is a simple fix for this problem, assuming everything is good it
will need repeating in multiple places in the code base.

Change-Id: Ib0693f6ff28e2f9e9b2befbd1abc05945a7b6d61
2017-05-10 14:17:35 +01:00
Jesse Pretorius
49d9c4a71a Use zuul-cloner for tests repo in OpenStack-CI
When executing the tests repo clone in OpenStack-CI,
use zuul-cloner instead of git to enable cross-repo
testing. This ensures that if a dependent patch from
the tests repo is noted using 'Depends-On: <change-id>'
in the commit message, that patch will be included.

Change-Id: Ie1a48685f48cd5074031d58478a541967a01be42
Depends-On: Idce7abebf32f24c356a27e099fbca954d917402b
2017-05-04 17:40:00 +00:00
Jesse Pretorius
5bf8389219 Rename release note to unique hash
Change-Id: Icf5fda2c7c0ff0b8b04f2b1f01620180f3ce2f16
2017-04-28 11:40:02 +01:00
Jenkins
5043a6d43f Merge "Set defaults for swift_vars and swift_proxy_vars" 2017-04-26 21:02:28 +00:00
Jenkins
2d6d509294 Merge "Filter services dictionary per host" 2017-04-26 20:35:45 +00:00
Jimmy McCrory
dbd37c4337 Set defaults for swift_vars and swift_proxy_vars
Use the defaults file to set the 'swift_vars' and 'swift_proxy_vars'
variables instead of set_fact tasks.

Change-Id: I52636950652180c4192ad7596dc96c397a7c78f9
2017-04-26 17:11:55 +00:00
Jimmy McCrory
acdbf6bc38 Filter services dictionary per host
To greatly reduce the amount of log noise from skipped tasks, set a
var in the role that filters the 'swift_services' dict to one that only
contains services relevant for each host.

Change-Id: Ib4e7d398ce2b34e560520d0266dc67bed653cc5c
2017-04-26 17:11:48 +00:00
Jesse Pretorius
22a4a72afb Reduce init restart/kill times
The systemd unit 'TimeoutSec' value which controls the time
between sending a SIGTERM signal and a SIGKILL signal when
stopping or restarting the service has been reduced from 300
seconds to 120 seconds. This provides 2 minutes for long-lived
sessions to drain while preventing new ones from starting
before a restart or a stop.

The 'RestartSec' value which controls the time between the
service stop and start when restarting has been reduced from
150 seconds to 2 seconds to make the restart happen faster.

These values can be adjusted by using the *_init_config_overrides
variables which use the config_template task to change template
defaults.

Change-Id: I048b877e859ad744dc54f19a93afdd89f8ef1661
2017-04-26 17:04:04 +00:00
Jesse Pretorius
49c3e0b727 Optimise apt cache update task
The update of the apt cache and the package installation
can all be handled in a single task by providing the
package action plugin with the right parameters. This
removes an extra task to optimise execution.

The minimum Ansible version is raised to 2.2 due to a
known bug [1] in Ansible's apt module which does not
update the cache properly if the cache update and the
install are combined in a single task.

[1] https://github.com/ansible/ansible-modules-core/issues/1497

Change-Id: I532d866286d4cb885e1f3696819455cbdc8c0c39
2017-04-24 16:57:19 +00:00
Jimmy McCrory
9e1824d3be Fix role gate tests for Ansible 2.3
'ansible_become' defined as a host_var or in the inventory for a host
has a higher precedence than 'become' defined within a playbook.

In change Id5b76a87809f03951c954fc3d752419a673403f7, 'become' was
defined explicitly for each play running against localhost so
'ansible_become' should be removed from its host_vars.

Change-Id: I3b56a8c2df670423a2cb4e473379028e23bb01bd
2017-04-23 00:43:38 -07:00
Andy McCrae
e54538cd17 Rename reno to avoid conflict on integrated repo
Change-Id: I3230eae9838c72058d29936345247ce402b46e57
2017-04-11 12:12:39 +01:00