RETIRED, A Python library for code common to TripleO CLI and TripleO UI.
Go to file
Michele Baldessari 6f55c89171 Use oslo_rootwrap subprocess module in order to gain proper eventlet awareness
Via 31cfdbd407
oslo.rootwrap gained support eventlet when using subprocess. By moving
to oslo_rootwrap.subprocess we make sure that with python3 the
subprocess calls use eventlet.green.subprocess if eventlet is used.
This worked on python2 because (from above commit):
"""
On Python 2, it "works" to use directly subprocess: subprocess.Popen
calls os.pipe() and os.fdopen(fd) which are both monkey-patched. On
Python 3, it doesn't work because subprocess uses os.pipe() and
io.open(fd), and the io module is *not* monkey-patched at all.
"""

By applying this change what happens is that the heartbeat thread is
able to be scheduled every 15seconds by default. Without this patch
what we have been observing with python3 is that while running ansible
mistral would constantly log error messages like the following:
2019-05-02 19:14:36.702 8 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: amqp.exceptions.ConnectionForced: Too many heartbeats missed

With this change we could not reproduce this issue during a deployment
and no missed heartbeat messages were observed during the deploy.

Co-Authored-By: Damien Ciabrini <dciabrin@redhat.com>
Co-Authored-By: Hervé Beraud <hberaud@redhat.com>

Closes-Bug: #1826281

Change-Id: Id22b1465d6d2424d90781983b970aba4545feb8a
(cherry picked from commit 2e54cff0db)
2019-05-04 04:58:09 +02:00
ansible_plugins/callback Ansible json error callback plugin 2018-05-31 07:46:10 -04:00
container-images Update default Ceph container image to use to the Nautilus version 2019-04-25 13:06:08 +00:00
contrib Rename contrib to container-images for packaging 2017-04-07 16:56:29 +12:00
doc/source Merge "Fix Sphinx warnings on auto generated workbooks docs" 2019-02-19 16:22:56 +00:00
healthcheck Add new healthchecks for zaqar services 2019-05-01 14:40:11 +00:00
heat_docker_agent Remove /etc/os-net-config/config.json in os-apply-config 2018-03-22 18:44:00 -04:00
image-yaml Merge "don't install "yum-plugin-priorities" as it part of DNF" 2019-01-23 03:23:32 +00:00
playbooks playbooks/rotate-keys: add support for podman 2019-04-09 14:24:57 -04:00
releasenotes New health check for cron containers 2019-04-10 10:38:07 +02:00
roles tripleo-bootstrap: only enable network, not starting. 2019-04-28 18:10:14 +00:00
scripts Adding support for the new validation framework 2019-04-17 10:21:28 +02:00
tools Add bashate in gate jobs and fix existing errors 2018-09-17 11:36:57 +02:00
tripleo_common Use oslo_rootwrap subprocess module in order to gain proper eventlet awareness 2019-05-04 04:58:09 +02:00
undercloud_heat_plugins Add custom subclass to revert mapping 2018-03-27 12:33:24 +02:00
workbooks Remove amp_hw_arch from octavia_post 2019-04-11 14:33:49 +00:00
zuul.d turn voting/gating on scen009 master 2019-04-02 20:14:31 +00:00
.coveragerc Make coverage tests work 2015-11-30 23:01:07 +00:00
.gitignore [Configuration] Remove testrepository. 2019-01-23 10:00:19 +01:00
.gitreview Merge "Update .gitreview for stable/stein" into stable/stein 2019-04-26 06:43:31 +00:00
.mailmap Initial Cookiecutter Commit. 2015-04-29 13:34:49 +02:00
.stestr.conf Use stestr for unit tests 2018-11-18 21:39:33 +00:00
CONTRIBUTING.rst Fix non-exiting link to TripleO-common bugs 2018-11-27 08:29:25 +01:00
HACKING.rst Update the documentation link for doc migration 2017-07-25 15:00:27 +08:00
LICENSE Initial Cookiecutter Commit. 2015-04-29 13:34:49 +02:00
README.rst Update README to pass RST strict test 2018-08-24 07:39:52 -04:00
babel.cfg Initial Cookiecutter Commit. 2015-04-29 13:34:49 +02:00
lower-constraints.txt Use oslo_rootwrap subprocess module in order to gain proper eventlet awareness 2019-05-04 04:58:09 +02:00
requirements.txt Use oslo_rootwrap subprocess module in order to gain proper eventlet awareness 2019-05-04 04:58:09 +02:00
setup.cfg Merge "nova-less-deploy: implement deploy_roles workflow" 2019-03-13 00:24:31 +00:00
setup.py Updated from global requirements 2017-03-10 03:40:32 +00:00
sudoers Make validation inputs configurable via Mistral 2019-04-01 10:43:11 +00:00
test-requirements.txt Update hacking version 2018-12-31 16:54:36 +00:00
tox.ini Update UPPER_CONSTRAINTS_FILE for stable/stein 2019-04-18 14:57:22 +00:00

README.rst

Team and repository tags

image

tripleo-common

A common library for TripleO workflows.

Action Development

When developing new actions, you will checkout a copy of tripleo-common to an undercloud machine and add actions as needed. To test the actions they need to be installed and selected services need to be restarted. Use the following code to accomplish these tasks. :

sudo rm -Rf /usr/lib/python2.7/site-packages/tripleo_common*
sudo python setup.py install
sudo cp /usr/share/tripleo-common/sudoers /etc/sudoers.d/tripleo-common
sudo systemctl restart openstack-mistral-executor
sudo systemctl restart openstack-mistral-engine
# this loads the actions via entrypoints
sudo mistral-db-manage populate
# make sure the new actions got loaded
mistral action-list | grep tripleo

Workflow Development

When developing new workflows, you will need to reload the modified workflows, e.g the following will reload all the workflows from the default packaged location, or you can use a similar approach to replace only a single workbook while under development. :

for workbook in $(openstack workbook list -f value -c Name | grep tripleo); do
    openstack workbook delete $workbook
done
for workflow in $(openstack workflow list -f value -c Name | grep tripleo); do
    openstack workflow delete $workflow
done
for workbook in $(ls /usr/share/openstack-tripleo-common/workbooks/*); do
    openstack workbook create $workbook
done

Validations

Prerequisites

If you haven't installed the undercloud with the enable_validations set to true, you will have to prepare your undercloud to run the validations:

$ sudo pip install git+https://git.openstack.org/openstack/tripleo-validations
$ sudo yum install ansible
$ sudo useradd validations

Finally you need to generate an SSH keypair for the validation user and copy it to the overcloud's authorized_keys files:

$ mistral execution-create tripleo.validations.v1.copy_ssh_key

Running validations using the mistral workflow

Create a context.json file containing the arguments passed to the workflow:

{
  "validation_names": ["512e", "rabbitmq-limits"]
}

Run the tripleo.validations.v1.run_validations workflow with mistral client:

mistral execution-create tripleo.validations.v1.run_validations context.json

Running groups of validations

Create a context.json file containing the arguments passed to the workflow:

{
  "group_names": ["network", "post-deployment"]
}

Run the tripleo.validations.v1.run_groups workflow with mistral client:

mistral execution-create tripleo.validations.v1.run_groups context.json