tripleo-heat-templates/puppet/services
Emilien Macchi 7c84a9b390 upgrades/validation: only run validation when services exist
During upgrades, validation test if a service is running before the
upgrade process starts.
In some cases, servies doesn't exist yet so we don't want to run the
validation.

This patch makes sure we check if the service is actually present on the
system before validating it's running correctly.

Also it makes sure that services are enabled before trying to stop them.
It allows use-cases where we want to add new services during an upgrade.
Also install new packages of services added in Ocata, so we can validate
upgrades on scenarios jobs.

Change-Id: Ib48fb6b1557be43956557cbde4cbe26b53a50bd8
2017-03-01 19:49:00 +00:00
..
database mysqlclient: Use actual parameter in puppet to set bind-address 2017-02-28 14:48:38 +02:00
disabled Put service stop at step1 and quiesce at step2. 2017-02-28 19:20:13 +01:00
logging upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
metrics upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
monitoring upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
network Re-organizes Contrail services to the correct roles 2017-02-08 20:25:41 +01:00
pacemaker Add Ceph RBD mirror Pacemaker profile 2017-01-26 12:24:56 +00:00
time Configuring a default ntp server. 2017-02-14 14:13:02 +01:00
README.rst Put service stop at step1 and quiesce at step2. 2017-02-28 19:20:13 +01:00
aodh-api.yaml Put service stop at step1 and quiesce at step2. 2017-02-28 19:20:13 +01:00
aodh-base.yaml Make the DB URIs host-independent for all services 2017-02-17 17:22:42 +01:00
aodh-evaluator.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
aodh-listener.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
aodh-notifier.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
apache-internal-tls-certmonger.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
apache.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
auditd.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
barbican-api.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
ca-certs.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
ceilometer-agent-central.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
ceilometer-agent-compute.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
ceilometer-agent-notification.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
ceilometer-api.yaml Put service stop at step1 and quiesce at step2. 2017-02-28 19:20:13 +01:00
ceilometer-base.yaml Make the DB URIs host-independent for all services 2017-02-17 17:22:42 +01:00
ceilometer-collector.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
ceilometer-expirer.yaml Remove openstack-ceilometer-expirer check 2017-02-03 13:12:27 +01:00
ceph-base.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
ceph-client.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
ceph-external.yaml Conform CephExternal template to the new hiera hook 2017-01-25 19:54:11 +00:00
ceph-mds.yaml Add support for the deployment of Ceph MDS 2017-01-10 17:30:16 +01:00
ceph-mon.yaml Add checks in ansible upgrade tasks for CephMon and CephOSD 2017-02-21 20:53:01 +00:00
ceph-osd.yaml Add checks in ansible upgrade tasks for CephMon and CephOSD 2017-02-21 20:53:01 +00:00
ceph-rgw.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
cinder-api.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
cinder-backend-dellps.yaml Composable services support for Cinder Dell EMC PS Series 2017-02-07 11:54:24 +00:00
cinder-backend-dellsc.yaml Composable service support for Cinder Dell EMC Storage Center 2017-02-03 12:07:33 -06:00
cinder-backend-scaleio.yaml Enables support for configuring Cinder with Dell EMC 2017-02-07 12:06:47 -06:00
cinder-backup.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
cinder-base.yaml Make the DB URIs host-independent for all services 2017-02-17 17:22:42 +01:00
cinder-hpelefthand-iscsi.yaml Check that all templates are using the release alias 2017-01-18 12:30:15 +01:00
cinder-scheduler.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
cinder-volume.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
congress.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
ec2-api.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
etcd.yaml Add etcd composable upgrade steps 2017-02-28 09:44:40 +01:00
glance-api.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
glance-base.yaml Remove Glance Registry service 2017-01-16 17:04:19 -05:00
gnocchi-api.yaml Put service stop at step1 and quiesce at step2. 2017-02-28 19:20:13 +01:00
gnocchi-base.yaml Make the DB URIs host-independent for all services 2017-02-17 17:22:42 +01:00
gnocchi-metricd.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
gnocchi-statsd.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
haproxy-internal-tls-certmonger.yaml Add metadata settings for needed kerberos principals 2017-01-25 00:33:11 +02:00
haproxy-public-tls-certmonger.yaml Add metadata settings for needed kerberos principals 2017-01-25 00:33:11 +02:00
haproxy.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
heat-api-cfn.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
heat-api-cloudwatch.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
heat-api.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
heat-base.yaml Make heat max_json_body_size configurable 2017-02-24 10:11:37 -05:00
heat-engine.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
horizon.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
ironic-api.yaml Put service stop at step1 and quiesce at step2. 2017-02-28 19:20:13 +01:00
ironic-base.yaml Make the DB URIs host-independent for all services 2017-02-17 17:22:42 +01:00
ironic-conductor.yaml Put service stop at step1 and quiesce at step2. 2017-02-28 19:20:13 +01:00
keepalived.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
kernel.yaml Adding the ip_conntrack_proto_sctp kernel module 2017-02-23 00:31:10 +02:00
keystone.yaml Put service stop at step1 and quiesce at step2. 2017-02-28 19:20:13 +01:00
manila-api.yaml Use Keystone internal endpoint instead of admin for services 2017-02-14 02:41:13 +00:00
manila-backend-cephfs.yaml Merge "Set manila cephfs backend if ceph is deployed" 2017-01-18 10:20:55 +00:00
manila-backend-generic.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
manila-backend-netapp.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
manila-base.yaml Make the DB URIs host-independent for all services 2017-02-17 17:22:42 +01:00
manila-scheduler.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
manila-share.yaml Use Keystone internal endpoint instead of admin for services 2017-02-14 02:41:13 +00:00
memcached.yaml Reduce memcached memory configuration 2017-02-12 14:39:37 -07:00
mistral-api.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
mistral-base.yaml Make the DB URIs host-independent for all services 2017-02-17 17:22:42 +01:00
mistral-engine.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
mistral-executor.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
neutron-api.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
neutron-base.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
neutron-compute-plugin-midonet.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
neutron-compute-plugin-nuage.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
neutron-compute-plugin-ovn.yaml OVN bridge mappings for tripleo 2017-02-14 21:56:41 +05:30
neutron-compute-plugin-plumgrid.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
neutron-dhcp.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
neutron-l3-compute-dvr.yaml Merge "neutron: don't set external_network_bridge option by default" 2017-02-23 00:06:28 +00:00
neutron-l3.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
neutron-metadata.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
neutron-midonet.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
neutron-ovs-agent.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
neutron-ovs-dpdk-agent.yaml Merge "Configure DPDK options to isolate PMD cores and ovs process cores" 2017-01-31 12:51:19 +00:00
neutron-plugin-ml2-fujitsu-cfab.yaml Bump missing template names to ocata 2017-01-17 17:04:49 +01:00
neutron-plugin-ml2-fujitsu-fossw.yaml Add THT for fossw ML2 plugin in networking-fujitsu 2017-01-19 12:55:47 -05:00
neutron-plugin-ml2-ovn.yaml OVN plugin configuration fixes 2017-02-02 21:30:38 +05:30
neutron-plugin-ml2.yaml Remove unused SR-IOV parameter NeutronSupportedPCIVendorDevs 2017-02-02 11:18:07 +05:30
neutron-plugin-nuage.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
neutron-plugin-plumgrid.yaml Make the DB URIs host-independent for all services 2017-02-17 17:22:42 +01:00
neutron-sriov-agent.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
nova-api.yaml Upgrade nova-api/scheduler/conductor packages at step3 not step2. 2017-02-24 17:25:28 +01:00
nova-base.yaml Make the DB URIs host-independent for all services 2017-02-17 17:22:42 +01:00
nova-compute.yaml Put service stop at step1 and quiesce at step2. 2017-02-28 19:20:13 +01:00
nova-conductor.yaml Put service stop at step1 and quiesce at step2. 2017-02-28 19:20:13 +01:00
nova-consoleauth.yaml Put service stop at step1 and quiesce at step2. 2017-02-28 19:20:13 +01:00
nova-ironic.yaml Use Keystone internal endpoint instead of admin for nova-ironic 2017-02-14 02:41:18 +00:00
nova-libvirt.yaml Configure VNC Server listen address through t-h-t 2017-02-01 22:35:42 +02:00
nova-metadata.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
nova-placement.yaml Put service stop at step1 and quiesce at step2. 2017-02-28 19:20:13 +01:00
nova-scheduler.yaml Put service stop at step1 and quiesce at step2. 2017-02-28 19:20:13 +01:00
nova-vnc-proxy.yaml Put service stop at step1 and quiesce at step2. 2017-02-28 19:20:13 +01:00
octavia-api.yaml Make the DB URIs host-independent for all services 2017-02-17 17:22:42 +01:00
octavia-base.yaml Add Octavia API service definitions 2017-01-18 15:14:54 -03:30
octavia-health-manager.yaml Introduce Octavia implementation services 2017-01-30 17:24:20 -03:30
octavia-housekeeping.yaml Introduce Octavia implementation services 2017-01-30 17:24:20 -03:30
octavia-worker.yaml Introduce Octavia implementation services 2017-01-30 17:24:20 -03:30
opendaylight-api.yaml Add OpenDaylightConnectionProtocol parameter to opendaylight-api service 2017-02-16 15:06:45 -05:00
opendaylight-ovs.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
ovn-dbs.yaml Bump missing template names to ocata 2017-01-17 17:04:49 +01:00
pacemaker.yaml Put service stop at step1 and quiesce at step2. 2017-02-28 19:20:13 +01:00
pacemaker_remote.yaml pacemaker remote profile support 2017-01-24 12:18:14 +01:00
panko-api.yaml Install openstack-panko-api on upgrade 2017-02-25 20:40:00 +01:00
panko-base.yaml Make the DB URIs host-independent for all services 2017-02-17 17:22:42 +01:00
rabbitmq.yaml Merge "Force epmd listening to a specific address" 2017-01-20 08:39:37 +00:00
sahara-api.yaml Put service stop at step1 and quiesce at step2. 2017-02-28 19:20:13 +01:00
sahara-base.yaml Make the DB URIs host-independent for all services 2017-02-17 17:22:42 +01:00
sahara-engine.yaml Put service stop at step1 and quiesce at step2. 2017-02-28 19:20:13 +01:00
services.yaml docker: new hybrid deployment architecture and configuration 2017-02-15 12:56:44 -05:00
snmp.yaml Put service stop at step1 and quiesce at step2. 2017-02-28 19:20:13 +01:00
sshd.yaml Adds SSH Banner text into sshd_config 2017-01-26 11:04:01 +00:00
swift-base.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
swift-proxy.yaml Put service stop at step1 and quiesce at step2. 2017-02-28 19:20:13 +01:00
swift-ringbuilder.yaml Auto-set SwiftMountCheck and SwiftUseLocalDir settings 2017-01-06 08:32:18 +01:00
swift-storage.yaml Put service stop at step1 and quiesce at step2. 2017-02-28 19:20:13 +01:00
tacker.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00
tripleo-firewall.yaml Bump template version for all templates to "ocata" 2016-12-23 11:43:39 +00:00
tripleo-packages.yaml Adds a step0 for pre upgrade-init checks 2017-01-13 12:34:57 +00:00
vpp.yaml Add VPP composable service 2017-02-26 16:43:26 -05:00
zaqar.yaml upgrades/validation: only run validation when services exist 2017-03-01 19:49:00 +00:00

README.rst

services

A TripleO nested stack Heat template that encapsulates generic configuration data to configure a specific service. This generally includes everything needed to configure the service excluding the local bind ports which are still managed in the per-node role templates directly (controller.yaml, compute.yaml, etc.). All other (global) service settings go into the puppet/service templates.

Input Parameters

Each service may define its own input parameters and defaults. Operators will use the parameter_defaults section of any Heat environment to set per service parameters.

Config Settings

Each service may define three ways in which to output variables to configure Hiera settings on the nodes.

  • config_settings: the hiera keys will be pushed on all roles of which the service is a part of.
  • global_config_settings: the hiera keys will be distributed to all roles
  • service_config_settings: Takes an extra key to wire in values that are defined for a service that need to be consumed by some other service. For example: service_config_settings: haproxy: foo: bar This will set the hiera key 'foo' on all roles where haproxy is included.

Deployment Steps

Each service may define an output variable which returns a puppet manifest snippet that will run at each of the following steps. Earlier manifests are re-asserted when applying latter ones.

  • config_settings: Custom hiera settings for this service.

  • global_config_settings: Additional hiera settings distributed to all roles.

  • step_config: A puppet manifest that is used to step through the deployment sequence. Each sequence is given a "step" (via hiera('step') that provides information for when puppet classes should activate themselves.

    Steps correlate to the following:

    1. Load Balancer configuration
    2. Core Services (Database/Rabbit/NTP/etc.)
    3. Early Openstack Service setup (Ringbuilder, etc.)
    4. General OpenStack Services
    5. Service activation (Pacemaker)

Batch Upgrade Steps

Each service template may optionally define a upgrade_batch_tasks key, which is a list of ansible tasks to be performed during the upgrade process.

Similar to the step_config, we allow a series of steps for the per-service upgrade sequence, defined as ansible tasks with a tag e.g "step1" for the first step, "step2" for the second, etc (currently only two steps are supported, but more may be added when required as additional services get converted to batched upgrades).

Note that each step is performed in batches, then we move on to the next step which is also performed in batches (we don't perform all steps on one node, then move on to the next one which means you can sequence rolling upgrades of dependent services via the step value).

The tasks performed at each step is service specific, but note that all batch upgrade steps are performed before the upgrade_tasks described below. This means that all services that support rolling upgrades can be upgraded without downtime during upgrade_batch_tasks, then any remaining services are stopped and upgraded during upgrade_tasks

The default batch size is 1, but this can be overridden for each role via the upgrade_batch_size option in roles_data.yaml

Upgrade Steps

Each service template may optionally define a upgrade_tasks key, which is a list of ansible tasks to be performed during the upgrade process.

Similar to the step_config, we allow a series of steps for the per-service upgrade sequence, defined as ansible tasks with a tag e.g "step1" for the first step, "step2" for the second, etc.

Steps/tages correlate to the following:

  1. Stop all control-plane services.

  2. Quiesce the control-plane, e.g disable LoadBalancer, stop pacemaker cluster: this will stop the following resource:

    • ocata:
      • galera
      • rabbit
      • redis
      • haproxy
      • vips
      • cinder-volumes
      • cinder-backup
      • manilla-share
      • rbd-mirror

    The exact order is controlled by the cluster constraints.

  3. Perform a package update and install new packages: A general upgrade is done, and only new package should go into service ansible tasks.

  4. Start services needed for migration tasks (e.g DB)

  5. Perform any migration tasks, e.g DB sync commands

Note that the services are not started in the upgrade tasks - we instead re-run puppet which does any reconfiguration required for the new version, then starts the services.

Nova Server Metadata Settings

One can use the hook of type OS::TripleO::ServiceServerMetadataHook to pass entries to the nova instances' metadata. It is, however, disabled by default. In order to overwrite it one needs to define it in the resource registry. An implementation of this hook needs to conform to the following:

  • It needs to define an input called RoleData of json type. This gets as input the contents of the role_data for each role's ServiceChain.
  • This needs to define an output called metadata which will be given to the Nova Server resource as the instance's metadata.