tripleo-heat-templates/docker/services
Rajesh Tailor e852186ee1 nova: Use LIBGUESTFS_BACKEND=direct
After change [1] nova-compute launch libguestfs using the default
``qemu:///system``, but when ``inject_password` is set to true and
user tries to create vm, the vm creation is successful and we could
see libguestfs error in nova-compute logs.

This change forces libvirt to use ``direct`` when launching instances
on host.

[1] Ib55936ea562dfa965be0764647e2b8e3fa309fd6

Change-Id: I195358742c19d6ea0a3d32979896c0268e3b55a6
Closes-bug: #1912141
(cherry picked from commit 67917bf650)
(cherry picked from commit 6a37431ced)
(cherry picked from commit 1484c45607)
(cherry picked from commit e26e6a1fb4)
2021-02-04 15:18:22 +00:00
..
ceph-ansible [Queens] Handle ceph service restart during update. 2021-01-07 10:18:47 +01:00
database Fix broken metadata_settings for redis templates 2019-08-02 17:49:11 +00:00
logging Make sure glance_api_tls_proxy logs are persisted on the host 2019-12-17 07:15:01 +00:00
metrics Add j2 per-role MetricsQdrNetwork 2020-08-07 14:22:29 +02:00
neutron neutron-cleanup skips ports marked skip_cleanup=true 2018-12-06 13:48:26 +00:00
octavia Update octavia playbooks parameters 2020-08-17 13:47:50 +02:00
pacemaker [Queens-only] Fix redis pull error on tls-e 2020-11-05 21:30:24 +01:00
skydive Remove hardcoded skydive container image 2017-11-27 10:21:17 +01:00
README.rst Run online data migrations 2018-09-10 10:55:58 +00:00
aodh-api.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
aodh-evaluator.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
aodh-listener.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
aodh-notifier.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
barbican-api.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
ceilometer-agent-central.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
ceilometer-agent-compute.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
ceilometer-agent-ipmi.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
ceilometer-agent-notification.yaml [TRAIN-ONLY] Finish Ceilometer-Panko decouple 2020-05-15 11:53:46 +02:00
cinder-api.yaml Ensure Cinder has a default volume type 2019-06-17 10:00:39 -04:00
cinder-backup.yaml Use ipc:host for cinder-backup 2020-03-04 10:12:20 +01:00
cinder-common.yaml Ensure logs folder is created in prep hosts tasks. 2019-01-22 13:59:29 +01:00
cinder-scheduler.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
cinder-volume.yaml [queens-only] Unmount cinder NFS shares during upgrade 2020-07-20 12:59:54 -07:00
congress.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
containers-common.yaml HA: fix <service>_restart_bundle with minor update workflow 2019-09-16 11:17:40 +02:00
derive_pci_passthrough_whitelist.py Generated passthrough_whitelist shall use all the user_configs fields 2020-07-29 11:41:22 +00:00
ec2-api.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
etcd.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
fluentd-client.yaml Update heat_template_version in templates, with stricter validation 2019-08-15 13:19:42 +01:00
fluentd.yaml Ensure logs folder is created in prep hosts tasks. 2019-01-22 13:59:29 +01:00
glance-api.yaml Pass image import conf file to command which runs glance server 2020-02-17 09:45:39 +00:00
gnocchi-api.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
gnocchi-metricd.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
gnocchi-statsd.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
haproxy.yaml Transitioning to HAProxy 1.8 2020-06-18 10:42:45 +02:00
heat-api-cfn.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
heat-api.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
heat-engine.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
horizon.yaml Use /var/tmp on host to store temporal files for image upload via Horizon 2019-08-29 08:04:53 +09:00
ironic-api.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
ironic-conductor.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
ironic-inspector.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
ironic-neutron-agent.yaml Add Ironic Networking Baremetal Templates 2019-08-22 18:55:26 +00:00
ironic-pxe.yaml Ensure logs folder is created in prep hosts tasks. 2019-01-22 13:59:29 +01:00
iscsid.yaml Create missing directories before mounting them 2019-08-08 16:39:45 +02:00
keepalived.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
keystone.yaml Update environment var for keystone bootstrap 2020-02-14 16:08:23 +00:00
logrotate-crond.yaml [Queens-only] Do not remove symlinks by containers-tmpwatch 2020-12-09 23:43:30 +09:00
manila-api.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
manila-common.yaml Unify the Manila HA and non-HA docker configurations 2018-07-16 13:43:34 +00:00
manila-scheduler.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
manila-share.yaml Fix Manila when run without pacemaker 2019-10-10 16:14:45 +00:00
memcached.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
mistral-api.yaml Merge "Convert ServiceNetMap evals to hiera interpolation" into stable/queens 2019-06-12 05:44:33 +00:00
mistral-engine.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
mistral-event-engine.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
mistral-executor.yaml Create missing directories before mounting them 2019-08-08 16:39:45 +02:00
multipathd.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
neutron-api.yaml Fix neutron api TLS logging 2019-12-17 07:15:10 +00:00
neutron-bgpvpn-api.yaml Adding docker service for BGPVPN Service Plugin 2018-02-09 11:21:32 +01:00
neutron-dhcp.yaml Create /run/netns if does not exist 2019-08-08 16:40:04 +02:00
neutron-l2gw-api.yaml Adding docker service for the L2GW 2018-02-09 11:26:44 +01:00
neutron-l3.yaml Enable "port_forwarding" feature in neutron ML2 ovs environment 2020-12-11 11:30:14 +00:00
neutron-lbaas-api.yaml Containerize Neutron LBaaS service plugin 2018-04-20 18:31:27 +00:00
neutron-metadata.yaml Add setfacl statements for neutron metadata proxy 2020-02-27 16:48:11 +00:00
neutron-ovs-agent.yaml Handle LP openvswitch meta-package on upgrade 2019-11-05 11:22:04 +05:30
neutron-ovs-dpdk-agent.yaml Added the missing attributes for roles_data of ovs-dpdk-agent docker service 2018-03-29 05:16:53 +00:00
neutron-plugin-ml2-ansible.yaml Add networking-ansible ML2 plugin support 2018-12-07 08:56:17 +00:00
neutron-plugin-ml2-cisco-vts.yaml Fixes certificate generation error for Neutron agents 2018-03-10 08:50:54 +00:00
neutron-plugin-ml2.yaml Parameterizing Puppet Tags 2018-04-30 20:31:25 -04:00
neutron-plugin-nsx.yaml Add config files/templates to integrate nsx plugin with container 2018-12-18 22:45:48 +00:00
neutron-sfc-api.yaml Adds docker SFC and cleans up ODL envs 2018-07-16 16:30:26 +03:00
neutron-sriov-agent.yaml Fixing the copy failure of derive_pci_passthrough_whitelist.py 2020-07-27 08:40:35 +00:00
nova-api.yaml [FFU] Use output parameter instead of hiera lookup for cell creation 2021-01-05 12:42:40 +01:00
nova-compute-common.yaml [Queens] Run cellv2 host discovery via workflow or deploy_steps_tasks 2019-10-08 12:00:42 +02:00
nova-compute.yaml nova: Use LIBGUESTFS_BACKEND=direct 2021-02-04 15:18:22 +00:00
nova-conductor.yaml Merge "Fail to live migration if instance has NUMA topology" into stable/queens 2019-07-15 18:37:14 +00:00
nova-consoleauth.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
nova-ironic.yaml [Queens] Run cellv2 host discovery via workflow or deploy_steps_tasks 2019-10-08 12:00:42 +02:00
nova-libvirt.yaml Use bind mounts for tls certificates 2020-12-18 10:47:15 +01:00
nova-metadata.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
nova-migration-target.yaml Add /run/libvirt to nova_migration_target container 2019-06-27 10:11:36 +02:00
nova-placement.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
nova-scheduler.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
nova-vnc-proxy.yaml Revert "Point InternalTLSVncCAFile to /etc/ipa/ca.crt" 2019-08-20 18:56:51 +00:00
octavia-api.yaml Use docker_container Ansible module 2019-08-20 09:22:24 +02:00
octavia-health-manager.yaml Simplify octavia post deploy configs 2020-01-08 15:44:22 +01:00
octavia-housekeeping.yaml Simplify octavia post deploy configs 2020-01-08 15:44:22 +01:00
octavia-worker.yaml Simplify octavia post deploy configs 2020-01-08 15:44:22 +01:00
opendaylight-api.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
ovn-controller.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
ovn-dbs.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
ovn-metadata.yaml Create /run/netns if does not exist 2019-08-08 16:40:04 +02:00
panko-api.yaml Add panko_api_cron container 2019-06-10 18:28:06 -04:00
qdrouterd.yaml Ensure logs folder is created in prep hosts tasks. 2019-01-22 13:59:29 +01:00
rabbitmq.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
rsyslog-sidecar.yaml Change template names to queens 2017-11-23 10:15:32 +01:00
sahara-api.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
sahara-engine.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
sensu-client.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
sshd.yaml Change template names to queens 2017-11-23 10:15:32 +01:00
swift-proxy.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
swift-ringbuilder.yaml Fix Swift ring file synchronization issue 2020-09-04 09:34:05 +02:00
swift-storage.yaml Create missing directories before mounting them 2019-08-08 16:39:45 +02:00
tacker.yaml [Rocky/Queens Only] Remove pre-upgrade validation tasks in cont services. 2019-06-04 14:07:47 +02:00
zaqar.yaml Resolve broken zaqar container caused by logging issues 2019-09-13 11:43:56 +02:00

README.rst

Docker Services

TripleO docker services are currently built on top of the puppet services. To do this each of the docker services includes the output of the t-h-t puppet/service templates where appropriate.

In general global docker specific service settings should reside in these templates (templates in the docker/services directory.) The required and optional items are specified in the docker settings section below.

If you are adding a config setting that applies to both docker and baremetal that setting should (so long as we use puppet) go into the puppet/services templates themselves.

Building Kolla Images

TripleO currently relies on Kolla docker containers. Kolla supports container customization and we are making use of this feature within TripleO to inject puppet (our configuration tool of choice) into the Kolla base images. The undercloud nova-scheduler also requires openstack-tripleo-common to provide custom filters.

To build Kolla images for TripleO adjust your kolla config1 to build your centos base image with puppet using the example below:

$ cat template-overrides.j2 {% extends parent_template %} {% set base_centos_binary_packages_append = ['puppet'] %} {% set nova_scheduler_packages_append = ['openstack-tripleo-common'] %}

kolla-build --base centos --template-override template-overrides.j2

Docker settings

Each service may define an output variable which returns a puppet manifest snippet that will run at each of the following steps. Earlier manifests are re-asserted when applying latter ones.

  • config_settings: This setting is generally inherited from the puppet/services templates and only need to be appended to on accasion if docker specific config settings are required.

  • kolla_config: Contains YAML that represents how to map config files into the kolla container. This config file is typically mapped into the container itself at the /var/lib/kolla/config_files/config.json location and drives how kolla's external config mechanisms work.

  • docker_config: Data that is passed to the docker-cmd hook to configure a container, or step of containers at each step. See the available steps below and the related docker-cmd hook documentation in the heat-agents project.

  • puppet_config: This section is a nested set of key value pairs that drive the creation of config files using puppet. Required parameters include:

    • puppet_tags: Puppet resource tag names that are used to generate config files with puppet. Only the named config resources are used to generate a config file. Any service that specifies tags will have the default tags of 'file,concat,file_line,augeas,cron' appended to the setting. Example: keystone_config
    • config_volume: The name of the volume (directory) where config files will be generated for this service. Use this as the location to bind mount into the running Kolla container for configuration.
    • config_image: The name of the docker image that will be used for generating configuration files. This is often the same container that the runtime service uses. Some services share a common set of config files which are generated in a common base container.
    • step_config: This setting controls the manifest that is used to create docker config files via puppet. The puppet tags below are used along with this manifest to generate a config directory for this container.
  • docker_puppet_tasks: This section provides data to drive the docker-puppet.py tool directly. The task is executed only once within the cluster (not on each node) and is useful for several puppet snippets we require for initialization of things like keystone endpoints, database users, etc. See docker-puppet.py for formatting.

Docker steps

Similar to baremetal docker containers are brought up in a stepwise manner. The current architecture supports bringing up baremetal services alongside of containers. For each step the baremetal puppet manifests are executed first and then any docker containers are brought up afterwards.

Steps correlate to the following:

Pre) Containers config files generated per hiera settings. 1) Load Balancer configuration baremetal a) step 1 baremetal b) step 1 containers 2) Core Services (Database/Rabbit/NTP/etc.) a) step 2 baremetal b) step 2 containers 3) Early Openstack Service setup (Ringbuilder, etc.) a) step 3 baremetal b) step 3 containers 4) General OpenStack Services a) step 4 baremetal b) step 4 containers c) Keystone containers post initialization (tenant,service,endpoint creation) 5) Service activation (Pacemaker), online data migration a) step 5 baremetal b) step 5 containers

Update steps:

All services have an associated update_tasks output that is an ansible snippet that will be run during update in an rolling update that is expected to run in a rolling update fashion (one node at a time)

For Controller (where pacemaker is running) we have the following states:
  1. Step=1: stop the cluster on the updated node;
  2. Step=2: Pull the latest image and retag the it pcmklatest
  3. Step=3: yum upgrade happens on the host.
  4. Step=4: Restart the cluster on the node
  5. Step=5: Verification: Currently we test that the pacemaker services are running.

Then the usual deploy steps are run which pull in the latest image for all containerized services and the updated configuration if any.

Note: as pacemaker is not containerized, the points 1 and 4 happen in puppet/services/pacemaker.yaml.

Fast-forward Upgrade Steps

Each service template may optionally define a fast_forward_upgrade_tasks key, which is a list of Ansible tasks to be performed during the fast-forward upgrade process. As with Upgrade steps each task is associated to a particular step provided as a variable and used along with a release variable by a basic conditional that determines when the task should run.

Steps are broken down into two categories, prep tasks executed across all hosts and bootstrap tasks executed on a single host for a given role.

The individual steps then correspond to the following tasks during the upgrade:

Prep steps:

  • Step=0: Check running services
  • Step=1: Stop the service
  • Step=2: Stop the cluster
  • Step=3: Update repos

Bootstrap steps:

  • Step=4: DB backups
  • Step=5: Pre package update commands
  • Step=6: Package updates
  • Step=7: Post package update commands
  • Step=8: DB syncs
  • Step=9: Verification

  1. See the override file which can be used to build Kolla packages that work with TripleO, and an `example build script <https://github.com/dprince/undercloud_containers/blob/master/build_kolla.sh>_.↩︎