tripleo-heat-templates/docker/services
James Slagle cba00abb75 Separate config_volume for ringbuilder
Use a separate config_volume for swift_ringbuilder puppet_config tasks.
This is necessary so that the swift_ringbuilder and swift-storage
services don't both rsync files to the same bind mounted directory.

The rsync command from docker-puppet.py uses --delete-after, so when
they both use the same config_volume, they can end up deleting the files
generated by the other (depending on the order of execution).

Even though a separate config_volume is used, the rings must still end up
in /etc/swift for the swift services containers.  An additional
container init task is used to copy the ring files into
/var/lib/config-data/puppet-generated/swift/etc/swift so that they will
be present when the actual swift services containers are started.

Change-Id: I05821e76191f64212704ca8e3b7428cda6b3a4b7
Closes-Bug: #1710952
2017-08-28 16:04:45 +00:00
..
ceph-ansible Merge "More fixes for the Ceph docker images url parsing" 2017-08-23 23:24:58 +00:00
database Merge "Enable TLS for containerized MySQL" 2017-08-17 16:08:31 +00:00
pacemaker Tag the ha containers with 'pcmklatest' at deploy time 2017-08-18 15:59:17 +02:00
aodh-api.yaml Bind mount tripleo.cnf in transient bootstrap containers 2017-08-14 10:53:16 +00:00
aodh-evaluator.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
aodh-listener.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
aodh-notifier.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
barbican-api.yaml Containarise Barbican API 2017-08-24 17:11:53 +05:30
ceilometer-agent-central.yaml Correct gnocchi-upgrade command quotes 2017-08-11 15:01:27 -04:00
ceilometer-agent-compute.yaml docker: Stop all active ceilometer services during compute upgrade 2017-08-16 12:10:29 +01:00
ceilometer-agent-ipmi.yaml Merge "Use a single configuration file for specifying docker containers." 2017-07-15 06:19:13 +00:00
ceilometer-agent-notification.yaml Merge "Use a single configuration file for specifying docker containers." 2017-07-15 06:19:13 +00:00
cinder-api.yaml Remove baremetal cron jobs on docker upgrade 2017-08-03 10:20:57 -04:00
cinder-backup.yaml Cinder volume/backup containers shouldn't mount two paths at same point 2017-08-02 02:54:56 +00:00
cinder-scheduler.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
cinder-volume.yaml Cinder volume/backup containers shouldn't mount two paths at same point 2017-08-02 02:54:56 +00:00
collectd.yaml Merge "Make collectd run as root inside the container" 2017-07-27 06:07:26 +00:00
congress.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
containers-common.yaml Fix CA file bind mounting in containers 2017-08-01 07:28:33 +00:00
ec2-api.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
etcd.yaml Merge "Use a single configuration file for specifying docker containers." 2017-07-15 06:19:13 +00:00
glance-api.yaml Mount NFS volume to docker container. 2017-08-10 06:51:18 +00:00
gnocchi-api.yaml Bind mount tripleo.cnf in transient bootstrap containers 2017-08-14 10:53:16 +00:00
gnocchi-metricd.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
gnocchi-statsd.yaml Mount ceph config on gnocchi statsd 2017-08-18 21:22:34 +00:00
haproxy.yaml Enable TLS for containerized haproxy 2017-08-14 15:06:14 +00:00
heat-api-cfn.yaml Stop Heat WSGI services on docker upgrade 2017-07-19 06:21:30 -07:00
heat-api.yaml Remove baremetal cron jobs on docker upgrade 2017-08-03 10:20:57 -04:00
heat-engine.yaml Bind mount tripleo.cnf in transient bootstrap containers 2017-08-14 10:53:16 +00:00
horizon.yaml TLS for containerized horizon 2017-08-21 12:30:58 +00:00
ironic-api.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
ironic-conductor.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
ironic-pxe.yaml Merge "Use a single configuration file for specifying docker containers." 2017-07-15 06:19:13 +00:00
iscsid.yaml Remove empty metadata_settings from iscsid and multipathd templates 2017-08-01 08:44:32 +03:00
keystone.yaml Remove baremetal cron jobs on docker upgrade 2017-08-03 10:20:57 -04:00
logrotate-crond.yaml Fix configuration files path for logrotate container 2017-08-22 11:55:19 +02:00
manila-api.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
manila-scheduler.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
manila-share.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
memcached.yaml Merge "Use a single configuration file for specifying docker containers." 2017-07-15 06:19:13 +00:00
mistral-api.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
mistral-engine.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
mistral-executor.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
multipathd.yaml Fix up multipath docker indentation 2017-08-02 11:55:23 +02:00
neutron-api.yaml Bind mount tripleo.cnf in transient bootstrap containers 2017-08-14 10:53:16 +00:00
neutron-dhcp.yaml Mount /var/lib/neutron in neutron agents for metadata proxy 2017-07-21 16:09:42 -02:30
neutron-l3.yaml Mount /var/lib/neutron in neutron agents for metadata proxy 2017-07-21 16:09:42 -02:30
neutron-metadata.yaml Mount /var/lib/neutron in neutron agents for metadata proxy 2017-07-21 16:09:42 -02:30
neutron-ovs-agent.yaml Merge "Use a single configuration file for specifying docker containers." 2017-07-15 06:19:13 +00:00
neutron-plugin-ml2.yaml Merge "Use a single configuration file for specifying docker containers." 2017-07-15 06:19:13 +00:00
nova-api.yaml Merge "Remove baremetal cron jobs on docker upgrade" 2017-08-24 18:08:52 +00:00
nova-compute.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
nova-conductor.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
nova-consoleauth.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
nova-ironic.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
nova-libvirt.yaml Docker: Enable TLS in the internal network for libvirt 2017-08-23 05:10:58 +00:00
nova-metadata.yaml Restore and split nova metadata docker service out of nova-api. 2017-08-18 02:13:17 +01:00
nova-migration-target.yaml Add support for nova live/cold-migration with containers 2017-07-23 02:26:55 +01:00
nova-placement.yaml Enable TLS for nova api and placement containers 2017-08-11 05:00:02 +00:00
nova-scheduler.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
nova-vnc-proxy.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
octavia-api.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
octavia-health-manager.yaml Merge "Use a single configuration file for specifying docker containers." 2017-07-15 06:19:13 +00:00
octavia-housekeeping.yaml Merge "Use a single configuration file for specifying docker containers." 2017-07-15 06:19:13 +00:00
octavia-worker.yaml Merge "Use a single configuration file for specifying docker containers." 2017-07-15 06:19:13 +00:00
opendaylight-api.yaml Cleans up exec workaround for ODL container clustering 2017-07-21 11:53:32 -04:00
ovn-controller.yaml Support deploying OVN as container services 2017-08-23 18:18:04 +05:30
ovn-dbs.yaml Support deploying OVN as container services 2017-08-23 18:18:04 +05:30
panko-api.yaml Bind mount tripleo.cnf in transient bootstrap containers 2017-08-14 10:53:16 +00:00
rabbitmq.yaml Enable TLS for containerized RabbitMQ 2017-08-18 12:21:31 +00:00
README.rst Add support for running crontabs in containers 2017-07-12 11:01:07 +01:00
sahara-api.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
sahara-engine.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
sensu-client.yaml Merge "Use a single configuration file for specifying docker containers." 2017-07-15 06:19:13 +00:00
swift-proxy.yaml Merge "Use a single configuration file for specifying docker containers." 2017-07-15 06:19:13 +00:00
swift-ringbuilder.yaml Separate config_volume for ringbuilder 2017-08-28 16:04:45 +00:00
swift-storage.yaml Stop also openstack-swift-object-expirer when upgrading swift services 2017-07-18 12:20:32 +02:00
tacker.yaml Generate MySQL client config if service requires database 2017-07-27 13:41:13 -04:00
zaqar.yaml Zaqar: Match service name with service-net-map 2017-08-22 15:36:25 +03:00

Docker Services

TripleO docker services are currently built on top of the puppet services. To do this each of the docker services includes the output of the t-h-t puppet/service templates where appropriate.

In general global docker specific service settings should reside in these templates (templates in the docker/services directory.) The required and optional items are specified in the docker settings section below.

If you are adding a config setting that applies to both docker and baremetal that setting should (so long as we use puppet) go into the puppet/services templates themselves.

Building Kolla Images

TripleO currently relies on Kolla docker containers. Kolla supports container customization and we are making use of this feature within TripleO to inject puppet (our configuration tool of choice) into the Kolla base images. The undercloud nova-scheduler also requires openstack-tripleo-common to provide custom filters.

To build Kolla images for TripleO adjust your kolla config1 to build your centos base image with puppet using the example below:

$ cat template-overrides.j2 {% extends parent_template %} {% set base_centos_binary_packages_append = ['puppet'] %} {% set nova_scheduler_packages_append = ['openstack-tripleo-common'] %}

kolla-build --base centos --template-override template-overrides.j2

Docker settings

Each service may define an output variable which returns a puppet manifest snippet that will run at each of the following steps. Earlier manifests are re-asserted when applying latter ones.

  • config_settings: This setting is generally inherited from the puppet/services templates and only need to be appended to on accasion if docker specific config settings are required.

  • step_config: This setting controls the manifest that is used to create docker config files via puppet. The puppet tags below are used along with this manifest to generate a config directory for this container.

  • kolla_config: Contains YAML that represents how to map config files into the kolla container. This config file is typically mapped into the container itself at the /var/lib/kolla/config_files/config.json location and drives how kolla's external config mechanisms work.

  • docker_config: Data that is passed to the docker-cmd hook to configure a container, or step of containers at each step. See the available steps below and the related docker-cmd hook documentation in the heat-agents project.

  • puppet_config: This section is a nested set of key value pairs that drive the creation of config files using puppet. Required parameters include:

    • puppet_tags: Puppet resource tag names that are used to generate config files with puppet. Only the named config resources are used to generate a config file. Any service that specifies tags will have the default tags of 'file,concat,file_line,augeas,cron' appended to the setting. Example: keystone_config
    • config_volume: The name of the volume (directory) where config files will be generated for this service. Use this as the location to bind mount into the running Kolla container for configuration.
    • config_image: The name of the docker image that will be used for generating configuration files. This is often the same container that the runtime service uses. Some services share a common set of config files which are generated in a common base container.
    • step_config: This setting controls the manifest that is used to create docker config files via puppet. The puppet tags below are used along with this manifest to generate a config directory for this container.
  • docker_puppet_tasks: This section provides data to drive the docker-puppet.py tool directly. The task is executed only once within the cluster (not on each node) and is useful for several puppet snippets we require for initialization of things like keystone endpoints, database users, etc. See docker-puppet.py for formatting.

Docker steps

Similar to baremetal docker containers are brought up in a stepwise manner. The current architecture supports bringing up baremetal services alongside of containers. For each step the baremetal puppet manifests are executed first and then any docker containers are brought up afterwards.

Steps correlate to the following:

Pre) Containers config files generated per hiera settings. 1) Load Balancer configuration baremetal a) step 1 baremetal b) step 1 containers 2) Core Services (Database/Rabbit/NTP/etc.) a) step 2 baremetal b) step 2 containers 3) Early Openstack Service setup (Ringbuilder, etc.) a) step 3 baremetal b) step 3 containers 4) General OpenStack Services a) step 4 baremetal b) step 4 containers c) Keystone containers post initialization (tenant,service,endpoint creation) 5) Service activation (Pacemaker) a) step 5 baremetal b) step 5 containers


  1. See the override file which can be used to build Kolla packages that work with TripleO, and an `example build script <https://github.com/dprince/undercloud_containers/blob/master/build_kolla.sh>_.↩︎