RETIRED, Heat templates for deploying OpenStack
Go to file
Dan Prince 949d367dde Add DockerPuppetProcessCount defaults to 3
docker-puppet.py is very aggressive about running concurrently.
It uses python multiprocessing to run multiple config generating
containers at once. This seems to work well in general, but
in some cases... perhaps when the registry is slow or under
heavy load can cause timeouts to occur. Lately I'm seeing
several 'container did not start before the specified timeout'
errors that always seem to occur when config files are generated
(docker-puppet.py is initially executed.

A couple of things:

 -when config files are generated this is the first time
  most of the containers are pulled to each host machine
  during deployment

 -docker-puppet.py runs many of these processes at once. Some
  of them run faster, other not.

 -docker daemon's pull limit defaults to 3. This would throttle
  the above a bit perhaps contributing the the likelyhood of a timeout.

One solution that seems to work for me is to set the PROCESS_COUNT
in docker-puppet.py to 3. As this matches docker daemon's default
it is probably safer at the cost of being slightly slower in some
cases.

Change-Id: I17feb3abd9d36fe7c95865a064502ce9902a074e
Closes-bug: #1713188
2017-08-25 23:01:24 -04:00
ci Enable ceilometer compute agent 2017-08-25 13:50:18 +02:00
common Add DockerPuppetProcessCount defaults to 3 2017-08-25 23:01:24 -04:00
deployed-server Add script to create tripleo-admin on deployed servers 2017-08-08 08:07:19 +02:00
docker Merge "Containarise Barbican API" 2017-08-25 08:54:28 +00:00
environments Merge "Docker: Enable TLS in the internal network for libvirt" 2017-08-24 17:56:50 +00:00
extraconfig Workaround for RHEL registration as "localhost" 2017-08-17 14:27:30 -04:00
firstboot Merge "Don't curl metadata server in userdata example" 2017-08-09 04:41:12 +00:00
network Render port templates via j2 2017-08-21 19:42:45 +01:00
plan-samples Workflow input parameter update in plan-environment 2017-07-05 07:57:43 -04:00
puppet Merge "Add panko publisher in the event pipeline" 2017-08-25 23:13:57 +00:00
releasenotes Merge "Update reno for stable/pike" 2017-08-26 01:10:32 +00:00
roles Merge "Add Ceilometer API and Collector service to roles_data" 2017-08-23 00:10:37 +00:00
sample-env-generator Provide sample environment for composable roles 2017-08-17 09:00:02 -06:00
scripts Avoid awk error in hosts-config.sh for large deployments 2017-04-07 10:50:39 +01:00
tools Merge "Make UpgradeLevelNovaCompute parameters consistent" 2017-08-03 21:53:09 +00:00
tripleo_heat_templates Add ServiceData to hidden params 2017-08-11 16:35:28 -05:00
validation-scripts Tolerate network errors in pingtest retry logic 2017-06-30 11:56:55 +01:00
.gitignore Sample environment generator 2017-06-12 15:02:50 -05:00
.gitreview Update stackforge references to openstack 2013-08-17 22:57:57 -04:00
.testr.conf Sample environment generator 2017-06-12 15:02:50 -05:00
LICENSE Add license file 2014-01-20 11:58:20 +01:00
MANIFEST.in Add release configuration. 2013-10-22 17:49:35 +01:00
README.rst README: Fix CI coverage layout 2017-08-16 10:28:29 -07:00
all-nodes-validation.yaml Update the template_version alias for all the templates to pike. 2017-05-19 09:58:07 +02:00
babel.cfg Add release configuration. 2013-10-22 17:49:35 +01:00
bindep.txt Add in roles data validation 2017-07-07 09:51:40 -06:00
bootstrap-config.yaml Update the template_version alias for all the templates to pike. 2017-05-19 09:58:07 +02:00
capabilities-map.yaml Add support for Dell EMC Unity Cinder backend 2017-08-17 08:36:14 +00:00
default_passwords.yaml Update the template_version alias for all the templates to pike. 2017-05-19 09:58:07 +02:00
hosts-config.yaml Update the template_version alias for all the templates to pike. 2017-05-19 09:58:07 +02:00
j2_excludes.yaml Render port templates via j2 2017-08-21 19:42:45 +01:00
net-config-bond.yaml Render IP map and host maps according to network_data.yaml 2017-08-16 13:30:54 +01:00
net-config-bridge.yaml Render IP map and host maps according to network_data.yaml 2017-08-16 13:30:54 +01:00
net-config-linux-bridge.yaml Render IP map and host maps according to network_data.yaml 2017-08-16 13:30:54 +01:00
net-config-noop.yaml Render IP map and host maps according to network_data.yaml 2017-08-16 13:30:54 +01:00
net-config-static-bridge-with-external-dhcp.yaml Render IP map and host maps according to network_data.yaml 2017-08-16 13:30:54 +01:00
net-config-static-bridge.yaml Render IP map and host maps according to network_data.yaml 2017-08-16 13:30:54 +01:00
net-config-static.yaml Render IP map and host maps according to network_data.yaml 2017-08-16 13:30:54 +01:00
net-config-undercloud.yaml Render IP map and host maps according to network_data.yaml 2017-08-16 13:30:54 +01:00
network_data.yaml Keep dynamic network creation backward compatible. 2017-08-08 14:01:08 +02:00
overcloud-resource-registry-puppet.j2.yaml Add logrotate with crond service 2017-08-21 08:56:29 +02:00
overcloud.j2.yaml Merge "Render VIPs dynamically based on network_data.yaml" 2017-08-16 15:30:29 +00:00
plan-environment.yaml Add name and description fields to plan-environment.yaml 2017-04-12 17:25:40 +02:00
requirements.txt Add in roles data validation 2017-07-07 09:51:40 -06:00
roles_data.yaml Merge "Add Ceilometer API and Collector service to roles_data" 2017-08-23 00:10:37 +00:00
roles_data_undercloud.yaml Add logrotate with crond service 2017-08-21 08:56:29 +02:00
setup.cfg Drop deprecated templates/Makefile/merge.py 2015-11-25 15:00:13 -05:00
setup.py Updated from global requirements 2017-03-28 13:03:01 +00:00
test-requirements.txt Updated from global requirements 2017-07-19 22:32:37 +00:00
tox.ini Add in roles data validation 2017-07-07 09:51:40 -06:00

README.rst

Team and repository tags

image

tripleo-heat-templates

Heat templates to deploy OpenStack using OpenStack.

Features

The ability to deploy a multi-node, role based OpenStack deployment using OpenStack Heat. Notable features include:

  • Choice of deployment/configuration tooling: puppet, (soon) docker
  • Role based deployment: roles for the controller, compute, ceph, swift, and cinder storage
  • physical network configuration: support for isolated networks, bonding, and standard ctlplane networking

Directories

A description of the directory layout in TripleO Heat Templates.

  • environments: contains heat environment files that can be used with -e

    on the command like to enable features, etc.

  • extraconfig: templates used to enable 'extra' functionality. Includes

    functionality for distro specific registration and upgrades.

  • firstboot: example first_boot scripts that can be used when initially

    creating instances.

  • network: heat templates to help create isolated networks and ports
  • puppet: templates mostly driven by configuration with puppet. To use these

    templates you can use the overcloud-resource-registry-puppet.yaml.

  • validation-scripts: validation scripts useful to all deployment

    configurations

  • roles: example roles that can be used with the tripleoclient to generate

    a roles_data.yaml for a deployment See the roles/README.rst for additional details.

Service testing matrix

The configuration for the CI scenarios will be defined in tripleo-heat-templates/ci/ and should be executed according to the following table:

+----------------+-------------+-------------+-------------+-------------+-----------------++-------------+ | - | scenario001 | scenario002 | scenario003 | scenario004 | multinode-nonha | scenario007 | +================+=============+=============+=============+=============+=================+==============+ | keystone | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | glance | rbd | swift | file | swift + rbd | swift | file | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | cinder | rbd | iscsi | | | iscsi | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | heat | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | mysql | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | neutron | ovs | ovs | ovs | ovs | X | ovn | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | neutron-bgpvpn | | | | X | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | ovn | | | | | | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | neutron-l2gw | | | | X | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | rabbitmq | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | mongodb | X | X | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | redis | X | | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | haproxy | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | keepalived | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | memcached | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | pacemaker | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | nova | qemu | qemu | qemu | qemu | X | qemu | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | ntp | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | snmp | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | timezone | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | sahara | | | X | | | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | mistral | | | X | | | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | swift | | X | | | X | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | aodh | X | X | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | ceilometer | X | X | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | gnocchi | rbd | swift | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | panko | X | X | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | barbican | | X | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | zaqar | | X | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | ec2api | | X | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | cephrgw | | X | | X | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | tacker | X | | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | congress | X | | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | cephmds | | | | X | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | manila | | | | X | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | collectd | X | | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | fluentd | X | | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | sensu-client | X | | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+