3ebb05d987
docker-puppet.py is very aggressive about running concurrently.
It uses python multiprocessing to run multiple config generating
containers at once. This seems to work well in general, but
in some cases... perhaps when the registry is slow or under
heavy load can cause timeouts to occur. Lately I'm seeing
several 'container did not start before the specified timeout'
errors that always seem to occur when config files are generated
(docker-puppet.py is initially executed.
A couple of things:
-when config files are generated this is the first time
most of the containers are pulled to each host machine
during deployment
-docker-puppet.py runs many of these processes at once. Some
of them run faster, other not.
-docker daemon's pull limit defaults to 3. This would throttle
the above a bit perhaps contributing the the likelyhood of a timeout.
One solution that seems to work for me is to set the PROCESS_COUNT
in docker-puppet.py to 3. As this matches docker daemon's default
it is probably safer at the cost of being slightly slower in some
cases.
Change-Id: I17feb3abd9d36fe7c95865a064502ce9902a074e
Closes-bug: #1713188
(cherry picked from commit
|
||
---|---|---|
ci | ||
common | ||
deployed-server | ||
docker | ||
environments | ||
extraconfig | ||
firstboot | ||
network | ||
plan-samples | ||
puppet | ||
releasenotes | ||
roles | ||
sample-env-generator | ||
scripts | ||
tools | ||
tripleo_heat_templates | ||
validation-scripts | ||
.gitignore | ||
.gitreview | ||
.testr.conf | ||
LICENSE | ||
MANIFEST.in | ||
README.rst | ||
all-nodes-validation.yaml | ||
babel.cfg | ||
bindep.txt | ||
bootstrap-config.yaml | ||
capabilities-map.yaml | ||
default_passwords.yaml | ||
hosts-config.yaml | ||
j2_excludes.yaml | ||
net-config-bond.yaml | ||
net-config-bridge.yaml | ||
net-config-linux-bridge.yaml | ||
net-config-noop.yaml | ||
net-config-static-bridge-with-external-dhcp.yaml | ||
net-config-static-bridge.yaml | ||
net-config-static.yaml | ||
net-config-undercloud.yaml | ||
network_data.yaml | ||
overcloud-resource-registry-puppet.j2.yaml | ||
overcloud.j2.yaml | ||
plan-environment.yaml | ||
requirements.txt | ||
roles_data.yaml | ||
roles_data_undercloud.yaml | ||
setup.cfg | ||
setup.py | ||
test-requirements.txt | ||
tox.ini |
README.rst
Team and repository tags
tripleo-heat-templates
Heat templates to deploy OpenStack using OpenStack.
- Free software: Apache license
- Documentation: http://docs.openstack.org/developer/tripleo-docs
- Source: http://git.openstack.org/cgit/openstack/tripleo-heat-templates
- Bugs: http://bugs.launchpad.net/tripleo
Features
The ability to deploy a multi-node, role based OpenStack deployment using OpenStack Heat. Notable features include:
- Choice of deployment/configuration tooling: puppet, (soon) docker
- Role based deployment: roles for the controller, compute, ceph, swift, and cinder storage
- physical network configuration: support for isolated networks, bonding, and standard ctlplane networking
Directories
A description of the directory layout in TripleO Heat Templates.
- environments: contains heat environment files that can be used with -e
on the command like to enable features, etc.
- extraconfig: templates used to enable 'extra' functionality. Includes
functionality for distro specific registration and upgrades.
- firstboot: example first_boot scripts that can be used when initially
creating instances.
- network: heat templates to help create isolated networks and ports
- puppet: templates mostly driven by configuration with puppet. To use these
templates you can use the overcloud-resource-registry-puppet.yaml.
- validation-scripts: validation scripts useful to all deployment
configurations
- roles: example roles that can be used with the tripleoclient to generate
a roles_data.yaml for a deployment See the roles/README.rst for additional details.
Service testing matrix
The configuration for the CI scenarios will be defined in tripleo-heat-templates/ci/ and should be executed according to the following table:
+----------------+-------------+-------------+-------------+-------------+-----------------++-------------+ | - | scenario001 | scenario002 | scenario003 | scenario004 | multinode-nonha | scenario007 | +================+=============+=============+=============+=============+=================+==============+ | keystone | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | glance | rbd | swift | file | swift + rbd | swift | file | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | cinder | rbd | iscsi | | | iscsi | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | heat | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | mysql | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | neutron | ovs | ovs | ovs | ovs | X | ovn | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | neutron-bgpvpn | | | | X | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | ovn | | | | | | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | neutron-l2gw | | | | X | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | rabbitmq | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | mongodb | X | X | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | redis | X | | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | haproxy | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | keepalived | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | memcached | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | pacemaker | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | nova | qemu | qemu | qemu | qemu | X | qemu | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | ntp | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | snmp | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | timezone | X | X | X | X | X | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | sahara | | | X | | | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | mistral | | | X | | | X | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | swift | | X | | | X | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | aodh | X | X | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | ceilometer | X | X | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | gnocchi | rbd | swift | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | panko | X | X | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | barbican | | X | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | zaqar | | X | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | ec2api | | X | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | cephrgw | | X | | X | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | tacker | X | | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | congress | X | | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | cephmds | | | | X | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | manila | | | | X | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | collectd | X | | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | fluentd | X | | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+ | sensu-client | X | | | | | | +----------------+-------------+-------------+-------------+-------------+-----------------+--------------+