RETIRED, further work has moved to Debian project infrastructure
Go to file
Clark Boylan 84336a4d3c Cleanup failed upload records
Failed uploads happen when things like clouds disappearing happen. This
then results in hundreds or even thousands of upload records all failed
while we wait for the cloud to return. THis is noise that makes it hard
to debug actual problems with image uploads as you can't easily see what
is current.

Avoid this noise in output by cleaning up Failed records after they have
been recorded.

Change-Id: Ife0cf3dd0d9af6cf7a587e9906726c67271b0d5c
2017-05-24 14:37:40 -07:00
devstack Support both python2 and python3 virtualenv 2017-05-24 14:14:43 -04:00
doc Merge "Support externally managed images" into feature/zuulv3 2017-05-18 15:34:11 +00:00
nodepool Cleanup failed upload records 2017-05-24 14:37:40 -07:00
tools Merge "Add ability to select flavor by name or id" into feature/zuulv3 2017-04-27 21:29:20 +00:00
.gitignore Add files for zuul-nodepool integration test 2017-01-24 09:46:08 -08:00
.gitreview Set default branch to feature/zuulv3 2016-08-18 09:08:23 -07:00
.testr.conf Add a test for subnodes 2014-03-31 09:22:00 -07:00
bindep.txt Add libffi development headers to bindep 2017-03-21 08:53:12 -04:00
LICENSE Add LICENSE file 2015-12-10 12:54:23 -05:00
README.rst Rename nodepoold to nodepool-launcher 2017-03-29 09:28:33 -04:00
requirements.txt Bump diskimage-builder dependency to 2.0.0 2017-05-23 11:15:42 -04:00
setup.cfg Fix internal doc refs to renamed section 2017-04-05 11:07:03 -07:00
setup.py Bump pbr requirements to >=1.3 2015-09-14 16:19:13 -04:00
test-requirements.txt Block sphinx 1.6 2017-05-16 16:35:51 -05:00
tox.ini Python 3.x incompatible use of print operator 2017-05-12 14:09:15 -04:00

Nodepool

Nodepool is a service used by the OpenStack CI team to deploy and manage a pool of devstack images on a cloud server for use in OpenStack project testing.

Developer setup

Make sure you have pip installed:

wget https://bootstrap.pypa.io/get-pip.py
sudo python get-pip.py

Install dependencies:

sudo pip install bindep
sudo apt-get install $(bindep -b nodepool)

mkdir src
cd ~/src
git clone git://git.openstack.org/openstack-infra/system-config
git clone git://git.openstack.org/openstack-infra/nodepool
cd nodepool
sudo pip install -U -r requirements.txt
sudo pip install -e .

If you're testing a specific patch that is already in gerrit, you will also want to install git-review and apply that patch while in the nodepool directory, ie:

git review -x XXXXX

Create or adapt a nodepool yaml file. You can adapt an infra/system-config one, or fake.yaml as desired. Note that fake.yaml's settings won't Just Work - consult ./modules/openstack_project/templates/nodepool/nodepool.yaml.erb in the infra/system-config tree to see a production config.

If the cloud being used has no default_floating_pool defined in nova.conf, you will need to define a pool name using the nodepool yaml file to use floating ips.

Export variable for your ssh key so you can log into the created instances:

export NODEPOOL_SSH_KEY=`cat ~/.ssh/id_rsa.pub | awk '{print $2}'`

Start nodepool with a demo config file (copy or edit fake.yaml to contain your data):

export STATSD_HOST=127.0.0.1
export STATSD_PORT=8125
nodepool-launcher -d -c tools/fake.yaml

All logging ends up in stdout.

Use the following tool to check on progress:

nodepool image-list