Manage a pool of nodes for a distributed test infrastructure
Go to file
Ian Wienand a668411978 webapp: fix browser return
This small match had a surprising number of issues...

Even though we're testing returning 'text/plain' when 'text/html' is
specified, it turns out the accept headers real browsers send actually
specify "*/*;q=0.8" which means that unmatched types will be given the
same, lower weight.

This means in the extant code, the best_match() for a normal browser
request (without 'text/plain') will think that 'application/json' and
'text/plain' are the same preference, and will take the first in the
list, which happens to be 'application/json'.  The result is that
*real* webrowsers are getting back json, when we wanted them to get a
human readable result.

Also, in the mean time webob has a new accept handling model, and
best_match() is deprecated anyway.  Update the requirements to the
latest WebOb (new handling was added in 1.8.0, 1.8.1 is a bugfix)

So now we use the new API, and list 'text/html' as an acceptable
offer, which ensures it will be chosen if a browser is requesting
things.  It still returns a text/plain table.

A check for this is added to the test suite.  Also a bug with setting
the headers after the request is fixed, which went unnoticed because
of the prior default behaviour.

Change-Id: I84094ca67b16ce9246507aa0010646ffc3e9dbff
2018-06-07 18:47:06 +10:00
devstack Merge "Update logging format for devstack jobs" 2018-05-09 23:19:43 +00:00
doc Create a base Driver class 2018-06-06 14:11:43 -04:00
etc Merge "Add systemd drop-in file for CentOS 7" 2018-05-09 18:09:54 +00:00
nodepool webapp: fix browser return 2018-06-07 18:47:06 +10:00
playbooks Refactor playbooks/nodepool-zuul-functional/pre.yaml 2018-02-20 19:56:11 +01:00
releasenotes/notes Fix adding qcow2 format without need 2018-06-06 21:58:21 +02:00
roles/nodepool-zuul-functional Refactor playbooks/nodepool-zuul-functional/pre.yaml 2018-02-20 19:56:11 +01:00
tools Remove debian-jessie from nodepool dsvm testing 2018-05-04 12:16:34 -04:00
.coveragerc Switch to stestr 2018-04-26 11:52:17 -05:00
.gitignore Ignore .stestr directory in .gitignore 2018-05-07 12:37:44 -04:00
.gitreview Replace master with feature/zuulv3 2018-01-18 10:13:57 -08:00
.stestr.conf Switch to stestr 2018-04-26 11:52:17 -05:00
.zuul.yaml Merge "Remove debian-jessie from nodepool dsvm testing" 2018-05-09 18:11:48 +00:00
LICENSE license: remove dos line break 2018-01-19 00:30:22 +00:00
README.rst Rename nodepoold to nodepool-launcher 2017-03-29 09:28:33 -04:00
bindep.txt Ensure only python3 is installed with bindep.txt 2018-02-14 12:19:16 -05:00
requirements.txt webapp: fix browser return 2018-06-07 18:47:06 +10:00
setup.cfg update supported python version in setup.cfg 2018-02-02 04:30:06 +00:00
setup.py Bump pbr requirements to >=1.3 2015-09-14 16:19:13 -04:00
test-requirements.txt Switch to stestr 2018-04-26 11:52:17 -05:00
tox.ini Switch to stestr 2018-04-26 11:52:17 -05:00

README.rst

Nodepool

Nodepool is a service used by the OpenStack CI team to deploy and manage a pool of devstack images on a cloud server for use in OpenStack project testing.

Developer setup

Make sure you have pip installed:

wget https://bootstrap.pypa.io/get-pip.py
sudo python get-pip.py

Install dependencies:

sudo pip install bindep
sudo apt-get install $(bindep -b nodepool)

mkdir src
cd ~/src
git clone git://git.openstack.org/openstack-infra/system-config
git clone git://git.openstack.org/openstack-infra/nodepool
cd nodepool
sudo pip install -U -r requirements.txt
sudo pip install -e .

If you're testing a specific patch that is already in gerrit, you will also want to install git-review and apply that patch while in the nodepool directory, ie:

git review -x XXXXX

Create or adapt a nodepool yaml file. You can adapt an infra/system-config one, or fake.yaml as desired. Note that fake.yaml's settings won't Just Work - consult ./modules/openstack_project/templates/nodepool/nodepool.yaml.erb in the infra/system-config tree to see a production config.

If the cloud being used has no default_floating_pool defined in nova.conf, you will need to define a pool name using the nodepool yaml file to use floating ips.

Export variable for your ssh key so you can log into the created instances:

export NODEPOOL_SSH_KEY=`cat ~/.ssh/id_rsa.pub | awk '{print $2}'`

Start nodepool with a demo config file (copy or edit fake.yaml to contain your data):

export STATSD_HOST=127.0.0.1
export STATSD_PORT=8125
nodepool-launcher -d -c tools/fake.yaml

All logging ends up in stdout.

Use the following tool to check on progress:

nodepool image-list