Manage a pool of nodes for a distributed test infrastructure

Go to file

James E. Blair 1603675ba8 Add a fake-secure.conf In order to run nodepool in the foreground for development, a secure.conf that coressponds to the fake.yaml is needed. Change-Id: I274a6fe9be0cb62335804163c28131a2db652333		2016-08-18 09:08:21 -07:00
devstack	Add diskimage-builder from git to dsvm job	2016-07-22 15:24:09 +10:00
doc	Add config support for ZooKeeper servers	2016-08-05 17:34:55 +00:00
nodepool	Clarify code in nodepool/cmd/builder.py	2016-08-17 10:14:52 -04:00
tools	Add a fake-secure.conf	2016-08-18 09:08:21 -07:00
.gitignore	Ignore vim editor backup and swap files.	2014-01-20 13:23:04 +13:00
.gitreview	Added .gitreview	2013-08-13 17:10:06 +00:00
.testr.conf	Add a test for subnodes	2014-03-31 09:22:00 -07:00
LICENSE	Add LICENSE file	2015-12-10 12:54:23 -05:00
README.rst	Nodepool Install failure	2015-10-29 10:44:41 +05:30
requirements.txt	Add a simple status webapp	2016-07-14 15:10:38 -07:00
setup.cfg	Builders can be run on their own	2016-01-12 15:33:01 -08:00
setup.py	Bump pbr requirements to >=1.3	2015-09-14 16:19:13 -04:00
test-requirements.txt	Remove testresources	2016-08-15 10:27:07 -07:00
tox.ini	Allow testing with external zookeeper	2016-07-07 16:32:06 -04:00

README.rst

Nodepool

Nodepool is a service used by the OpenStack CI team to deploy and manage a pool of devstack images on a cloud server for use in OpenStack project testing.

Developer setup

Install dependencies:

sudo apt-get update
sudo apt-get -qy install git mysql-server libmysqlclient-dev g++\
                 python-dev python-pip libffi-dev libssl-dev qemu-utils\
                 libxml2-dev libxslt1-dev python-lxml
mkdir src
cd ~/src
git clone git://git.openstack.org/openstack-infra/system-config
git clone git://git.openstack.org/openstack-infra/nodepool
cd nodepool
sudo pip install -U -r requirements.txt
sudo pip install -e .

If you're testing a specific patch that is already in gerrit, you will also want to install git-review and apply that patch while in the nodepool directory, ie:

git review -x XXXXX

Create or adapt a nodepool yaml file. You can adapt an infra/system-config one, or fake.yaml as desired. Note that fake.yaml's settings won't Just Work - consult ./modules/openstack_project/templates/nodepool/nodepool.yaml.erb in the infra/system-config tree to see a production config.

If the cloud being used has no default_floating_pool defined in nova.conf, you will need to define a pool name using the nodepool yaml file to use floating ips.

Set up database for interactive testing:

mysql -u root

mysql> create database nodepool;
mysql> GRANT ALL ON nodepool.* TO 'nodepool'@'localhost';
mysql> flush privileges;

Set up database for unit tests:

mysql -u root
mysql> grant all privileges on *.* to 'openstack_citest'@'localhost' identified by 'openstack_citest' with grant option;
mysql> flush privileges;
mysql> create database openstack_citest;

Export variable for your ssh key so you can log into the created instances:

export NODEPOOL_SSH_KEY=`cat ~/.ssh/id_rsa.pub | awk '{print $2}'`

Start nodepool with a demo config file (copy or edit fake.yaml to contain your data):

export STATSD_HOST=127.0.0.1
export STATSD_PORT=8125
nodepoold -d -c tools/fake.yaml

All logging ends up in stdout.

Use the following tool to check on progress:

nodepool image-list

After each run (the fake nova provider is only in-memory):

mysql> delete from snapshot_image; delete from node;