Manage a pool of nodes for a distributed test infrastructure
Go to file
Monty Taylor 94e4dbd733 Consume os-client-config directly
In order for us to notice config changes in clouds.yaml, rather than
consuming it indirectly via shade, create the cloud config directly
and pass it in to the shade factory function.

There would not be a huge win in teaching shade to notice and update
itself at the moment, as the update processing happens in a different
place and there isn't really a great way to have the check ask the old
provider manager to see if its cloud config has changed.

Change-Id: Ie4cf44adefda637b5987dd9d39ec398786086720
Depends-On: Icdd9acede81bc5fba60d877194048e24a62c9e5d
2015-05-28 12:29:56 -04:00
doc Clarify project-id meaning for Rackspace deployment 2015-05-09 10:44:05 -04:00
nodepool Consume os-client-config directly 2015-05-28 12:29:56 -04:00
tools Switch from MySQL-python to PyMySQL 2015-04-02 21:18:21 +00:00
.gitignore Ignore vim editor backup and swap files. 2014-01-20 13:23:04 +13:00
.gitreview Added .gitreview 2013-08-13 17:10:06 +00:00
.testr.conf Add a test for subnodes 2014-03-31 09:22:00 -07:00
README.rst Merge "Update Readme config -> system-config repo" 2015-04-27 18:21:45 +00:00
requirements.txt Consume os-client-config directly 2015-05-28 12:29:56 -04:00
setup.cfg Replace ci.o.o links with docs.o.o/infra 2015-05-14 21:38:16 +00:00
setup.py Update pbr version 2014-06-29 00:20:36 +08:00
test-requirements.txt Check image-list output in cmd tests 2015-03-17 23:34:15 +00:00
tox.ini Add tox 'docs' env to build Sphinx documentation 2015-04-21 17:33:52 +02:00

README.rst

Nodepool

Nodepool is a service used by the OpenStack CI team to deploy and manage a pool of devstack images on a cloud server for use in OpenStack project testing.

Developer setup

Install dependencies:

sudo apt-get update
sudo apt-get -qy install git mysql-server libmysqlclient-dev g++\
                 python-dev python-pip libffi-dev libssl-dev qemu-utils
mkdir src
cd ~/src
git clone git://git.openstack.org/openstack-infra/system-config
git clone git://git.openstack.org/openstack-infra/nodepool
cd nodepool
sudo pip install -U -r requirements.txt
sudo pip install -e .

If you're testing a specific patch that is already in gerrit, you will also want to install git-review and apply that patch while in the nodepool directory, ie:

git review -x XXXXX

Create or adapt a nodepool yaml file. You can adapt an infra/system-config one, or fake.yaml as desired. Note that fake.yaml's settings won't Just Work - consult ./modules/openstack_project/templates/nodepool/nodepool.yaml.erb in the infra/system-config tree to see a production config.

If the cloud being used has no default_floating_pool defined in nova.conf, you will need to define a pool name using the nodepool yaml file to use floating ips.

Set up database for interactive testing:

mysql -u root

mysql> create database nodepool;
mysql> GRANT ALL ON nodepool.* TO 'nodepool'@'localhost';
mysql> flush privileges;

Set up database for unit tests:

mysql -u root
mysql> grant all privileges on *.* to 'openstack_citest'@'localhost' identified by 'openstack_citest' with grant option;
mysql> flush privileges;
mysql> create database openstack_citest;

Export variable for your ssh key so you can log into the created instances:

export NODEPOOL_SSH_KEY=`cat ~/.ssh/id_rsa.pub | awk '{print $2}'`

Start nodepool with a demo config file (copy or edit fake.yaml to contain your data):

export STATSD_HOST=127.0.0.1
export STATSD_PORT=8125
nodepoold -d -c tools/fake.yaml

All logging ends up in stdout.

Use the following tool to check on progress:

nodepool image-list

After each run (the fake nova provider is only in-memory):

mysql> delete from snapshot_image; delete from node;