Upgrade testing of OpenStack projects built on top of DevStack.
Go to file
Sean Dague 45af10285b add .gitreview to the project
Change-Id: Ib2b995eb1e3f355731db004151b688af742c602e
2013-03-26 10:18:59 -04:00
.gitreview add .gitreview to the project 2013-03-26 10:18:59 -04:00
HACKING.rst Update functions file from DevStack 2013-03-15 15:57:03 -05:00
LICENSE Initial repo setup 2012-08-03 17:07:12 -05:00
README.rst Update docs 2013-03-11 10:55:03 -05:00
TODO.rst Change terms 2013-01-23 15:50:42 -06:00
clean.sh Add clean.sh 2013-03-11 10:55:03 -05:00
devstack.localrc.base Add upgrade-swift 2013-02-20 10:59:06 -06:00
devstack.localrc.target Fix javelin image name setup 2013-03-22 14:44:04 -05:00
functions Update functions file from DevStack 2013-03-15 15:57:03 -05:00
grenade.sh Update functions file from DevStack 2013-03-15 15:57:03 -05:00
grenaderc Wait for javelin instance to start 2013-03-11 10:55:10 -05:00
javelin.conf Create volume in javelin config 2012-08-31 10:04:05 -05:00
javelinrc Change terms 2013-01-23 15:50:42 -06:00
prep-base Upgrade scripts: 2013-02-05 17:34:11 -06:00
prep-target sudo rsync in pre-ptarget 2013-02-20 10:59:11 -06:00
save-state Save ebtables/iptables state 2013-03-11 10:55:10 -05:00
setup-grenade Update master Grenade repo 2013-03-22 13:40:08 -05:00
setup-javelin Fix javelin image name setup 2013-03-22 14:44:04 -05:00
stop-base Swift updates: 2013-02-28 15:51:04 -06:00
upgrade-cinder Merge "Update functions file from DevStack" 2013-03-15 20:59:36 +00:00
upgrade-devstack Change terms 2013-01-23 15:50:42 -06:00
upgrade-glance Merge "Update functions file from DevStack" 2013-03-15 20:59:36 +00:00
upgrade-keystone Merge "Update functions file from DevStack" 2013-03-15 20:59:36 +00:00
upgrade-nova Merge "Need to get more of the setup stack.sh does for Nova" 2013-03-15 22:48:44 +00:00
upgrade-packages Change terms 2013-01-23 15:50:42 -06:00
upgrade-swift Save compelte conf dir rather than specific files 2013-03-15 15:49:04 -05:00

README.rst

Grenade

Grenade is an OpenStack test harness to exercise the upgrade process between releases. It uses DevStack to perform an initial OpenStack install and as a reference for the final configuration. Currently Grenade upgrades Keystone, Glance, Nova, Cinder and Swift in their default DevStack configurations.

The master branch tests the upgrade path from the previous release (aka 'base') to the current trunk (aka 'target'). Stable branches of grenade will be created soon after an OpenStack release and after a corresponding DevStack stable branch is available.

For example, following the release of Grizzly and the creation of DevStack's stable/grizzly branch a similar stable/grizzly branch of Grenade will be created. At that time master will be re-worked to base on Grizzly and the cycle will continue.

Goals

Continually test the upgrade process between OpenStack releases to find issues as they are introduced so they can be fixed immediately.

Status

Preparations are ongoing to add Grenade as a non-voting job in the OpenStack CI Jenkins.

  • Testing of the 'javelin' project artifacts is incomplete

Process

  • Install base OpenStack using current stable/<base-release> DevStack
  • Perform basic testing (exercise.sh)
  • Create some artifacts in a new project ('javelin') for comparison after the upgrade process.
  • Install current target DevStack to support the upgrades
  • Run upgrade scripts preserving (running?) instances and data

Terminology

Grenade has two DevStack installs present and distinguished between then as 'base' and 'target'.

  • Base: The initial install that will be upgraded.
  • Target: The reference install of target OpenStack (maybe just DevStack)

Directory Structure

Grenade creates a set of directories for both the base and target OpenStack installation sources and DevStack.

$DEST

- <base> | - <target> | |- swift

Install Grenade

Get Grenade from GitHub in the usual way:

git clone https://github.com/nebula/grenade.git

Grenade knows how to install the current master branch using the included setup-grenade script. The only argument is the hostname of the target system that will run the upgrade testing.

./setup-grenade testbox

The Grenade repo and branch used can be changed by adding something like this to localrc:

GRENADE_REPO=git@github.com:dtroyer/grenade.git
GRENADE_BRANCH=dt-test

Grenade includes devstack.localrc.base and devstack.localrc.target for DevStack that are used to customize its behaviour for use with Grenade. If $DEST/devstack.$BASE_RELEASE/localrc does not exist the following is performed by prep-base:

  • devstack.localrc.base is copied to to $DEST/$BASE_RELEASE/devstack/localrc
  • if devstack.localrc exists it is appended $DEST/$BASE_RELEASE/devstack/localrc

Similar steps are performed by prep-target for $DEST/$BASE_RELEASE/devstack.

devstack.localrc will be appended to both DevStack localrc files if it exists. devstack.localrc is not included in Grenade and will not be overwritten it if it exists.

To handle differences between the DevStack releases GRENADE_PHASE will be set to base or target so appropriate decisions can be made:

if [[ "$GRENADE_PHASE" == "base" ]]; then
    # Handle base-specific local
    :
else
    # Handle target-specific local
    :
fi

Prepare For An Upgrade Test

./grenade.sh

grenade.sh installs DevStack for the Base release and runs its stack.sh. Then it creates a 'javelin' project containing some non-default configuration.

This is roughly the equivalent to:

grenade/prep-base
(cd /opt/stack/folsom/devstack
 ./stack.sh)
grenade/setup-javelin
(cd /opt/stack/folsom/devstack
 ./unstack.sh)
# dump databases to $DEST/save
grenade/prep-target
grenade/upgrade-packages
grenade/upgrade-devstack
grenade/upgrade-keystone
grenade/upgrade-glance
grenade/upgrade-nova
grenade/upgrade-cinder
grenade/upgrade-swift

The Target release of DevStack is installed in a different directory from the Base release.

While the Base release is running an imaginary Javelin tenant is configured to populate the databases with some non-default content:

grenade/setup-javelin

Set up the javelin credentials with javelinrc.

Testing Upgrades

The upgrade-* scripts are the individual components of the DevStack/Grenade upgrade process. They typically stop any running processes, checkout updated sources, migrate the database, any other tasks that need to be done then start the processes in screen.

These scripts are written to be idmpotent.