Rally provides a framework for performance analysis and benchmarking of individual OpenStack components as well as full production OpenStack cloud deployments
Go to file
Ian Wienand 33023798b4 Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.

This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.

This update should result in no functional change.

For more information see the thread at

 http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html

Change-Id: Iac57d073b6b10e7c11a9119cfb7d968ee90d6aa6
2019-03-24 20:35:59 +00:00
.zuul.d Merge "Restore publishing docs to rtd" 2019-02-21 11:20:49 +00:00
devstack Replace openstack.org git:// URLs with https:// 2019-03-24 20:35:59 +00:00
doc Add the section installing rally-openstack in quick-start 2019-01-17 16:51:12 +08:00
etc [docs] Fix readme for docker image 2019-02-05 18:15:16 +02:00
rally Task context: implement comparison operators 2019-03-17 03:15:08 +03:00
rally-jobs [evil] Remove OpenStack related plugins 2018-06-20 19:01:47 +03:00
samples [evil] Remove OpenStack related plugins 2018-06-20 19:01:47 +03:00
tests Task context: implement comparison operators 2019-03-17 03:15:08 +03:00
.coveragerc [CI] Fix coverage job 2016-06-27 15:39:13 +03:00
.dockerignore Fix docker build command 2015-11-10 16:33:29 -08:00
.gitignore [ci] Start fixing CLI job 2017-10-12 12:13:18 +03:00
.gitreview Update .gitreview file to reflect repo rename 2015-04-18 00:37:36 +00:00
bindep.txt bindep.txt: 2019-03-08 15:13:24 -07:00
CHANGELOG.rst Propose 1.4.1 release 2019-02-28 19:11:49 +02:00
CONTRIBUTING.rst [docs][6] Re-design docs to cover all user-groups 2017-01-10 11:25:00 -08:00
install_rally.sh Change openstack-dev to openstack-discuss 2018-12-09 23:48:24 +08:00
LICENSE Initial commit 2013-08-03 09:17:25 -07:00
optional-requirements.txt Fixing docker-check jenkins job 2016-09-20 16:56:00 +03:00
README.rst Prepare to Rally 1.0.0 release 2018-06-20 19:02:05 +03:00
requirements.txt Remove morph dependency 2019-02-04 16:59:29 +00:00
setup.cfg Change openstack-dev to openstack-discuss 2018-12-04 08:36:06 +00:00
setup.py Updated from global requirements 2015-09-22 10:45:07 +00:00
test-requirements.txt Update our requirements.txt and u-c files 2018-08-07 13:09:46 +03:00
tox.ini [ci] Add job to run functional tests over py3 env 2019-02-04 18:01:13 +00:00
upper-constraints.txt Remove morph dependency 2019-02-04 16:59:29 +00:00

Rally

Rally is tool & framework that allows one to write simple plugins and combine them in complex tests scenarios that allows to perform all kinds of testing!

Team and repository tags

image

Latest Version

Gitter Chat

Trello Board

Apache License, Version 2.0

What is Rally

Rally is intended to provide a testing framework that is capable to perform specific, complicated and reproducible test cases on real deployment scenarios.

Rally workflow can be visualized by the following diagram:

Rally Architecture

Who Is Using Rally

Who is Using Rally

Documentation

Rally documentation on ReadTheDocs is a perfect place to start learning about Rally. It provides you with an easy and illustrative guidance through this benchmarking tool.

For example, check out the Rally step-by-step tutorial that explains, in a series of lessons, how to explore the power of Rally in benchmarking your OpenStack clouds.

Architecture

In terms of software architecture, Rally is built of 4 main components:

  1. Environment - one of key component in Rally. It manages and stores information about tested platforms. Env manager is using platform plugins to: create, delete, cleanup, check health, obtain information about platforms.
  2. Task component is responsible for executing tests defined in task specs, persisting and reporting results.
  3. Verification component allows to wrap subunit-based testing tools and provide complete tool on top of them with allow to do pre configuration, post cleanup as well process and persist results to Rally DB for future use like reporting and results comparing.

Use Cases

There are 3 major high level Rally Use Cases:

Rally Use Cases

Typical cases where Rally aims to help are:

  • Automate measuring & profiling focused on how new code changes affect the OpenStack performance;

  • Using Rally profiler to detect scaling & performance issues;

  • Investigate how different deployments affect the OS performance:

    • Find the set of suitable OpenStack deployment architectures;
    • Create deployment specifications for different loads (amount of controllers, swift nodes, etc.);
  • Automate the search for hardware best suited for particular OpenStack cloud;

  • Automate the production cloud specification generation:

    • Determine terminal loads for basic cloud operations: VM start & stop, Block Device create/destroy & various OpenStack API methods;
    • Check performance of basic cloud operations in case of different loads.