848 Commits

Author SHA1 Message Date
Sergey Skripnick
4faf54e2c2 Prepare documentation for readthedocs
Create Makefile and recreate conf.py using sphinx-quickstart
Add _build to gitignore
Fix several nits in rst files
Add tox environment for docs building. Now docs may be built by
running `tox -edoc'

Change-Id: Ib0eb17047e583bdf3ac9111e117f908340f4d5ef
2014-06-05 17:45:51 +03:00
Jenkins
3bf5396305 Merge "Add missing keys to rally runner result" 2014-06-05 02:45:21 +00:00
Jenkins
b6bb8fbcb9 Merge "Add command-line integrated tests" 2014-06-04 16:58:53 +00:00
Jenkins
0579015f78 Merge "Add neutron scenario" 2014-06-04 13:17:03 +00:00
Sergey Skripnick
588ca122ec Add neutron scenario
This scenario is intended to be run by rally-dsvm-neutron job

Change-Id: I9055c855863624a028317d928e6b995d93dbd794
2014-06-04 15:25:57 +03:00
Rohan Kanade
08e69fb7eb Add missing keys to rally runner result
Adds "scenario_output" and "atomic_actions" keys to constant and
periodic runner result when exception is raised while running a scenario

Change-Id: I5ddc8d08e787eab34d67df400acb33a133ea0cef
Closes-Bug: #1325630
2014-06-04 13:06:28 +02:00
Sergey Kraynev
90c24f7dd6 Heat rally scenario tests
This patch contains next main changes:
 - two scenarios for heat project ("create_and_list_stack",
   "create_and_delete_stack").
 - three atomic action for heat project ("stack-list" , "stack-create",
   "stack-delete").
 - two task samples how to use new scenarios.
 - a little changes in utils for supporting heat stack_status property.

Change-Id: Ice2bd4dc2fcefb7351df69dd8463abc6f8d4fd24
2014-06-04 02:51:54 -04:00
Jenkins
b40b67037c Merge "Add benchmark scenarios for ceilometer queries API" 2014-06-03 23:43:38 +00:00
Jenkins
934fe95dbc Merge "Fix typos and pep257" 2014-06-03 23:43:32 +00:00
Jenkins
c17339ee2c Merge "Add scenario name to Scenario Configuration for html" 2014-06-03 23:43:26 +00:00
Jenkins
fc83d172a6 Merge "Modify install_rally.sh to install under BSDs" 2014-06-03 23:43:19 +00:00
Jenkins
0fada9a014 Merge "Log deployment id and benchmark key from task" 2014-06-03 23:43:13 +00:00
Anwar Ruwaifa
1d6af0f8a3 Add benchmark scenarios for ceilometer queries API
Change-Id: I88a197c0f0dd637bc4420725b1dc54ee8a0355bf
blueprint: benchmark-scenarios-for-celiometer
2014-06-03 11:34:18 +00:00
Sergey Skripnick
3087241c58 Fix typos and pep257
Fixed typos and pep257 issues in docstrings

Change-Id: I1fef47fad640eafb4470e96db54bb5bff5b47413
2014-06-03 13:53:36 +03:00
Marco Morais
6dd5909fc4 Log deployment id and benchmark key from task
* Log deployment id and benchmark key from task to help when
  reading logs from multiple benchmarks which are concatenated
  together

Change-Id: Ia5690cfd911c38f71c3ed4595cae5f2aa683f842
2014-06-03 07:38:03 +00:00
Marco Morais
4fe39730dc pass id or name of resources in scenario config
* added types.set(...) decorator to apply transform to scenario args
* abstract ResourceType implements generic transform logic
* support use of flavor name through FlavorResourceType
* support use of image name through ImageResourceType
* transform is applied during validation and during preprocessing
  which follows validation
* modified all sample scenarios to use flavor-by-name and
  image-by-name
* passing resource as simple key-value pair will no longer work,
  and instead resource must be object containig id, name, or regex
* unit tests for image and flavor transformations

Change-Id: If35959ece8f247b5376f5ff91ae3d3e008a84447
2014-06-03 07:19:00 +00:00
Marco Morais
de36c14184 Ensure file handle cleanup during image creation
* When uploading an image to glance from a file,
  perform the close operation from finally block
  to avoid waiting for handle to be closed when
  reference count goes to 0

Change-Id: I5c3ee35b87fa55097c2e847836d5ad1764ae0574
2014-05-30 08:01:25 +00:00
liyingjun
5a750effff Add scenario name to Scenario Configuration for html
Without scenario name users are not able just to copy/paste & run
the scenario, this patch add the missing name for the configuration.

Change-Id: I4b5f8cd1b6f0d03e264580c84bb06b7bada4792a
2014-05-29 07:34:25 +08:00
liyingjun
d47e21b144 corresponding result with name in output html
Names are sorted but the results are not corresponding

Change-Id: Ia1cfe97c7eed72ee175d0360f8d1989005a87f5a
2014-05-29 03:25:31 +08:00
liyingjun
3ee22ed2bb sorted benchmark scenario selection
The benchmark scenarios are not sorted in the selection field
in the output html. This patch fixes the problem.

Change-Id: I11bf545f659dccd088b1ff16961ae89be3aee8dd
2014-05-29 01:14:18 +08:00
Marco Morais
8e90dc537a Increase http client timeout from 30s to 180s
* Some deployments are reporting timeout exceptions
  with default values

Change-Id: I536a5fd138fefe48227809a4d2c78971682b7cfd
2014-05-29 01:08:05 +00:00
Jenkins
9b73283b9d Merge "Add FuelEngine" 2014-05-28 17:42:29 +00:00
Jenkins
3b20511f02 Merge "Fix typos in file names for ceilometer resources API" 2014-05-28 17:42:23 +00:00
ali-mohsin
13de8ac34d Add benchmark scenarios for ceilometer statistics api
Change-Id: I6ae09420e970890f82b4b86806b38e7a07ae915f
blueprint: benchmark-scenarios-for-celiometer
2014-05-28 13:27:41 +00:00
Jenkins
4a69eb703c Merge "Fix inconsistencies in docs for factory classes" 2014-05-28 12:44:55 +00:00
Sergey Skripnick
59f1d031c1 Add FuelEngine
This engine deploys OpenStack with Fuel

blueprint fuel-engine

Change-Id: Ifff933197b02c7dc7b47aedbe52810bc923d8678
2014-05-28 15:11:47 +03:00
Subhash Dasyam
9c29321ab0 Fix typos in file names for ceilometer resources API
Closes-Bug: #1322586
Change-Id: I1ec88f155eeda67e710aba1b9ae2382505713b29
2014-05-28 17:02:49 +05:30
Jenkins
d2aaa24872 Merge "Use plugins from project in rally-gate" 2014-05-28 03:35:10 +00:00
Sergey Skripnick
24ef12bc78 Use plugins from project in rally-gate
Plugins must be stored in $PROJECT/rally-scenarios/plugins/

Change-Id: I751216e69c11e8743d5256c4e8e5b1bfa193091e
2014-05-27 14:20:31 +03:00
chen-li
99245bdc89 Use function "print_list" to output tables in rally cmd
The CLI code has recently been partially rewritten,
so that it uses now the openstack.common.cliutils.print_list()
method to draw tables, instead of pure PrettyTable library usage.

Change-Id: I895112c5514a1f9e31919e110d16650272ca5960
2014-05-27 16:18:43 +08:00
Tzanetos Balitsaris
8d651fdf94 Modify install_rally.sh to install under BSDs
The sed command (line 138) responsible for setting the database
connection string in the configuration file of Rally, is only GNU sed
compatible. The BSD systems (ex. FreeBSD, OS X) use a different sed
implementation. The in-place editing differs in these two versions. This
commit modifies the sed command in a way to be compatible for both
implementations.
It creates a temporary file and sends the output of sed to that file,
and then it replaces the original file with the temporary one. It is
actually what the --in-place switch of GNU sed does in the background
[1].

[1] http://www.gnu.org/software/sed/manual/sed.html

Change-Id: Idef71121416c1c6c5d70ab6e041f89a7b441b1f9
2014-05-26 14:19:20 +03:00
Mikhail Dubov
2b0b6a1e7d Fix inconsistencies in docs for factory classes
Fix several issues in rally.deploy.engine.EngineFactory and
rally.deploy.serverprovider.provider.ProviderFactory:

* Wrong API descriptions
* Wrong module references
* Grammar

Change-Id: Idddf3da0c935ba7d21132c67be9259a1fbf96130
2014-05-26 12:44:16 +04:00
Jenkins
0116fa6d7f Merge "Add benchmark scenarios for ceilometer resources GET API" 2014-05-23 11:07:17 +00:00
Jenkins
a32be3f40a Merge "Added a class to measure the duration of atomic operations" 2014-05-22 05:40:11 +00:00
Neependra Khare
be5eae938b Added a class to measure the duration of atomic operations
This would simplify the way measure atomic opeation duration
in certain cases. For example if we want to get the duration
for each operation which runs in an iteration

    for i in range(repetitions):
       with scenario_utils.AtomicAction(instance_of_base_scenario_subclass,
                                        "name_of_action"):
           self.clients(<client>).<operation>

Change-Id: I48793fc0af160656f37964ca5d4e9b59b62de685
2014-05-22 10:47:41 +05:30
LipingMao
5234e7b510 The configs in osclients.py are not in rally.conf.sample
Closes-Bug: #1321987

Change-Id: I3ed025e5633f96f0a72902ed879b969f88ebe27d
2014-05-22 04:13:24 +00:00
Jenkins
c8019d0c9b Merge "Unit tests for TempestConf" 2014-05-20 09:25:44 +00:00
chen-li
5f7d4d1787 Add output message for rally task command if uuid is not specified
Closes-Bug: #1303292

Change-Id: Idf639a44bc92447e3e49cead76cb86eae7a714e1
2014-05-20 13:11:13 +08:00
Jenkins
6293189432 Merge "Add documentation for plugins" 2014-05-20 02:17:54 +00:00
Olga Kopylova
f883b07047 Add documentation for plugins
Documentation how to create and use plugins stored in doc/plugins.rst file

Change-Id: Icdf816861bc81b7a2fbcca92ebaf44ca0cb05903
2014-05-19 23:34:54 +03:00
Olga Kopylova
ad66ca895f Unit tests for TempestConf
Add unit tests for TempestConf class.
Small refactoring of fake resources and TempestConf.

Change-Id: Iae6b1322b372bebc086043d8bc0b5454f829222b
2014-05-19 16:54:41 +03:00
Jenkins
99ceaf80f7 Merge "Refactoring for random names generation in scenarios" 2014-05-19 09:24:49 +00:00
Christian Berendt
fa99d1a314 replaced e.message
BaseException.message has been deprecated as of Python 2.6.

http://legacy.python.org/dev/peps/pep-0352/

Replaced e.message with six.text_type(e) (uses unicode with
Python 2.x and str with Python 3.x).

Change-Id: I8d0c43f9383cec343ca159061b7a93d3db45a74a
2014-05-16 18:19:38 +02:00
Subhash Dasyam
4e0d9e22f5 Add benchmark scenarios for ceilometer resources GET API
Change-Id: I04b1d6383ec5e876ce67b9dd471fa0ff22f8fa58
blueprint: benchmark-scenarios-for-celiometer
2014-05-16 20:09:16 +05:30
Anwar Ruwaifa
c6b7125820 Add benchmark scenarios for ceilometer meters GET API
Change-Id: I868e444367180b6b4c51ce06b3b7c54d1fcbf5ec
blueprint: benchmark-scenarios-for-celiometer
2014-05-16 05:12:45 +04:00
Jenkins
38828b6eca Merge "Make cleanup methods lazy" 2014-05-15 14:49:20 +00:00
Alexander Maretskiy
00807d4de5 Refactoring for random names generation in scenarios
This patch replaces redundant code which generates random names
with calling classmethod base.Scenario._generate_random_name,
for all benchmark scenarios.

Change-Id: I051f83508e580f831ae665e09ee20275b4c77ded
2014-05-15 12:22:57 +03:00
Hugh Saunders
c6a860026b Enable plots with no successful iterations
The stacked and pie graphs can still be produced when there are no
successful iterations. The pie chart ilustrates this well by showing 100%
error. However the histogram cannot be produced as the number of bins
cannot be calculated, so this is skipped.

Also hides atomic actions header and select when there are no atomic
actions results.

closes-bug: #1315063
Change-Id: Ic1fb7f00550828a8e374a94034c1b8eb07db5e89
2014-05-14 21:55:49 +01:00
Hugh Saunders
52164fb86e Add probabliity based dummy exception scenario
This secnario will throw an exception with the probability provided.
Useful for testing where some good iterations and some bad iterations
are required.

Also adds:
  * number validator to dummy_exception scenario.
  * more itterations to dummy scenario sample files

Change-Id: I50360de0347a8c28686a3196edefe3ae004fce85
2014-05-14 20:46:28 +01:00
Sergey Skripnick
b194c2e2fe Add command-line integrated tests
Change-Id: I75b4efa104cb1991a439a891c2135af286d2283f
Related: blueprint rally-gate-jobs
2014-05-14 13:52:21 +03:00