46 Commits

Author SHA1 Message Date
zhangyanxian
85ae5b495c Fix typos in the docs
Change-Id: I204c72af3e28bdae9dee09f7a3f980b6b4c31654
2016-08-23 08:06:13 +00:00
Anton Studenov
74bb811ed5 Update hook_section spec
Format was updated to be more user friendly

Change-Id: Id18ed3c05237df3f1d1041b95004857a4a49bb96
2016-08-19 14:17:36 +03:00
Jenkins
2b07ff2a9f Merge "[spec] New Tasks Configuration section - hook" 2016-08-17 11:20:28 +00:00
Anton Studenov
3f144ad798 [spec] New Tasks Configuration section - hook
This document describes new section in task config.
This changes needed for reliability and density testing
of OpenStack clusters.

Change-Id: I39fed4b820710b74cf902363dd1c683622f89ca7
2016-08-16 15:07:20 +03:00
Anton Studenov
4837a8b5ed Add performance degradation SLA plugin
This adds SLA plugin that finds minimum and maximum duration of
iterations completed without errors during Rally task execution.
Assuming that minimum duration is 100%, it calculates
performance degradation against maximum duration.

Example config:
  sla:
    performance_degradation:
      max_degradation: 75

Spec: sla_pd_plugin
Change-Id: Ieedba7be72364f5599a3c0cf79f5f494a7391ea0
2016-07-26 12:47:53 +03:00
Jenkins
ff83b72976 Merge "[spec] Add performance degradation SLA plugin" 2016-07-18 22:47:48 +00:00
Alexander Maretskiy
2a004f368a [Spec] Spec class-based-scenarios.rst is implemented
Change-Id: If50cc5a341029b72ff92eeac41b1fc4559c6974b
2016-07-11 13:28:28 +03:00
Alexandr Nevenchannyy
5c2a28b337 [spec] Add performance degradation SLA plugin
This is document describes Rally SLA performance
degradation plugin.
This is plugin needed for reliability and density testing
of OpenStack clusters.

More info about testing available in openstack/performance-docs

Change-Id: Ic23d4e21e5bacbc949990364956edf06ac7e99f7
2016-07-05 12:20:07 +03:00
Jenkins
1ad1d2762d Merge "[spec] Making DB scalable and flexible enough" 2016-06-22 20:12:09 +00:00
Boris Pavlovic
f0e5bf0c83 [spec] Making DB scalable and flexible enough
Author:    Boris Pavlovic <boris@pavlovic.me>
Co-Authored-By: Illia Khudoshyn <ikhudoshyn@mirantis.com>

Change-Id: Ica4848ebf41798c6e0a8b1df73e9433d460d6e3d
2016-06-22 19:11:56 +00:00
Andrey Kurilin
5d003bfc8b Modify file-exporter plugin and base TaskExporter
- Since we supports plugin bases now, lets use shorter name and rename
   "file-exporter" to just "file".
 - this patch updates the help message and docstring for connection string
   for "file-exporter"/"file" plugin
 - TaskExporter located in the task module, so it is no need to store word
   "Task" in the class name

Change-Id: Ic8a9a765e7365ff108c88a67995b9bf26736e54e
2016-06-11 08:34:45 +00:00
Jenkins
dbfeeb1d6c Merge "[Spec] Rally Task Validation refactoring" 2016-05-30 16:03:31 +00:00
Roman Vasilets
2a4809bef7 [Spec] Rally Task Validation refactoring
Change-Id: I6b506971c361297ff1cb55bc9193eec871f7426c
2016-05-30 18:36:23 +03:00
Alexander Maretskiy
fb1f584a43 [Spec] Small fixes in introduce-class-based-scenario-implementation.rst
Changes:
  * rename spec to "class-based-scenarios.rst"
  * fix JSON code example format to make it valid
    and correctly displayed in HTML
  * highlight names of modules

Change-Id: Ice11cff93ee3d64f51afdf2aa33f4d1ed25cb6b3
2016-05-25 14:05:45 +03:00
Alexander Maretskiy
c6124f767c [Spec] Introduce class-based scenario implementation
Change-Id: Ifbd501f00c706210e767151fef4ff8f44bda4e88
Blueprint: inroduce-class-based-scenario-implementation
2016-04-27 18:27:47 +03:00
Jenkins
07f9e8f99b Merge "[spec] Rally Verification refactoring" 2016-04-19 16:21:01 +00:00
Andrey Kurilin
77994a4668 [spec] Rally Verification refactoring
Change-Id: Idaf161bbd01ada2aaa7968eae0cbd7d4515ba7bc
2016-03-28 19:16:24 +03:00
Alexander Maretskiy
6fd06d4f16 [Spec] Improve atomic actions format
This spec proposes improvements related to atomic actions:
  * rename term "atomic actions" into "actions"
  * store actions as list of dicts instead of OrderedDict
  * introduce nested actions saved in "children" container
  * start and end timestamps
  * get rid of duration time (since we have timestamps)

Blueprint: improve-atomic-actions
Change-Id: Ic22c00cf40c36205628dd3bf18b0f09f92fad8c0
2016-03-22 12:30:27 +02:00
Rodion Promyshlennikov
4901d08e00 [Spec] Deployment unification
Change-Id: I0c82cace6dc8cbc48cf76bb43ef62884c07d7056
2016-03-09 16:59:05 +00:00
Yair Fried
836808cb5e [spec] Refactoring scenario utils
Change-Id: I3bae09bc6528d5a019e0c42ebf946aafb31abf07
2016-02-22 19:44:38 +02:00
Jenkins
5746cbb04c Merge "Add base class for task exporter" 2016-02-10 22:26:23 +00:00
Roman Vasilets
bc2afdaddc Add base class for task exporter
Add base for Rally and Verification task exporters.
Implements: task_and_verification_export.rst

Change-Id: I3365f8dc5237a75041e902787a88e7d8896d7abe
2016-02-09 19:05:44 +02:00
Chris St. Pierre
8a9dc0558c Move OpenStack cleanup utils out of context
These will be used to do out-of-band cleanup in the near future, so
they are no longer specific to the cleanup context.

Change-Id: I5b5c7c89b04a080c487936cc3df0df24929ced31
Implements: blueprint cleanup-refactoring
2016-02-04 15:45:06 -06:00
Illia Khudoshyn
c215e309fc Fix RST formatting in a spec
Change-Id: I73fb09f5dd174df4866d9f330ce6d156340dc189
2016-01-26 12:09:20 +00:00
Chris St. Pierre
44c1db1c03 Consistent resource names spec is implemented
Change-Id: Ic2affa29e05b0c5e31cc88137a698248858bc129
Implements: blueprint consistent-resource-names
2016-01-15 09:11:44 -06:00
Chris St. Pierre
f17abea1df [Spec] Refactoring Rally Cleanup, Part II
This adds technical details for the existing "Refactoring Rally
Cleanup" spec.

Change-Id: I7a761eee2d245d30ab7f41fee0eb3d1f825bf0b1
Implements: blueprint cleanup-refactoring
2016-01-11 11:30:47 -06:00
Alexander Maretskiy
16472b25fb [Spec] Update and move spec about new output format
Spec 'improve_scenario_output_format.rst' is implemented,
so it is moved to doc/specs/implemented/

Also there were some updates to this spec to conform
improvements that are actually done:

 * Each output data set has 'description' text passed to
   Scenario.add_output() while adding the output.
   Description is displayed in HTML report under chart title.

 * Method Scenario.add_output() has changed (schema
   verification is added)

 * Subtab 'Detailed' is renamed to 'Per iteration'

Change-Id: Iddf0b0f5edea8002493d47131994f46202363ef5
2016-01-08 18:40:32 +02:00
Illia Khudoshyn
84a09c493b Add Workload object
The patch introduces Workload model
instead of regular dict that was used to describe
scenario configuration in TaskEngine.
As a side effect it allows to fix subtask representaion
in generated reports and other rally outputs.

Change-Id: I62148707c89f575f83da11e34d0d193e716e8249
2015-12-04 13:58:02 +00:00
Jenkins
e2e791502d Merge "[Spec]Add a spec for distiributed load generation" 2015-11-21 00:32:43 +00:00
Jenkins
2321591f99 Merge "[Spec] Propose improvements for scenario output format" 2015-11-20 22:07:50 +00:00
LiuNanke
ad496e55ab Fix some typos by toolkit typo
There commands:
 $pip install topy
 $cd rally
 $topy -a rally

Change-Id: I40ac3b34b97743edf5edc0a17b9553bb2f3476e2
2015-11-20 00:55:01 +08:00
Illia Khudoshyn
335d2d5ead [Spec]Add a spec for distiributed load generation
Change-Id: If2462a1142bbf1ce49cd61ac114ab0ced7394ed8
2015-11-19 14:45:06 +00:00
Alexander Maretskiy
f0668a8e52 [Spec] Propose improvements for scenario output format
Change-Id: Icbf970fc4ebb0ac6fd98e8bf34852eb9f87da623
2015-11-18 16:28:42 +02:00
Jenkins
e2fa9c6f97 Merge "OpenStack typo" 2015-11-16 12:57:51 +00:00
Shuquan Huang
86db380edc OpenStack typo
change capitalization of OpenStack

Change-Id: I990639a0a2a7aa9c995a2c53367d0c424cd522bd
2015-11-15 13:01:34 +08:00
Jenkins
91eee1de6e Merge "[Spec] Task and verification export" 2015-11-09 14:09:44 +00:00
Chris St. Pierre
557c7db0a7 [spec] Improve and make pluggable type conversion
This proposes to make resource type converters into proper plugins,
stop depending on OpenStack as much as is possible without modifying
validation, and make some improvements to handle an edge case
converting images.

Change-Id: If078332230df417b3967f086815796c7a96fa882
2015-11-06 08:49:13 -06:00
Illia Khudoshyn
2ff18a5c5d [Spec] Task and verification export
A spec for exporting task and verification data into external service.

Change-Id: If55a29fcaf2d2a7ba01c2afdb8e68b72399cdac9
2015-11-06 11:35:30 +00:00
Chris St. Pierre
babf25ccdc [spec] Consistent resource names
Name resources consistently to improve cleanup and make Rally more
generic.

Change-Id: I2888b9874c695a6616576c22f3ea218901911b5d
2015-09-03 16:03:39 -05:00
Wataru Takase
94461a0985 [spec] Refactoring Rally cleanup
Change-Id: Ie40373fda63ef79f64a211887021ce0e0e8d9d24
2015-08-20 15:15:47 +09:00
Illia Khudoshyn
e8d28e2367 Fix item name in new task format spec
Change-Id: I33f9661b3b13ff63ed963d79c44c5386e4e2a708
2015-08-06 18:23:58 +03:00
Boris Pavlovic
c3e08084aa Change new input task format specification
We have issue with current format there are 2 things called "task",
"task" is file with bunch of "task" that are run.

I would prefer to split these 2 things:

  task - is file that is run by "rally task" command

  subtasks - is actually single test case described in task file

Change-Id: Ib1a2f39bb91cfb5b0ba0b3d15be53d3a3241bfc7
2015-06-05 16:59:51 +03:00
Yair Fried
65e100e291 [Spec] Move plugins spec to implemented
Change-Id: I729d7feff5ea0e0013a08c83293a5f2cecad9a13
Implements: blueprint split-plugins
2015-05-21 17:14:24 +03:00
Yair Fried
1071b725b7 [Spec] Reorder plugins
Rally has billions of plugins and it becomes really hard for newbies
to understand how Rally code is organized and how it works.

So let's split framework and plugins

Example https://review.openstack.org/#/c/176092/

Change-Id: I6980c0dcbeeabf79e774c69cd27e5e4efca0fc50
2015-05-06 10:28:02 +03:00
Boris Pavlovic
c814ec585a [spec] Proposal for new task input file format
Change-Id: I358b3c796514a5efe6d5de6658489991cdd3e9fa
2015-03-24 04:28:29 +03:00
Boris Pavlovic
c3b27c6c6e Introduce in-tree Rally specs
Most of OpenStack projects have specs.
Specs are documents in .rst format with fixed structure.
They allow developers to use standard gerrit code review approach
to discuss and align future changes in project.

This patch includes:

- doc/specs directory
- doc/specs readme files
- spec template.rst
- unit tests that checks that specs are regarding template

Change-Id: I31e0dbb8bcbc68ca40c67c643d44b27359906b9c
2015-03-08 02:25:17 +03:00