4158 Commits

Author SHA1 Message Date
ChangBo Guo(gcb)
c2d8b93be4 Update config sample file with latest config options
Some config options have changed their help text like 'sqlite_db',
so run 'tox -e genconfig' to generate latest config sample file.

Change-Id: Ifad41b2e1203308c02392ad63e3e90853dbbca68
2016-09-23 08:32:30 +00:00
Yaroslav Lobankov
0b4b4b48e7 Fix column name for output of rally task detailed --iterations-data
The `rally task detailed --iterations-data` command prints an output
like this:

+---------------------------+
|   Atomics per iteration   |
+-----------+---------------+
| iteration | full duration |
+-----------+---------------+
| 1         | 0.598         |
| 2         | 0.838         |
| 3         | 0.906         |
| 4         | 0.763         |
| 5         | 0.929         |
| 6         | 0.632         |
| 7         | 0.636         |
| 8         | 0.926         |
| 9         | 0.702         |
| 10        | 0.756         |
+-----------+---------------+

However, the term 'full duration' is not applicable to a single iteration.
It should be applicable to all iterations. So the output should be as follows:

+---------------------------+
|   Atomics per iteration   |
+-----------+---------------+
| iteration | duration      |
+-----------+---------------+
| 1         | 0.598         |
| 2         | 0.838         |
| 3         | 0.906         |
| 4         | 0.763         |
| 5         | 0.929         |
| 6         | 0.632         |
| 7         | 0.636         |
| 8         | 0.926         |
| 9         | 0.702         |
| 10        | 0.756         |
+-----------+---------------+

Change-Id: I5714b486b10a21758d47993413c566a561f78197
2016-09-22 13:40:16 +03:00
Jenkins
f1a9abd5c9 Merge "Add sys_call hook" 2016-09-20 22:19:28 +00:00
Jenkins
f3518df1bf Merge "Fixing docker-check jenkins job" 2016-09-20 16:45:07 +00:00
Jenkins
a805328ad7 Merge "[magnum] Move list baymodels in a scenario class" 2016-09-20 16:14:47 +00:00
Jenkins
1c4c798c94 Merge "[Magnum] Context and scenario for Magnum baymodel" 2016-09-20 16:14:39 +00:00
Jenkins
89fb675c03 Merge "Adding the task attribute to the Hook instance" 2016-09-20 15:45:27 +00:00
Jenkins
e38d6cd481 Merge "Moving set of scenarios into separate classes" 2016-09-20 15:45:22 +00:00
Jenkins
75aa51b8d3 Merge "Moving of Ceilometer Alarms scenarios into separate classes" 2016-09-20 15:45:15 +00:00
Jenkins
c21d96b2b2 Merge "Moving of Volumes scenarios into separate classes" 2016-09-20 15:45:07 +00:00
Jenkins
9e88d7d0f3 Merge "Moving of Ceilometer scenarios into separate classes" 2016-09-20 15:25:25 +00:00
Yaroslav Lobankov
3d279c14bf Fixing docker-check jenkins job
The python-fuelclient requirement conflicts with other ones.
See logs from the docker job for more details.

Change-Id: I055eaf619ae62752c5fba6d1db26c91dbbbc86cb
2016-09-20 16:56:00 +03:00
Jenkins
060c22060e Merge "Moving of Heat scenarios into separate classes" 2016-09-20 13:22:37 +00:00
Anton Studenov
bc6b4197c3 Add sys_call hook
Allows to perform system call

implements spec: hook_section

Change-Id: I1dbe468b6d72f8455d0a71fd90ed4b65f1d5d048
2016-09-20 14:21:16 +03:00
Anton Staroverov
1bd3e85906 Moving of Heat scenarios into separate classes
Since current scenario implementation transforms method to class at runtime,
it is reasonable to have class-based scenario implementation which will be
much simpler to use behind the scenes.

This class should be based on Scenario and do not break compatibility.
The only required method is run() which is actually a body of scenario.

This patch contains changes for HEAT scenarios and tests

Change-Id: I92a1b63c40a67abbe05a78ba35ca53dc73952e75
2016-09-20 13:14:32 +03:00
Spyros Trigazis
aad4a613df [magnum] Move list baymodels in a scenario class
Update list baymodels implementation to the current class-based
scenario implementation.

Change-Id: I4f67fec9d4f6c4938149c7d6b597b1cc984a191c
2016-09-20 11:51:56 +02:00
zhufl
edf0beb68a Remove unnecessary setUp
setUp will be automatically called around each
testcase, so this is to remove setUp that doing
nothing additional than super to keep code clean.

Change-Id: I33dafd4525c9815961aa55ad652bc8df20cd84d4
2016-09-20 14:24:38 +08:00
Yaroslav Lobankov
6bcd6d57d4 Adding the task attribute to the Hook instance
Hook plugins allow us to run anything at some iterations. It depends
on the plugin. There can be cases when we need to get access the task
object in plugins to retrieve, for example, credentials. So this patch
resolves the issue.

Change-Id: Ie1f8a9da16715c85b8593cffba5c21bb497a6fb0
2016-09-19 13:46:25 +00:00
Winnie Tsang
5f8662e5eb [Magnum] Context and scenario for Magnum baymodel
Context and scenario to create baymodel

All Magnum scenarios will use some baymodels.
This patch sets up the Rally context to create any
baymodels needed by a scenario.  All baymodels created
will be cleaned up at the end of the job.

A simple scenario is included to test a Magnum job in
Rally.  Currently the scenario only lists the baymodel created
by the context, but later more user query type of actions can
be added to similate a large user base interacting with Magnum.

The job yaml file specifies the 3 bay types to be created by the
context:  Kubernetes, Swarm, Mesos.

Partially-Implements: blueprint benchmark-scenarios-for-magnum
Co-Authored-By: Ton Ngo <ton@us.ibm.com>
Co-Authored-By: Spyros Trigazis <strigazi@gmail.com>
Change-Id: I0979f2461c6e33c9163e19a6d7884fe1c7967e3f
2016-09-19 08:07:09 +00:00
Jenkins
faa00bea07 Merge "New plugin type - Hook" 2016-09-16 19:20:37 +00:00
Jenkins
9793384ba4 Merge "New plugin type - Trigger" 2016-09-16 19:20:30 +00:00
Jenkins
a7203a33ea Merge "Move clients to the usage of sessions" 2016-09-16 17:11:17 +00:00
Anton Staroverov
372d46dc96 Moving of Volumes scenarios into separate classes
Implements blueprint class-based-scenarios

Since current scenario implementation transforms method to class
at runtime, it is reasonable to have class-based scenario
implementation which will be much simpler to use behind the scenes.

This class should be based on Scenario and do not break compatibility.
The only required method is run() which is actually a body of scenario.

Contains changes for Cinder/Volumes scenarios/tests

Change-Id: I640b88723672d60de4148bb333df88f1c7fa20e5
2016-09-16 15:05:58 +00:00
Anton Staroverov
f83ca25144 Moving set of scenarios into separate classes
Implements blueprint class-based-scenarios

This patch contains changes in following modules
(both scenarios and modules):
Manila
Mistral
Monasca
Murano

Change-Id: I1df08e471b3bc7001b11849e9d0186914dbb5b82
2016-09-16 14:16:30 +00:00
Jenkins
866f402228 Merge "Add simple wrapper for pytest" 2016-09-16 13:08:08 +00:00
Anton Studenov
6273674aa2 New plugin type - Hook
- Added Hook Base class
- Added HookExecuter

implements spec: hook_section

Change-Id: Ib72247c412ba06ec107b2635c79ce109bef83f16
2016-09-16 13:42:15 +03:00
Anton Studenov
03c8740588 New plugin type - Trigger
Triggers determine when hooks should be executed.
Added event trigger.
Added utils required for implementation of hook_section spec.

implements spec: hook_section

Change-Id: I33d558468f221a7c731e4a3fd42deb4f76be671a
2016-09-16 13:40:05 +03:00
Anton Staroverov
1783156ccf Moving of Ceilometer Alarms scenarios into separate classes
Since current scenario implementation transforms method to class
at runtime, it is reasonable to have class-based scenario
implementation which will be much simpler to use behind the scenes.

This class should be based on Scenario and do not break compatibility.
The only required method is run() which is actually a body of scenario.

Change-Id: I1f1ef261942bcaf7617a5f10f05a74fae35c53f2
2016-09-16 09:27:54 +00:00
Jenkins
8ff0f2ee8c Merge "Rework optional-requirements" 2016-09-16 00:26:59 +00:00
Jenkins
4acb199a66 Merge "Port Senlin and others scenarios to new style" 2016-09-15 23:44:24 +00:00
Jenkins
93dd392783 Merge "[task] Fix verification log" 2016-09-15 23:44:17 +00:00
Jenkins
e478d4e781 Merge "[Reports] Add new OutputTextArea chart plugin" 2016-09-15 23:44:11 +00:00
Jenkins
5b0e5c8654 Merge "[Reports] Fix layout in base.html" 2016-09-15 23:43:21 +00:00
Andrey Kurilin
878ed9bea1 [rally-jobs] unblock gates
Temporary move failed gates to non-voting job

Change-Id: Ie58ed4997026ab5502dbe203fd1ad0d5ef816a15
2016-09-15 18:29:05 +03:00
Andrey Kurilin
2bfe9a9928 [task] Fix verification log
While fix for bug #1562713 changed the way how to save verification log in
case of some issues at CLI layer, it did not fixed old saved logs. Also, it
produced one more bug - IOError trace was saved as list instead of string.

This patch fixes the way of storage IOError and add migration to fix old data

Also, we change format of verification_log to dict here
Change-Id: Iffcf066e7033acd48f1446baebe0b2e9a334449f
Related-Bug: #1562713
2016-09-15 12:19:17 +03:00
Alexander Maretskiy
b6324c234a [Reports] Fix layout in base.html
There is a piece of MAKO code in the layout,
which must be removed.

Change-Id: Ie4137e695f21c2dde77b941bec0d5486375e4d62
2016-09-14 17:30:51 +03:00
Lucio Seki
22013dcfde Fix scenario miscount in the tutorial
Change-Id: Ibf855a2e73048e0e6d703a63ddb7e895f97406c2
2016-09-14 09:21:37 -03:00
astaroverov
eb66136085 Port Senlin and others scenarios to new style
Since current scenario implementation transforms method to class
at runtime, it is reasonable to have class-based scenario
implementation which will be much simpler to use behind the scenes.

This class should be based on Scenario and do not break compatibility.
The only required method is run() which is actually a body of scenario.

This patch contains changes in following groups (scenarios and tests):
/senlin/
/swift/
/tempest/
/vm/
/watcher/
/zaqar/

and modules:

rally/plugins/openstack/context/vm/custom_image.py
tests/unit/test_docstrings.py

Change-Id: Ia7f33d7c279991232286b34abe199d125b92f023
2016-09-14 11:44:50 +03:00
Andrey Kurilin
6c3809aa48 Rework optional-requirements
As discussed at weekly meeting, we should use optional-requirements only
for small number of cases.

This patch:
 - moves most of packages from optional-requirements to requirements
 - make groups of packages in requirements.txt
 - sorts Openstack related group of package
 - describes purpose of optional-requirements

Change-Id: I24fff516588d064069bf4226adeb0ae209c16d42
2016-09-13 18:31:23 +03:00
Jenkins
bea20ca6ec Merge "[Reports] Use timestamps on X axis in trends report" 2016-09-13 14:39:37 +00:00
Roman Vasilets
ce23aef652 Move clients to the usage of sessions
Initialize following clients by keystone session:
  * Nova, Neutron, Glance, Heat, Cinder, Ceilometer, Sahara,
    Mistral, Manila, Ironic, Trove, Watcher

Monasca currently not support initializing through session.
Senlin initializing through sessoin is broken for now. Should be
fixed after openstack-sdk will cut release.

Change-Id: I66301e3a002a67174ef84594ac38936c4d8b9f41
2016-09-13 16:17:52 +03:00
Anton Staroverov
11c2c6f12a Moving of Ceilometer scenarios into separate classes
Since current scenario implementation transforms method to class
at runtime, it is reasonable to have class-based scenario
implementation which will be much simpler to use behind the scenes.

This class should be based on Scenario and do not break compatibility.
The only required method is run() which is actually a body of scenario.

Following modules were redesigned:
        ceilometer/meters.py
        ceilometer/resources.py
        ceilometer/samples.py
        ceilometer/stats.py
        ceilometer/traits.py

Change-Id: Ia2af282df98cb57ca8ba95cd343bd4506a474b23
2016-09-13 15:35:26 +03:00
Jenkins
e69687bfce Merge "Refactor sleep_between" 2016-09-12 13:47:42 +00:00
Jenkins
c10c5f9c88 Merge "[Tests] Ignore too long mock names" 2016-09-12 11:49:16 +00:00
Jenkins
e6f4dafc9a Merge "[requirements] Update requirements" 2016-09-10 11:30:48 +00:00
Jenkins
826312b22e Merge "Update error messages for ceilometer event scenarios" 2016-09-09 17:02:20 +00:00
Alexander Maretskiy
d96417fcf6 [Tests] Ignore too long mock names
It is very inconvenient and even sometimes not possible
(PEP8 restrictions for line length) to use long mock names,
so they are ignored if name if longer than
FuncMockArgsDecoratorsChecker.SHORTEST_VARIANT_LEN_LIMIT.

For example, existing name
`mock_murano_scenario__create_environment' is simplified
in this patch.

Change-Id: Ia2adf7098c60497c3b1fe5048e1145e47b56bc18
2016-09-09 19:14:32 +03:00
Gleb Stepanov
97f8495de6 Refactor sleep_between
Add ability to call sleep_between with single argument
to avoid redundant argument duplication.

Change-Id: I04c6c0385dcfc77e8491b429503b8859a5b83586
2016-09-09 16:47:26 +03:00
Andrey Kurilin
8e8ccc4304 Update error messages for ceilometer event scenarios
In case of empty list of events, rally raises IndexError.
It is not user-friednly and without reading code, it is hard to understand what
had happend.

Change-Id: I998614ca842aaee62b1ea4e77713f527190338ff
2016-09-09 14:36:34 +03:00
Jenkins
7abb2fe7e8 Merge "Add __ne__ built-in function" 2016-09-09 08:51:15 +00:00