While we are not depend on OpenStack global-requirements, we need to be synced
with it to be sure that Rally compatible with all OpenStack related stuff.
This patch provides new helper script, which checks versions from g-r, correct
license and latest version from pypi.
The usage is simple:
# sync rally requirements with g-r
tox -e requirements
# just format rally requirements
tox -e requirements -- --format
# sync rally requirements with g-r & add upper limits for all packages
tox -e requirements -- --add-uppers
Also, this patch formats Rally requirements in unified form, puts right
licenses to requirements and adds rally licenses in correct way in setup.cfg
Change-Id: Ia50694f636d9f80f08d90cc8133ebac8bb3f8671
Changes:
* start using pytest-cov library
* if there are uncommitted changes then do not try to
stash them automatically but exit with error message
Co-Authored-By: Andrey Kurilin <andr.kurilin@gmail.com>
Co-Authored-By: Alexander Maretskiy <amaretskiy@mirantis.com>
Change-Id: Id5f396550a600fe0ab899b09aceff60b3d98dc0e
- pytest is used by everybody
- pytest works on MacOS and Windows without any issues
- pytest doesn't require bash scripts in and .testrconfig in repo
- pytest has built-in colorizer
- pytest shows out of box slowest test
- pytest shows progress
This patch does 3 things:
1) Remove testr config file & requirments
2) Add pytest requirments
3) Change tox.ini to use pytest instead of testr
To add parameters to py.test you should add -- and than all args.
For example,
tox -e py27 -- -k "db"
Change-Id: Ide3ddd58a2d1635651fc53404cb5cc7c1c4bab5e
add timestamps with certain interval and resource_metadata into creating
samples in sample_generator
Change-Id: Id24487eb1cd86da065e2d21584b7dda8ebe112cb
Also, this patch turn off coverage job to allow merge this patch.
Closes-bug: #1473362
Depends-On: I0cfab6d13e5d9e744cb302c86a2c21269923e75d
Change-Id: I13ba7b2e20016666d4e0eab4560e2e522f038a15
List of changes:
- Added general support of Manila project.
- Added support of 'list' operation for shares.
- Added benchmark for listing of shares.
- Added two different manila jobs scripts that will be used for two
different Manila installtions. Current benchmark is used without changes in
both installations.
Change-Id: Ie29be6162e788c880aea6816803c9ddea340bcf7
Here we add a new "rally info" command, which, based on the input,
prints descriptions for different entities in Rally (in this patch -
benchmark scenarios & scenario groups, more entities are to follow
(deployment engines etc.)). This command makes use of docstrings by
parsing them and printing them in CLI in human-readable form.
The command should be called as "rally info find <query>" (or, in case
of an explicit parameter setting, "rally info find --query=<query>").
Samples:
$ rally info find create_meter_and_get_stats
CeilometerStats.create_meter_and_get_stats (benchmark scenario).
Test creating a meter and fetching its statistics.
Meter is first created and then statistics is fetched for the same
using GET /v2/meters/(meter_name)/statistics.
Parameters:
- name_length: length of generated (random) part of meter name
- kwargs: contains optional arguments to create a meter
$ rally info find Authenticate
Authenticate (benchmark scenario group).
This class should contain authentication mechanism.
For different types of clients like Keystone.
Change-Id: Icf3545c0666d99ab7fd0eaabce8bbe572834e485
* Remove subunit2junitxml dependency and code from rally
* Convert raw subunit stream from tempest tests to json and store only
json in DB
* Run tempest scenario (smoke) in rally gate
Change-Id: I6628375d83da9af3984819dfc5815ae0c06ec1aa
Implements: blueprint tempest-subunit-to-json
There is a new support library named 'oslotest'
extracted from oslo incubator. So, we add it to
test-requirements.txt and remove deprecated modules
from rally.openstack.common
Change-Id: I1d9efaf2f8a5a4948c454ea3f2e75262479133e8
The patch introduce configuration files for building documentations by
Sphinx. Also added a simple tree of static documents for test ability of
autobuilding documentation from source code.
bp rally-sphinx-docs
Change-Id: I2a225b1bdb4ae0640428b438a0c9779e28586546
Fixtures are required by oslo.lockutils so we should move them to
requirments.
And could move it back after this patch
https://review.openstack.org/#/c/52612/
Will be merged
Change-Id: I018a603c994cf8573020cca28b77fa5716038d8e
Closes-bug: #1241581
This patch introduces the benchmark test framework for rally. The presented
framework relies heavily on the usage of test configuration files which allow
to set up which tests should be run in which order and how many times, as well
as parameterize them (e.g., to configure, say, the number of compute nodes used
in load testing). The test configuration also allows to set whether the
benchmark tests should be launched concurrently in several threads.
Test configuration processing is provided by the further development of
TestEngine, which now also can validate the test configuration passed to its
constructor.
The patch also contains some refactoring of the Tester class which makes it
configurable through the test configuration. This functionality is supported
by the TestConfigManager class, another child class of the base ConfigManager
defined in one of the previous patches.
Blueprint test-engine
Change-Id: Idd1296537d5a65c0b353ee9812d2e360d3c8ea39
