42fcb22627
Currently when python clients are called, Rally authenticates with keystone client then pass then token to the clients. This behavior will break the test when the token gets expired. When the token gets expired, the operations using the token will receive a 401 error which instructs the clients to re-new the token with the user crendentials. The python clients will re-authenticate and try to re-send the operation request. However, since the credentials are not passed by Rally, the clients are unable to re-authenticate in which case the operation will fail and break the test. This patch is going to pass the credentials to the python clients to allow the test go beyond the token expiration time. This patch mainly focus on nova and neutron. Please note that some clients do not support this re-authentication mechanism. Change-Id: I2732e9c7053005b265df3122181f99544d4b6100
Testing
Please, don't hesitate to write tests ;)
Unit tests
Files: /tests/unit/*
The goal of unit tests is to ensure that internal parts of the code work properly. All internal methods should be fully covered by unit tests with a reasonable mocks usage.
About Rally unit tests:
- All unit tests are located inside /tests/unit/*
- Tests are written on top of: testtools, fixtures and mock libs
- Tox is used to run unit tests
To run unit tests locally:
$ pip install tox
$ toxTo run py26, py27 or pep8 only:
$ tox -e <name>
#NOTE: <name> is one of py26, py27 or pep8To run py26, py27 against mysql or psql
$ export RALLY_UNITTEST_DB_URL="mysql://user:secret@localhost/rally" $ tox -epy27
To get test coverage:
$ tox -e cover
#NOTE: Results will be in /cover/index.htmlTo generate docs:
$ tox -e docs
#NOTE: Documentation will be in doc/source/_build/html/index.htmlFunctional tests
Files: /tests/functional/*
The goal of functional tests is to check that everything works well together. Fuctional tests use Rally API only and check responses without touching internal parts.
To run functional tests locally:
$ source openrc
$ rally deployment create --fromenv --name testing
$ tox -e cli
#NOTE: openrc file with OpenStack admin credentialsOutput of every Rally execution will be collected under some reports root in directiry structure like: reports_root/ClassName/MethodName_suffix.extension This functionality implemented in tests.functional.utils.Rally.__call__ method. Use 'gen_report_path' method of 'Rally' class to get automaticaly generated file path and name if you need. You can use it to publish html reports, generated during tests. Reports root can be passed throw environment variable 'REPORTS_ROOT'. Default is 'rally-cli-output-files'.
Rally CI scripts
Files: /tests/ci/*
This directory contains scripts and files related to the Rally CI system.
Rally Style Commandments
File: /tests/hacking/checks.py
This module contains Rally specific hacking rules for checking commandments.