32c91c7264
Tox venv commands are expected to return a code that indicates test cases final outcome: - 0 => any test vase has failed - 1 => some test case has failed - not in [0, 1] => any other error This change handles the special case when some test cases have failed. In any of below cases: - JENKINS_URL environment variable is defined on controller node - --ignore-test-failure flag is passed to IR plugin then the plugin runs without treating it as an error. This has been introduced because when running the plugin from a Jenkins slave host, Jenkins itself is expected to check test case have failed looking at produced Junit XML artifacts. Change-Id: Ia7d7f736ae18a7561dced2271228d86ca658e892 |
||
|---|---|---|
| devstack | ||
| doc | ||
| etc/oslo-config-generator | ||
| infrared_plugin | ||
| playbooks | ||
| releasenotes | ||
| roles | ||
| tobiko | ||
| tools | ||
| zuul.d | ||
| .ansible-lint | ||
| .coveragerc | ||
| .gitignore | ||
| .gitreview | ||
| .stestr.conf | ||
| LICENSE | ||
| Pipfile | ||
| README.rst | ||
| Vagrantfile | ||
| ansible.cfg | ||
| bindep.txt | ||
| infrared-requirements.txt | ||
| linters-requirements.txt | ||
| requirements.txt | ||
| setup.cfg | ||
| setup.py | ||
| test-requirements.txt | ||
| tobiko.conf.example | ||
| tox.ini | ||
README.rst
Tobiko
Test Big Cloud Operations
Tobiko is an OpenStack testing framework focusing on areas mostly complementary to Tempest. While tempest main focus has been testing OpenStack rest APIs, the main Tobiko focus would be to test OpenStack system operations while "simulating" the use of the cloud as the final user would.
Tobiko's test cases populate the cloud with workloads such as instances, allows the CI workflow to perform an operation such as an update or upgrade, and then runs test cases to validate that the cloud workloads are still functional.
Project Requirements
Tobiko Python framework is being tested with below Python versions:
- Python 3.6
- Python 3.7
- Python 3.8
and below Linux distributions:
- CentOS 7 (with Python 3.6 and 3.8)
- Ubuntu Bionic (with Python 3.6 and 3.7)
The framework is being used for executing test cases. As Tobiko can be executed on nodes that are not part of the cloud to test against, this doesn't mean Tobiko requires cloud nodes have to run with one of tested Python versions or Linux distributions.
Main Project Goals
- To provide a Python framework to write system scenario test cases.
- To provide tools for testing OpenStack system operations like update, upgrades and fast forward upgrade.
- To provide CLI tools to implement a workflow designed to test potentially destructive operations (like rebooting cloud nodes, restarting services or others kinds of fault injections).
- To provide tools to monitor and recollect the healthy status of the cloud as seen from user perspective (black-box testing) or from inside (white-box testing).
References
- Free software: Apache License, Version 2.0
- Documentation: https://tobiko.readthedocs.io/en/latest/
- Release notes: https://docs.openstack.org/releasenotes/tobiko/
- Source: https://opendev.org/x/tobiko
- Bugs: https://storyboard.openstack.org/#!/project/x/tobiko