- Set workflow step name as junit test suite name
- Set HTML report title
- Render HTML report all test case rows collapsed
- Add tobiko release version and Git commit to
reported environment metadata
Change-Id: Id827146d1f8455047dd5eedfa90171da8be02ea5
Add new env variable to handle test cases
execution when debugging test cases under a
debugger by using testools.run runner.
Change-Id: Ia6ec38e6471d93dd98c3fef17e66e9187c666c9d
- Dockerfile file is intended for running test cases
without using tox
- infrared_plugin/Dockerfile file is intended to run
Tobiko IR plugin
- docker-compose file is intended to emulate the tox
experience by using docker
All images are build staring from official CentOS 8
image.
Change-Id: I2f57f6e1c9c6161cef9448d25027d784ebd37e2c
Tox venv commands are expected to return a code that indicates
test cases final outcome:
- 0 => any test vase has failed
- 1 => some test case has failed
- not in [0, 1] => any other error
This change handles the special case when some test cases have
failed. In any of below cases:
- JENKINS_URL environment variable is defined on controller node
- --ignore-test-failure flag is passed to IR plugin
then the plugin runs without treating it as an error.
This has been introduced because when running the plugin from
a Jenkins slave host, Jenkins itself is expected to check test
case have failed looking at produced Junit XML artifacts.
Change-Id: Ia7d7f736ae18a7561dced2271228d86ca658e892
- Acreate a new tools/run_tests.py script to
execute test cases
- Move report generation to such script and
remove 'report' tox environment
- Running test cases generates report files
(.log, .html, .xml) into 'report/{envname}'
directory
- Test cases failures will returns exit code 1
Other script test runner failures returns
exit code 2
Big refactory to tox.ini file to try semplifying it:
- create the new 'py3' tox environment for running unit
tests as default platform python 3 interpreter
- use same as py3 '{envdir}' for scenario, functional,
neutron and faults tox environments
Change-Id: Id09425245cc86b84b41e6b3b1c1db759cc686f3a
