Make coverage tox job fail when test coverage was reduced

For the moment we can just calculate coverage and generate html with results.
It would be really useful to be able to get 'failure' by this job, when
latest commit introduced reduction of test coverage by any reason - either
addon of new code not covered with unit tests or deletion of existing unit
tests.
It will reduce total required efforts for code reviewers, that are forced now
to perform such check separately and inform about it committer.

Added file 'tools/cover.sh' is taken from OpenStack Rally project as
of state [1], with couple of fixes for satisfying 'bashate'.

Also add configuration file for coverage package.

[1] I7b4defe187c0631928d70bd09d7bcea956f4eed3

Change-Id: Ie0c5721985ae48256d9bb26af5fdb4b05797b359
This commit is contained in:
Valeriy Ponomaryov
2015-07-23 14:34:28 +03:00
parent 533c21129a
commit 4ea9031b4f
3 changed files with 78 additions and 3 deletions

View File

@@ -23,6 +23,7 @@ commands =
contrib/ci/pre_test_hook.sh \
contrib/ci/post_test_hook.sh \
devstack/plugin.sh \
tools/cover.sh \
run_tests.sh
[testenv:genconfig]
@@ -37,9 +38,7 @@ commands = {posargs}
commands = python setup.py build_sphinx
[testenv:cover]
commands =
python setup.py testr --coverage \
--testr-args='^(?!.*test.*coverage).*$'
commands = {toxinidir}/tools/cover.sh {posargs}
[testenv:pylint]
deps = -r{toxinidir}/requirements.txt