Check the number of tests run by testr.

Check that the number of tests run by testr is equal to the number of
tests found by testr. If subunit has a catastrophic failure these two
numbers will not match but testr reports success. Check if the numbers
match and if not fail the build with a useful message.

Change-Id: I849db8912dd0d9974fb83ed08bc93646b0eb3e9f
Reviewed-on: https://review.openstack.org/22456
Reviewed-by: Dan Smith <danms@us.ibm.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Sean Dague <sdague@linux.vnet.ibm.com>
Reviewed-by: Khai Do <zaro0508@gmail.com>
Approved: Clark Boylan <clark.boylan@gmail.com>
Tested-by: Jenkins
This commit is contained in:
Clark Boylan 2013-02-20 10:20:24 -08:00 committed by Jenkins
parent 3ea8d372dc
commit 1012fb2a8e
1 changed files with 17 additions and 0 deletions

View File

@ -90,4 +90,21 @@ else
echo
fi
if [ -d ".testrepository" ]
then
source .tox/$venv/bin/activate
foundcount=$(testr list-tests | sed -e '1d' | wc -l)
rancount=$(testr last | sed -ne 's/Ran \([0-9]\+\).*tests in.*/\1/p')
if [ "$foundcount" -ne "$rancount" ]
then
echo
echo "The number of tests found did not match the number of tests"
echo "that were run. This indicates a fatal error occured while"
echo "running the tests."
echo "Tests found: $foundcount Tests ran: $rancount"
echo
exit 1
fi
fi
exit $result