opendev
/
system-config
Code Issues Proposed changes

Check the number of tests run by testr. 

Check that the number of tests run by testr is equal to the number of
tests found by testr. If subunit has a catastrophic failure these two
numbers will not match but testr reports success. Check if the numbers
match and if not fail the build with a useful message.

Change-Id: I849db8912dd0d9974fb83ed08bc93646b0eb3e9f
Reviewed-on: https://review.openstack.org/22456
Reviewed-by: Dan Smith <danms@us.ibm.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Sean Dague <sdague@linux.vnet.ibm.com>
Reviewed-by: Khai Do <zaro0508@gmail.com>
Approved: Clark Boylan <clark.boylan@gmail.com>
Tested-by: Jenkins
This commit is contained in:
Clark Boylan 2013-02-20 10:20:24 -08:00 committed by Jenkins
parent 3ea8d372dc
commit 1012fb2a8e
1 changed files with 17 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

17
modules/jenkins/files/slave_scripts/run-tox.sh
View File

@ -90,4 +90,21 @@ else
echo
fi
if [ -d ".testrepository" ]
then
source .tox/$venv/bin/activate
foundcount=$(testr list-tests | sed -e '1d' | wc -l)
rancount=$(testr last | sed -ne 's/Ran \([0-9]\+\).*tests in.*/\1/p')
if [ "$foundcount" -ne "$rancount" ]
then
echo
echo "The number of tests found did not match the number of tests"
echo "that were run. This indicates a fatal error occured while"
echo "running the tests."
echo "Tests found: $foundcount Tests ran: $rancount"
echo
exit 1
fi
fi
exit $result