958a5673f0
Let's update the coverage job behavior - it will run coverage on current master and then it will run coverage on Head and compare number of new lines w/o test coverage. The default number of allowed uncovered lines is 4. If more lines uncovered job will fail. We'll keep this job non-voting, but this script should help us a lot to monitor the degradation of test coverage. Change-Id: I16336cee3570f50bf80bc84ddb081737c1dd9dab
70 lines
2.3 KiB
Bash
Executable File
70 lines
2.3 KiB
Bash
Executable File
#!/bin/bash
|
|
#
|
|
# Copyright 2015: Mirantis Inc.
|
|
# All Rights Reserved.
|
|
#
|
|
# Licensed under the Apache License, Version 2.0 (the "License"); you may
|
|
# not use this file except in compliance with the License. You may obtain
|
|
# a copy of the License at
|
|
#
|
|
# http://www.apache.org/licenses/LICENSE-2.0
|
|
#
|
|
# Unless required by applicable law or agreed to in writing, software
|
|
# distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
|
|
# WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
|
|
# License for the specific language governing permissions and limitations
|
|
# under the License.
|
|
|
|
ALLOWED_EXTRA_MISSING=4
|
|
|
|
show_diff () {
|
|
head -1 $1
|
|
diff -U 0 $1 $2 | sed 1,2d
|
|
}
|
|
|
|
# Stash uncommitted changes, checkout master and save coverage report
|
|
uncommited=$(git status --porcelain | grep -v "^??")
|
|
[[ -n $uncommited ]] && git stash > /dev/null
|
|
git checkout HEAD^
|
|
|
|
baseline_report=$(mktemp -t sahara_coverageXXXXXXX)
|
|
find . -type f -name "*.pyc" -delete && python setup.py testr --coverage --testr-args="$*"
|
|
coverage report > $baseline_report
|
|
baseline_missing=$(awk 'END { print $3 }' $baseline_report)
|
|
|
|
# Checkout back and unstash uncommitted changes (if any)
|
|
git checkout -
|
|
[[ -n $uncommited ]] && git stash pop > /dev/null
|
|
|
|
# Generate and save coverage report
|
|
current_report=$(mktemp -t sahara_coverageXXXXXXX)
|
|
find . -type f -name "*.pyc" -delete && python setup.py testr --coverage --testr-args="$*"
|
|
coverage report > $current_report
|
|
current_missing=$(awk 'END { print $3 }' $current_report)
|
|
|
|
# Show coverage details
|
|
allowed_missing=$((baseline_missing+ALLOWED_EXTRA_MISSING))
|
|
|
|
echo "Allowed to introduce missing lines : ${ALLOWED_EXTRA_MISSING}"
|
|
echo "Missing lines in master : ${baseline_missing}"
|
|
echo "Missing lines in proposed change : ${current_missing}"
|
|
|
|
if [ $allowed_missing -gt $current_missing ];
|
|
then
|
|
if [ $baseline_missing -lt $current_missing ];
|
|
then
|
|
show_diff $baseline_report $current_report
|
|
echo "I believe you can cover all your code with 100% coverage!"
|
|
else
|
|
echo "Thank you! You are awesome! Keep writing unit tests! :)"
|
|
fi
|
|
exit_code=0
|
|
else
|
|
show_diff $baseline_report $current_report
|
|
echo "Please write more unit tests, we should keep our test coverage :( "
|
|
exit_code=1
|
|
fi
|
|
|
|
rm $baseline_report $current_report
|
|
exit $exit_code
|