Add script to bisect test failures with ttcn3 and docker

With this script you can now use docker ttcn3 test results to bisect a
regression and find the offending commit.

Use like this from the osmo-* git repository:
$ git bisect start <bad-rev> <good-rev>
$ git bisect run ~/scm/osmo/docker-playground/osmo-bisect.sh <component-to-test> <testcase>
e.g.:
$ git bisect run ~/scm/osmo/docker-playground/osmo-bisect.sh bsc BSC_Tests.TC_ho_in_fail_no_detect

Change-Id: I11f7e61a9b30d58a0fdfcaf77dde447806bf661f
This commit is contained in:
Daniel Willmann 2019-04-26 11:57:24 +02:00
parent b59a9ed8d4
commit 6e601e60ad
1 changed files with 53 additions and 0 deletions

53
osmo-bisect.sh Executable file
View File

@ -0,0 +1,53 @@
#!/bin/sh
# Script to bisect an osmo-* project with the docker ttcn3 images
# You need the git checkout of the project you wand to test as well as a
# checkout of the docker-playground repository.
# Use like this from the osmo-* project repository where the regression
# occurs:
# $ git bisect start <bad-rev> <good-rev>
# $ git bisect run ~/scm/osmo/docker-playground/osmo-bisect.sh <component-to-test> <testcase>
# e.g.:
# $ git bisect run ~/scm/osmo/docker-playground/osmo-bisect.sh bsc BSC_Tests.TC_ho_in_fail_no_detect
DOCKER_PLAYGROUND=$(dirname "$0")
COMP_UPPER=$(echo "$1" | tr '[:lower:]' '[:upper:]')
COMP_LOWER=$(echo "$1" | tr '[:upper:]' '[:lower:]')
TESTCASE=$2
COMMIT=$(git log -1 --format=format:%H)
case $COMP_LOWER in
"hnbgw")
BRANCH="OSMO_IUH_BRANCH"
SUITE="ttcn3-hnbgw-test"
;;
"bsc"|\
"bts"|\
"ggsn"|\
"hlr"|\
"mgw"|\
"msc"|\
"nitb"|\
"pcu"|\
"sgsn"|\
"sip"|\
"stp")
BRANCH="OSMO_${COMP_UPPER}_BRANCH"
SUITE="ttcn3-${COMP_LOWER}-test"
;;
*)
echo "Unknown repo, please fix the script!"
exit 125
;;
esac
export "$BRANCH=$COMMIT"
cd "$DOCKER_PLAYGROUND/$SUITE" || exit 125
echo "Testing for $COMMIT"
./jenkins.sh | grep -- "====== $TESTCASE pass ======"
exit $?