osmo-ttcn3-hacks/mgw
Neels Hofmeyr 3cf797d7a5 add compare-results.sh, call from start-testsuite.sh
Compare current test results to the expected results, and exit in error on
discrepancies.

Add compare-result.sh: (trivially) grep junit xml output to determine which
tests passed and which didn't, and compare against an expected-result.log,
another junit file from a previous run. Summarize and determine success.

Include an "xfail" feature: tests that are expected to fail are marked as
"xfail", unexpected failures as "FAIL".

In various subdirs, copy the current jenkins jobs' junit xml outputs as
expected-results.log, so that we will start getting useful output in both
jenkins runs and manual local runs.

In start-testsuite.sh, after running the tests, invoke the results comparison.

Due to the single-line parsing nature, the script so far does not distinguish
between error and failure. I doubt that we actually need to do that though.

Related: OS#3136
Change-Id: I87d62a8be73d73a5eeff61a842e7c27a0066079d
2018-04-06 01:07:15 +02:00
..
MGCP_Test.cfg MGCP_Test: fix config file include path 2018-03-16 13:46:40 +01:00
MGCP_Test.default remove *.default from [EXECUTE] in *.default files 2018-03-13 14:30:55 +01:00
MGCP_Test.ttcn mgw: Fix mixed-up MGW / local IP address 2018-03-29 18:01:51 +02:00
RTP_CodecPort_CtrlFunct.ttcn mgw: Add RTP_CodecPort throguh which we can send/receive RTP+RTCP 2017-11-18 13:28:07 +01:00
RTP_CodecPort_CtrlFunctDef.cc mgw: Add RTP_CodecPort throguh which we can send/receive RTP+RTCP 2017-11-18 13:28:07 +01:00
RTP_Endpoint.ttcn mgw: Add sockets for RTP packets + code for bind/connect/send RTP 2017-11-18 17:19:21 +01:00
expected-results.log add compare-results.sh, call from start-testsuite.sh 2018-04-06 01:07:15 +02:00
gen_links.sh mgw: Add statistics to RTP_Emulation and link/build it in mgw test 2018-03-29 08:49:15 +02:00
regen_makefile.sh mgw: Add statistics to RTP_Emulation and link/build it in mgw test 2018-03-29 08:49:15 +02:00