ttcn3
/
osmo-ttcn3-hacks
mirror of https://gerrit.osmocom.org/osmo-ttcn3-hacks
10
0
Fork 1
Code Issues Releases Wiki Activity
osmo-ttcn3-hacks/bsc/expected-results.xml

141 lines
11 KiB
XML
Raw Normal View History

add compare-results.sh, call from start-testsuite.sh Compare current test results to the expected results, and exit in error on discrepancies. Add compare-result.sh: (trivially) grep junit xml output to determine which tests passed and which didn't, and compare against an expected-result.log, another junit file from a previous run. Summarize and determine success. Include an "xfail" feature: tests that are expected to fail are marked as "xfail", unexpected failures as "FAIL". In various subdirs, copy the current jenkins jobs' junit xml outputs as expected-results.log, so that we will start getting useful output in both jenkins runs and manual local runs. In start-testsuite.sh, after running the tests, invoke the results comparison. Due to the single-line parsing nature, the script so far does not distinguish between error and failure. I doubt that we actually need to do that though. Related: OS#3136 Change-Id: I87d62a8be73d73a5eeff61a842e7c27a0066079d
2018-04-05 14:56:38 +00:00
<?xml version="1.0"?>
bsc: Introduce test TC_ctrl_location Related: OS#2012 Change-Id: I3640f6889e3b6adc3b4601082f948543c64a2fe3
2019-06-07 17:43:45 +00:00
<testsuite name='BSC_Tests' tests='107' failures='0' errors='0' skipped='0' inconc='0' time='MASKED'>
mask timestamps and source file nrs in expected-results.xml files Prepare for upcoming updates with concise diffs. Change-Id: Ic9f006aa8db1b477598605e0525faeb229b03641
2018-04-11 13:56:41 +00:00
<testcase classname='BSC_Tests' name='TC_ctrl_msc_connection_status' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_ctrl_msc0_connection_status' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_ctrl' time='MASKED'/>
bsc: Introduce test TC_ctrl_location Related: OS#2012 Change-Id: I3640f6889e3b6adc3b4601082f948543c64a2fe3
2019-06-07 17:43:45 +00:00
<testcase classname='BSC_Tests' name='TC_ctrl_location' time='MASKED'/>
mask timestamps and source file nrs in expected-results.xml files Prepare for upcoming updates with concise diffs. Change-Id: Ic9f006aa8db1b477598605e0525faeb229b03641
2018-04-11 13:56:41 +00:00
<testcase classname='BSC_Tests' name='TC_chan_act_noreply' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_chan_act_counter' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_chan_act_ack_noest' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_chan_act_ack_est_ind_noreply' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_chan_act_ack_est_ind_refused' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_chan_act_nack' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_chan_exhaustion' time='MASKED'/>
BSC_Tests.ttcn: introduce TC_chan_deact_silence The idea of this test case is to verify channel deactivation procedure due to no response to Immediate Assignment. Change-Id: I00b0838c9f919303aef72280248b0d1317f42b3b Related: OS#3709
2018-11-26 18:32:57 +00:00
<testcase classname='BSC_Tests' name='TC_chan_deact_silence' time='MASKED'/>
mask timestamps and source file nrs in expected-results.xml files Prepare for upcoming updates with concise diffs. Change-Id: Ic9f006aa8db1b477598605e0525faeb229b03641
2018-04-11 13:56:41 +00:00
<testcase classname='BSC_Tests' name='TC_chan_rel_rll_rel_ind' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_chan_rel_conn_fail' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_chan_rel_hard_clear' time='MASKED'/>
bsc: add TC_chan_rel_hard_clear_csfb to expected-results.xml The testcase TC_chan_rel_hard_clear_csfb is missing from the expected-results.xml. Lets add it. Change-Id: I087e6715364f72944cb47fa64d96eab6538afda5
2019-03-21 08:56:30 +00:00
<testcase classname='BSC_Tests' name='TC_chan_rel_hard_clear_csfb' time='MASKED'/>
mask timestamps and source file nrs in expected-results.xml files Prepare for upcoming updates with concise diffs. Change-Id: Ic9f006aa8db1b477598605e0525faeb229b03641
2018-04-11 13:56:41 +00:00
<testcase classname='BSC_Tests' name='TC_chan_rel_hard_rlsd' time='MASKED'/>
update expected results Change-Id: I32c29e62ca317937db771f8fb1540bb1fe9da2ab
2018-09-06 12:13:34 +00:00
<testcase classname='BSC_Tests' name='TC_chan_rel_hard_rlsd_ms_dead' time='MASKED'/>
mask timestamps and source file nrs in expected-results.xml files Prepare for upcoming updates with concise diffs. Change-Id: Ic9f006aa8db1b477598605e0525faeb229b03641
2018-04-11 13:56:41 +00:00
<testcase classname='BSC_Tests' name='TC_chan_rel_a_reset' time='MASKED'/>
bsc: Introduce test TC_chan_rel_sccp_tiar_timeout Verify SCCP T(iar) timeout triggers release of established channel. Change-Id: Ic2724f62689b99c33e2e5c3a0c2fd022178a788c
2020-01-09 18:55:40 +00:00
<testcase classname='BSC_Tests' name='TC_chan_rel_sccp_tiar_timeout' time='MASKED'/>
mask timestamps and source file nrs in expected-results.xml files Prepare for upcoming updates with concise diffs. Change-Id: Ic9f006aa8db1b477598605e0525faeb229b03641
2018-04-11 13:56:41 +00:00
<testcase classname='BSC_Tests' name='TC_outbound_connect' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_cic_only' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_csd' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_ctm' time='MASKED'/>
update expected results: bsc, sgsn Change-Id: Icc8bb648b3c79b2e29450ca38dd95bad1d2d09aa
2018-06-07 13:47:26 +00:00
<testcase classname='BSC_Tests' name='TC_assignment_sign' time='MASKED'/>
mask timestamps and source file nrs in expected-results.xml files Prepare for upcoming updates with concise diffs. Change-Id: Ic9f006aa8db1b477598605e0525faeb229b03641
2018-04-11 13:56:41 +00:00
<testcase classname='BSC_Tests' name='TC_assignment_fr_a5_0' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_fr_a5_1' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_fr_a5_1_codec_missing' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_fr_a5_3' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_fr_a5_4' time='MASKED'/>
bsc: Update expected-results.xml with 3 new ciphering related tests Change-Id: I2465016a7f355a657187d39c90992ade1afe584f
2018-05-10 21:04:00 +00:00
<testcase classname='BSC_Tests' name='TC_ciph_mode_a5_0' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_ciph_mode_a5_1' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_ciph_mode_a5_3' time='MASKED'/>
mask timestamps and source file nrs in expected-results.xml files Prepare for upcoming updates with concise diffs. Change-Id: Ic9f006aa8db1b477598605e0525faeb229b03641
2018-04-11 13:56:41 +00:00
<testcase classname='BSC_Tests' name='TC_assignment_codec_fr' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_hr' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_efr' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_amr_f' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_amr_h' time='MASKED'/>
BSC_Tests: Add tests to check channel allocator When a channel is assigned via the assignment request throught the A interface, the MSC may offer either FR, HR or both. When FR and HR are permitted, a preference is set on one of the two. At the moment we do not check how the bsc is reacting to those preferences and its also not checked how the behavior is when the preferred rate is not available because all lchan of that type are already in use. Lets add a set of tests to verify this. Change-Id: I109d986dd7ece1a56422a669ca64353ed46f7ed6 Depends: osmo-bsc I397e68e26d6a1727890353fa34f4897b54795866 Related: OS#3503
2019-01-08 12:41:39 +00:00
<testcase classname='BSC_Tests' name='TC_assignment_codec_fr_exhausted_req_hr' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_fr_exhausted_req_fr' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_fr_exhausted_req_fr_hr' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_fr_exhausted_req_hr_fr' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_hr_exhausted_req_fr' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_hr_exhausted_req_hr' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_hr_exhausted_req_hr_fr' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_hr_exhausted_req_fr_hr' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_req_hr_fr' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_req_fr_hr' time='MASKED'/>
bsc: Introduce Osmux infra and one test for osmo-bsc Test verifies once osmux is enabled in osmo-bsc, BSSMAP RESET (ACK) contains Osmux Support IE and that it correctly handles BSSMAP ASsign Req with Osmux CID. Related: OS#2551 Depends: osmo-bsc 6de754cdde5319af3059d8fc6abf85037ec7eacc Depends: titan.ProtocolModules.BSSMAP Iaf1e137269c0da20b2c96fd104b57edf336693af Change-Id: If69c716dc06d61d810c32d1720a237c7535baca8
2019-05-20 17:31:47 +00:00
<testcase classname='BSC_Tests' name='TC_assignment_osmux' time='MASKED'/>
mask timestamps and source file nrs in expected-results.xml files Prepare for upcoming updates with concise diffs. Change-Id: Ic9f006aa8db1b477598605e0525faeb229b03641
2018-04-11 13:56:41 +00:00
<testcase classname='BSC_Tests' name='TC_rll_est_ind_inact_lchan' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_rll_est_ind_inval_sapi1' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_rll_est_ind_inval_sapi3' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_rll_est_ind_inval_sacch' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_paging_imsi_nochan' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_paging_tmsi_nochan' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_paging_tmsi_any' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_paging_tmsi_sdcch' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_paging_tmsi_tch_f' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_paging_tmsi_tch_hf' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_paging_imsi_nochan_cgi' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_paging_imsi_nochan_lac_ci' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_paging_imsi_nochan_ci' time='MASKED'/>
expect previously failing paging tests to pass Two paging tests were failing in Jenkins due to a configuration problem. This has now been fixed so we can expect these two tests to pass: TC_paging_imsi_nochan_lac TC_paging_imsi_nochan_lai Related: g#9361 Related: docker-playground 4147adabb9917fd852cc49c93603f379ec810c6b Change-Id: I1a3dc5fb13385549bb9ec523271a5da5dc6aaa8c
2018-05-29 15:14:02 +00:00
<testcase classname='BSC_Tests' name='TC_paging_imsi_nochan_lai' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_paging_imsi_nochan_lac' time='MASKED'/>
mask timestamps and source file nrs in expected-results.xml files Prepare for upcoming updates with concise diffs. Change-Id: Ic9f006aa8db1b477598605e0525faeb229b03641
2018-04-11 13:56:41 +00:00
<testcase classname='BSC_Tests' name='TC_paging_imsi_nochan_all' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_paging_imsi_nochan_plmn_lac_rnc' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_paging_imsi_nochan_rnc' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_paging_imsi_nochan_lac_rnc' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_paging_imsi_nochan_lacs' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_paging_imsi_nochan_lacs_empty' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_paging_imsi_nochan_cgi_unknown_cid' time='MASKED'/>
bsc, msc: update expected results Mark TC_paging_imsi_a_reset fixed. Add various new tests. Change-Id: Ib3a36efeb086fd995d7dad4e040f5a46b1b1ca0a
2018-04-11 13:54:07 +00:00
<testcase classname='BSC_Tests' name='TC_paging_imsi_a_reset' time='MASKED'/>
mask timestamps and source file nrs in expected-results.xml files Prepare for upcoming updates with concise diffs. Change-Id: Ic9f006aa8db1b477598605e0525faeb229b03641
2018-04-11 13:56:41 +00:00
<testcase classname='BSC_Tests' name='TC_paging_imsi_load' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_paging_counter' time='MASKED'/>
bsc: Introduce test TC_paging_resp_unsol With this test we want to verify that channels are released if BSC fails to complete an L3 request, for instance because no pending Paging CMD is found for a received Paging Response. Related: OS#3680 Change-Id: Iabe8a51aa13d2fcfec4500cf7aab47d60cc138ce
2018-11-05 11:41:05 +00:00
<testcase classname='BSC_Tests' name='TC_paging_resp_unsol' time='MASKED'/>
mask timestamps and source file nrs in expected-results.xml files Prepare for upcoming updates with concise diffs. Change-Id: Ic9f006aa8db1b477598605e0525faeb229b03641
2018-04-11 13:56:41 +00:00
<testcase classname='BSC_Tests' name='TC_rsl_drop_counter' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_rsl_unknown_unit_id' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_oml_unknown_unit_id' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_classmark' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_unsol_ass_fail' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_unsol_ass_compl' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_unsol_ho_fail' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_err_82_short_msg' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_err_84_unknown_msg' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_ho_int' time='MASKED'/>
bsc: inter-BSC HO: add TC_ho_out_of_this_bsc, TC_ho_into_this_bsc Add f_gen_handover_req() like f_gen_ass_req(), to match AoIP or SCCPlite requirements. For incoming HO, MSC_ConnHdlr needs to know the SCCP addresses to expect the incoming SCCP Connection from MSC to BSC. Add 'handover' section to TestHdlrParams, and pass in the addresses from test_CT via that. In osmo-bsc.cfg, add a remote neighbor config, so that the VTY command 'handover any to arfcn 123 bsic any' can trigger an outgoing inter-BSC HO. Add various BSSMAP handover templates to BSSMAP_Templates.ttcn. Add RR Ho Command template to L3_Templates.ttcn. Move ts_BSSAP_Conn_Req() from msc/BSC_ConnectionHandler.ttcn to library/BSSMAP_Emulation.ttcn, so we can also model an SCCP Connection Request in BSC_Tests.ttcn (this time from MSC to BSC). Add the two new tests to bsc/expected-results.xml. Related: OS#2283 Change-Id: Id22852d4be7f127d827e7a8beeec55db27c07f03
2018-03-19 13:58:46 +00:00
<testcase classname='BSC_Tests' name='TC_ho_out_of_this_bsc' time='MASKED'/>
bsc: add 3 tests for inter-BSC HO outgoing failures Add * TC_ho_out_fail_no_msc_response() * TC_ho_out_fail_rr_ho_failure() * TC_ho_out_fail_no_ho_detect() Depends: I0980cacb9713e41a1eef3a0a7f6cc892e8a20da5 (osmo-bsc) Change-Id: If772dbbc5f9790d3f911465e1303dd0a99811154
2018-10-09 16:28:06 +00:00
<testcase classname='BSC_Tests' name='TC_ho_out_fail_no_msc_response' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_ho_out_fail_rr_ho_failure' time='MASKED'/>
rename TC_ho_out_fail_no_ho_detect to TC_ho_out_fail_no_result_after_ho_cmd Change-Id: If84a1d4535ee12e33a50588e178bf1ebb6fb2cd5
2019-07-09 17:46:01 +00:00
<testcase classname='BSC_Tests' name='TC_ho_out_fail_no_result_after_ho_cmd' time='MASKED'/>
bsc: inter-BSC HO: add TC_ho_out_of_this_bsc, TC_ho_into_this_bsc Add f_gen_handover_req() like f_gen_ass_req(), to match AoIP or SCCPlite requirements. For incoming HO, MSC_ConnHdlr needs to know the SCCP addresses to expect the incoming SCCP Connection from MSC to BSC. Add 'handover' section to TestHdlrParams, and pass in the addresses from test_CT via that. In osmo-bsc.cfg, add a remote neighbor config, so that the VTY command 'handover any to arfcn 123 bsic any' can trigger an outgoing inter-BSC HO. Add various BSSMAP handover templates to BSSMAP_Templates.ttcn. Add RR Ho Command template to L3_Templates.ttcn. Move ts_BSSAP_Conn_Req() from msc/BSC_ConnectionHandler.ttcn to library/BSSMAP_Emulation.ttcn, so we can also model an SCCP Connection Request in BSC_Tests.ttcn (this time from MSC to BSC). Add the two new tests to bsc/expected-results.xml. Related: OS#2283 Change-Id: Id22852d4be7f127d827e7a8beeec55db27c07f03
2018-03-19 13:58:46 +00:00
<testcase classname='BSC_Tests' name='TC_ho_into_this_bsc' time='MASKED'/>
update expected results Change-Id: Idacaf8343bed4a37878eacdf338c4d5eb46bf7a7
2019-01-23 11:44:09 +00:00
<testcase classname='BSC_Tests' name='TC_ho_in_fail_msc_clears' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_ho_in_fail_msc_clears_after_ho_detect' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_ho_in_fail_no_detect' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_ho_in_fail_no_detect2' time='MASKED'/>
mask timestamps and source file nrs in expected-results.xml files Prepare for upcoming updates with concise diffs. Change-Id: Ic9f006aa8db1b477598605e0525faeb229b03641
2018-04-11 13:56:41 +00:00
<testcase classname='BSC_Tests' name='TC_bssap_rlsd_does_not_cause_bssmap_reset' time='MASKED'/>
update expected results Change-Id: I32c29e62ca317937db771f8fb1540bb1fe9da2ab
2018-09-06 12:13:34 +00:00
<testcase classname='BSC_Tests' name='TC_bssmap_clear_does_not_cause_bssmap_reset' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_ms_rel_ind_does_not_cause_bssmap_reset' time='MASKED'/>
bsc, msc: update expected results Mark TC_paging_imsi_a_reset fixed. Add various new tests. Change-Id: Ib3a36efeb086fd995d7dad4e040f5a46b1b1ca0a
2018-04-11 13:54:07 +00:00
<testcase classname='BSC_Tests' name='TC_dyn_pdch_ipa_act_deact' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_dyn_pdch_ipa_act_nack' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_dyn_pdch_osmo_act_deact' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_dyn_pdch_osmo_act_nack' time='MASKED'/>
update expected results Change-Id: Idacaf8343bed4a37878eacdf338c4d5eb46bf7a7
2019-01-23 11:44:09 +00:00
<testcase classname='BSC_Tests' name='TC_chopped_ipa_ping' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_chopped_ipa_payload' time='MASKED'/>
bsc: Verify presence of MS Power Parameters IE on one test Otherwise most tests in bsc-latest fail because in latest release BSC never sends that IE. Related: OS#4244 Change-Id: I725836784a7900d2ea51eae188c2c279e8639dbf
2019-11-05 10:46:53 +00:00
<testcase classname='BSC_Tests' name='TC_assignment_verify_ms_power_params_ie' time='MASKED'/>
update expected results Change-Id: I32c29e62ca317937db771f8fb1540bb1fe9da2ab
2018-09-06 12:13:34 +00:00
<testcase classname='BSC_Tests' name='TC_early_conn_fail' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_late_conn_fail' time='MASKED'/>
expected-results: add new S15-S0 related testscases The S15-S0 related testscases are missing from the expected-results.xml file. Lets add them. Change-Id: I28a853ec25feb723b2d333061e1ae4d2e0b34d86 Related: SYS#4470
2019-03-20 08:19:08 +00:00
<testcase classname='BSC_Tests' name='TC_assignment_codec_amr_f_S1' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_amr_h_S1' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_amr_f_S124' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_amr_h_S124' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_amr_f_S0' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_amr_f_S02' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_amr_f_S024' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_amr_f_S0247' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_amr_h_S0' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_amr_h_S02' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_amr_h_S024' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_amr_h_S0247' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_amr_f_S01234567' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_amr_f_S0234567' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_amr_f_zero' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_amr_f_unsupp' time='MASKED'/>
<testcase classname='BSC_Tests' name='TC_assignment_codec_amr_h_S7' time='MASKED'/>
update expected results: bsc, sgsn Change-Id: Icc8bb648b3c79b2e29450ca38dd95bad1d2d09aa
2018-06-07 13:47:26 +00:00
<testcase classname='BSC_Tests_LCLS' name='TC_lcls_gcr_only' time='MASKED'/>
<testcase classname='BSC_Tests_LCLS' name='TC_lcls_gcr_bway_connect' time='MASKED'/>
BSC_Tests: Also test LCLS with halfrate codecs At the moment LCLS is only tested using GSM-FR. There are not LCLS tests that test with GSM-HR yet. Lets make GSM-HR available and see what happens when we run BSC_Tests_LCLS.TC_lcls_gcr_bway_connect on HR instead of FR. - set channelType depending on g_pars.ass_codec_list.codecElements[0] - add testcase TC_lcls_gcr_bway_connect_hr Related OS#1602 Change-Id: I2421519a642bdb7453ae4a9058e177845690a489
2018-07-06 12:03:38 +00:00
<testcase classname='BSC_Tests_LCLS' name='TC_lcls_gcr_bway_connect_hr' time='MASKED'/>
BSC_Tests_LCLS: try call legs with different codec/rate since the local MGW may not support transcoding, osmo-bsc should avoid to LCLS call legs that use different codec/rate. This test attemts to set up a call with different codec rate and checks if those legs do not get LCLSed Change-Id: I91b132306e530ad9ca03fb4a34012381be6b0b52 Depends: osmo-bsc I157549129a40c64364dc126f67195759e5f1d60f Related: OS#1602
2018-07-10 07:15:09 +00:00
<testcase classname='BSC_Tests_LCLS' name='TC_lcls_gcr_bway_codec_mismatch' time='MASKED'/>
update expected results: bsc, sgsn Change-Id: Icc8bb648b3c79b2e29450ca38dd95bad1d2d09aa
2018-06-07 13:47:26 +00:00
<testcase classname='BSC_Tests_LCLS' name='TC_lcls_gcr_nomatch_bway_connect' time='MASKED'/>
<testcase classname='BSC_Tests_LCLS' name='TC_lcls_gcr_bway_dont_connect' time='MASKED'/>
<testcase classname='BSC_Tests_LCLS' name='TC_lcls_gcr_unsuppported_cfg' time='MASKED'/>
<testcase classname='BSC_Tests_LCLS' name='TC_lcls_gcr_unsuppported_csc' time='MASKED'/>
<testcase classname='BSC_Tests_LCLS' name='TC_lcls_gcr_bway_dont_connect_csc' time='MASKED'/>
<testcase classname='BSC_Tests_LCLS' name='TC_lcls_connect_break' time='MASKED'/>
<testcase classname='BSC_Tests_LCLS' name='TC_lcls_connect_clear' time='MASKED'/>
BSC LCLS: add bts-loop tests Add basic establishment and teardown tests for 'bts-loop' mode of LCLS: * add explicit vty init for desired LCLS kind * add necessary IPA RSL MDCX functions * explicitly pass LCLS kind as a parameter to shared functions (defaulting to 'mgw-loop') Change-Id: I40e786b430591899c722d99d685db26efa868508 Related: OS#3659
2018-11-06 18:28:05 +00:00
<testcase classname='BSC_Tests_LCLS' name='TC_lcls_bts_gcr_bway_connect' time='MASKED'/>
<testcase classname='BSC_Tests_LCLS' name='TC_lcls_bts_gcr_bway_connect_hr' time='MASKED'/>
<testcase classname='BSC_Tests_LCLS' name='TC_lcls_bts_connect_break' time='MASKED'/>
add compare-results.sh, call from start-testsuite.sh Compare current test results to the expected results, and exit in error on discrepancies. Add compare-result.sh: (trivially) grep junit xml output to determine which tests passed and which didn't, and compare against an expected-result.log, another junit file from a previous run. Summarize and determine success. Include an "xfail" feature: tests that are expected to fail are marked as "xfail", unexpected failures as "FAIL". In various subdirs, copy the current jenkins jobs' junit xml outputs as expected-results.log, so that we will start getting useful output in both jenkins runs and manual local runs. In start-testsuite.sh, after running the tests, invoke the results comparison. Due to the single-line parsing nature, the script so far does not distinguish between error and failure. I doubt that we actually need to do that though. Related: OS#3136 Change-Id: I87d62a8be73d73a5eeff61a842e7c27a0066079d
2018-04-05 14:56:38 +00:00
</testsuite>