Commit Graph

1173 Commits

Author SHA1 Message Date
Harald Welte abec88d183 stp: Expand osmo-stp.cfg for "norctx" tests
In osmo-ttcn3-hacks.git I81052ece7d1cc8b43da6155356ed1c4d9620acdc
we're adding support for so-called "norctrx"tests, covering
operation without routing-context IEs.  For this, we need additional
AS/ASP definitions in the osmo-stp.cfg

Change-Id: Ie00d96d04dd36c71c79f3b73713c3fe1c26a5145
Related: OS#6003
2023-04-22 13:50:25 +12:00
Pau Espin c634cc7f75 ttcn3-ggsn: Speed up tests by lowering retransmission T3,N3 timers
Every test needs to wait for T3*N3 seconds before exiting in order to
make sure the queues waiting for duplicates are cleared, otherwise state
from previous state may affect next tests.
Since 1.10.0, osmo-ggsn supports having those timers changed through
VTY. Let's set them to a lower value than default specified by spec, in
order to speed up each test 15 seconds -> 2 seconds.

Only ttcn3-ggsn (against osmo-ggsn) and not ttcn3-ggsn-ogs (against
open5gs-smfd) is updated, since the later doesn't support changing the
default timer values using the config files yet.

Related: OS#5485
Change-Id: Ica346bd791a67b72fad597702d750383e8ac5895
2023-04-12 19:06:14 +02:00
Oliver Smith b268e13319 debian-bullseye-jenkins: add iproute2
Add iproute2 to make "ss" available. It is used in the openbsc testsuite
to dump socket statistics. If it isn't available, it does not cause
tests to fail, but prints an error message that looks like it might be
the real cause for the test failures:

  > ss -tn
  /bin/sh: 1: ss: not found

I've also asked Harald if we should just retire the master-openbsc job,
but we want to keep it around to ensure new libosmocore builds with this
old codebase.

Change-Id: I306caeda9bcd4020734eb3b343420c8115958ded
2023-04-05 14:59:18 +02:00
Vadim Yanitskiy 4275e63739 ttcn3-bts-test: enable running GPRS related tests with trxcon
Change-Id: I06ad8e6403e2538c64d650f19a8d0bd4a344edbe
Depends: osmo-ttcn3-hacks.git Ib8f4459480bbe12584a6fa71882f745f03c5055d
Related: osmocom-bb.git I9567d64f9d00262e36147e8d7e541e5e246bda5f
Related: OS#5500
2023-03-27 12:12:24 +00:00
Oliver Smith 14f836c7c2 debian-bullseye-jenkins-arm: add new container
Add a bullseye based container that can be used instead of
debian-buster-jenkins-arm. The master-builds jenkins jobs will attempt
to use this jenkins job for the arm builds after setting the main
default image from debian-buster-jenkins to debian-bullseye-jenkins.

Related: OS#5949
Change-Id: I8e1741f86ffb8abd658d1e4e0415dfd11fb1a8a1
2023-03-21 18:13:15 +01:00
Oliver Smith 03487bd570 debian-bullseye-jenkins: sync with buster-jenkins
Prepare to let jenkins master-builds use debian-bullseye-jenkins
instead of debian-buster-jenkins. Add almost everything from the buster
Dockerfile to the bullseye Dockerfile that is not there, except for:
dh-systemd (not available in debian11)

Also add python2, as some projects still require it to run tests
(OS#5950).

Related: OS#5949
Change-Id: I51925d0ab9e5a779379efab59c381ef12fb60929
2023-03-20 17:27:22 +01:00
Oliver Smith 322b1aa564 README: add example: nightlies from different date
Change-Id: I1b21c90b13a11aa1e51ea337207775c729709676
2023-03-20 11:59:41 +01:00
Oliver Smith cfeef2bed3 debian-buster-jenkins: add ghostscript
Add the ghostscript package, it contains ps2pdf which is now used in
osmo-gsm-manuals to shrink pdfs.

Related: SYS#6380
Change-Id: If7b30d0c948604211f4f5242aca8564c310a6ce3
2023-03-17 13:24:26 +01:00
Oliver Smith 4f459b779e docker kill: wait until containers are stopped
As "docker kill" / "docker container kill" (alias) doesn't block until
the given container stops, make sure to always run "docker wait"
afterwards.

Closes: OS#5928
Change-Id: I0242ece96541d8036ebbf8b0f498ebf231db26b5
2023-03-07 09:02:02 +00:00
Pau Espin c163d5d854 Introduce debian-bullseye-titan-master
This Dockerfile allows building a given repo and branch of
titan.core.git which can then be used by any ttcn-*-test/ environment by
simply changing its Dockerfile "FROM" line from
$REGISTRY/$USER/debian-bullseye-titan to
$REGISTRY/$USER/debian-bullseye-titan-mater.

This is useful to debug or develop titan.core or test whether a given
testsuite works fine with a newer version of titan.core.

Change-Id: I19ee98a319ccad167d06c4f183fe80ecac909483
2023-03-02 12:33:15 +01:00
Vadim Yanitskiy e893dcf18a ttcn3-ggsn-test-ogs: update open5gs-{smf,upf} config files
Change-Id: Ic92d73e93b47abb4fae99fc9bece0c93bf9b91ef
Related: I27adbab6a6b95ddf4c6d39803e4f7dd079f11a4c
Related: OS#5913
2023-02-27 10:43:43 +00:00
Vadim Yanitskiy abd1105000 ttcn3-pgw-test: make the testsuite dir writable by all users
When running jenkins.sh as root or any other user with UID different
than UID=1000 of the 'osmocom' user we have in open5gs-{master,latest}
images, programs spawned by osmo-uecups-daemon (e.g. ping) may fail to
start.  In such cases, osmo-uecups-daemon reports unexpected program
termination with exit code=512.  This is happening because the
stdout and stderr of a spawned program are being redirected to
"$VOL_BASE_DIR/pgw-tester/TESTCASE.prog.std{out,err}", for which
the 'osmocom' user needs to have write permissions.

Change-Id: Icb6b30e618e290d974a919fef34c6b5cb7eeb648
Related: OS#5913
2023-02-26 15:38:16 +07:00
Vadim Yanitskiy 18b578295e ttcn3-pgw-test: update open5gs-{nrf,smf,upf} config files
As stated in the ticket, both open5gs-{nrf,smf} daemons refuse to
start since build #326 because of the following error:

  [sbi] ERROR: TLS enabled but no server key (../lib/sbi/context.c:186)

The problem is that the recent open5gs (v2.6.0-39-g22be888 at the
moment of writing) is attempting to employ TLS verification for SBI
even if it's not explicitly configured in the config files.

  commit 05fbaf69587488e53b5e741a9ada9f9fa5749322
  Author: Sukchan Lee <acetcom@gmail.com>
  Date:   Sat Feb 18 10:58:29 2023 +0900

    [SBI] HTTP2-TLS verification - ConfFile Changed

Our config files are slightly outdated, so let's take a chance
to update them and specify the missing TLS params.  Check out
open5gs-{nrf,smf,upf}.yaml from the latest git version.

The updated files are confirmed to work with both:

* latest release for Debian v2.5.8, and
* latest git version v2.6.0-39-g22be888.

Change-Id: I27adbab6a6b95ddf4c6d39803e4f7dd079f11a4c
Related: OS#5913
2023-02-21 00:13:00 +07:00
Vadim Yanitskiy 35c6b4fe02 open5gs-latest: add osmocom user for ttcn3-pgw-test
In ttcn3-pgw-test we're running open5gs-upfd as a non-root user.
We do have this user in open5gs-master, but not in open5gs-latest.

Change-Id: I9139fc52fa6973cf495559d3c4202d9f804a2079
Related: OS#5913
2023-02-21 00:09:31 +07:00
Vadim Yanitskiy 4c3d879924 open5gs-master: fix comment in Dockerfile
Change-Id: I34577dd39051f429af8257afe075f22b20cfdfe4
Related: OS#5913
2023-02-21 00:09:04 +07:00
Vadim Yanitskiy d3c437abce open5gs-latest: install missing packages for ttcn3-pgw-test
These are present in open5gs-master, but missing in open5gs-latest.

Change-Id: Ic9227033d65d621e7f6c5e196a9a8d6a1b73d5da
Related: OS#5913
2023-02-20 21:36:42 +07:00
Vadim Yanitskiy 26916f0576 osmo-uecups-latest: install missing iputils-ping
ping is needed for ttcn3-pgw-test.  In the case of osmo-uecups-master
it's available from the parent $DISTRO-build image, but for the -latest
it needs to be installed by the inherited image itself.

Change-Id: Ia1b9124f09203c7dcf6d26dee78b09d5a139a04f
Related: OS#5913
2023-02-20 21:27:42 +07:00
Vadim Yanitskiy 273e066c98 ttcn3-pgw-test: allow using osmo-uecups from the latest feed
Change-Id: I4f92577f062e8a9be29af83026214636dff19d78
2023-02-20 16:41:38 +07:00
Vadim Yanitskiy 99f69d2ca8 osmo-uecups-latest: new Dockerfile
osmo-uecups is available in the latest feed since recently.

Change-Id: I89c16dd0a71d2461981d978d2abf36f62bb9b339
Related: SYS#5602
2023-02-20 16:41:38 +07:00
Vadim Yanitskiy 7a41031b5f debian-bullseye-*: apt-key is deprecated, use [signed-by] instead
The following warning message appears when running apt-key:

  apt-key is deprecated. Manage keyring files in trusted.gpg.d instead

The apt-key man page mentions that the "use of apt-key is deprecated,
except for the use of apt-key del in maintainer scripts to remove
existing keys from the main keyring".  What's more, "apt-key will last
be available in Debian 11 and Ubuntu 22.04".

Additionally, while the deprecation message says to "manage keyring
files in trusted.gpg.d instead", the Debian wiki states otherwise.
It's recommended to store the keys in /usr/share/keyrings instead,
and then use the 'signed-by' option to reference them.

ee284d5917

Change-Id: I1cae4f49e72f5e4f9d703cdb8f6d117e18e3567c
2023-02-20 16:39:07 +07:00
Harald Welte bb1b35e725 upgrade to gerrit 3.6.3
Change-Id: I56eadf8c6dd4c131dcdaf451e493f619576ae198
2023-02-19 13:51:26 +01:00
Oliver Smith 8fd822ad17 ttcn3-bsc-test: sleep 1s before starting testsuite
Give OsmoBSC time to connect to OsmoSTP, so BSSMAP RESET from the
testsuite doesn't fail in OsmoSTP with:
  MTP-TRANSFER.req for DPC 187: no route!

Without this patch, it would fail every other time on my system when
only having one test enabled in BSC_Tests.cfg.

Change-Id: Ic7f80bdfe2fe58e93c2f2e3baa6d7645fcdc3062
2023-02-13 18:22:03 +01:00
Oliver Smith 4bbe87db96 release-tarball: add libosmo-pfcp, libgtpnl
Change-Id: I4096c21352366c16167efce5c2a97f4e04c1addb
2023-02-08 15:44:39 +01:00
Oliver Smith b769d12021 release-tarball: add var to use list from jenkins
Add a parameter that can be used to reproduce the failure locally with
the last list from jenkins, without having SSH set up to download the
list of existing tarballs.

Change-Id: I9af310c24aa65c21cc4bd365d3df7804cba02df7
2023-02-08 14:16:02 +01:00
Oliver Smith c23f21f31c release-tarball: remove PARALLEL_MAKE variable
Probably copy pasted from another script, doesn't make much sense here
since only the release tarballs are built. Nothing gets compiled here,
the variable was not used.

Change-Id: Ie74ee6976759f9634503b21e964e93efcc925679
2023-02-08 14:16:02 +01:00
Oliver Smith 2ef19d24d2 release-tarball: fix osmo-trx 1.5.0
Run configure with the --with-mstrx argument, so LIBTRXCON_DIR is not
pointing at an empty directory.

Fix for:
  make[2]: Entering directory '/build/_temp/repos/osmo-trx/osmocom-bb'
  make[2]: *** No rule to make target 'distdir'.  Stop.

Change-Id: I2f067409f98119d4e35cf86cc2c816fc3c19e3f5
2023-02-08 14:16:02 +01:00
Oliver Smith c801b72336 release-tarball: support git submodules
osmo-trx 1.5.0 is now using a git submodule for osmocom-bb, so add
support for it.

Change-Id: I35e9ef6d976ae8cf2bfb4f3c410e6b2cb3ca7841
2023-02-08 14:15:59 +01:00
Oliver Smith 1790b9a7e6 release-tarball: add missing cd /build
Fix for:
  upload: no tarballs generated, nothing to do.

Change-Id: I047546b26f379c5302d8558b92b77e4fa311a0a0
2023-02-08 14:13:39 +01:00
Pau Espin 666488c8e4 ttcn3-*: Update test setup after Osmocom CNI release 202302
Change-Id: If34b043a55177e6c0d1be3949fc2a2682258cc84
2023-02-08 12:36:27 +01:00
Vadim Yanitskiy 4a2d9d1c0c jenkins-common.sh: open5gs-latest does not require debian-bullseye-build
We're not *building* anything for the open5gs-latest, but simply
downloading and installing DEBs from Sukchan's opensuse.org repo.

Change-Id: Iec7ccab28c37d274a731e08a2f893ec0514c1068
Fixes: 62ac21133a
2023-02-08 17:44:38 +07:00
Oliver Smith 46e4362ae2 FR testsuites: clean up all networks before start
Add a new network_clean_remove_all_ttcn3 function and use it in the fr
related testsuites to ensure no network is running before the test
starts. We just had the situation where the network link between
gtp0-deb10fr (where these testsuites run exclusively, and only one at a
time) and the jenkins host went down. And so the clean up trap
apparently did not run and starting a new test fails as the old network
still exists and has the network devices attached.

Related: OS#5802
Change-Id: I6a9464a11edcba978be08764bec9de19760a5c77
2023-01-30 13:45:30 +01:00
Oliver Smith 7a49258ca7 debian-buster-jenkins-arm: new image
Add a minimal image to use on the raspberry pis, so it doesn't need to
spend 1-2 hours building debian-buster-jenkins on the raspberry pis,
full of things we don't actually use there.

I've verified that osmo-bts, osmo-pcu, osmo-trx build with this image
(the only projects which we build on the rpis).

Related: OS#5863
Change-Id: I4fb4b48b233acaef815c4c27ec6f17f12cfe836b
2023-01-23 13:08:54 +00:00
Oliver Smith f71e0f2856 ttcn3-bts-test: replace subnets during 'make cfg'
Make ttcn3-bts-test work as expected again by replacing the subnets
hardcoded in the confmerge files and Makefile.

Related: OS#5802
Change-Id: I733619f80b4e2456da070649634d3c942bb6d95f
2023-01-18 12:35:42 +01:00
Oliver Smith 2437f4fe8e debian-buster-jenkins: install ccache
Make ccache available inside debian-buster-jenkins. An upcoming osmo-ci
patch will make use of it in gerrit-verification and master jobs. With
this docker-playground patch alone it's not used yet since
/usr/lib/ccache is not in the default PATH.

Related: OS#5848
Change-Id: I164c7835f99436e8d768a864f36118eaf799d109
2023-01-18 09:52:24 +01:00
Oliver Smith 76533bea88 kernel_test_wait_for_vm: increase timeout to 15s
As we run more testsuites in parallel, the load was higher and so this
timeout was reached.

Related: OS#5802
Change-Id: I823010106a99a4906e32198ed42b36f9fe662c4e
2023-01-17 13:42:04 +01:00
Oliver Smith 381e2f3a0e network_create: set NET_NAME after next SUBNET
Put the current SUBNET into NET_NAME, not the previous one. Without this
patch it works too, but this makes more sense.

Related: OS#5802
Change-Id: I6c90505fd6c0ba62244ff67709b0bf31bf44b449
2023-01-17 13:41:29 +01:00
Oliver Smith 998bc92f07 jenkins-common: replace subnet in scm files too
Replace the subnet in *.scm configs of nplab-sua-test and
nplab-m3ua-test too.

Related: OS#5802
Change-Id: Ia734df3721a4ae3408a17d33c835282b79174132
2023-01-17 12:47:52 +01:00
Oliver Smith d2827d91ce network_create: put SUBNET in NET_NAME
Fix the bug that running a test twice on the same host results in the
second test stopping the containers and network of the first test:

* Have the subnet name in the network name, so there's no collision of
  network names when cleaning up the network.

* Don't clean up the network when creating a new network. Rely on the
  clean up trap to clean up the network instead.

* Don't set NET_NAME when sourcing jenkins-common.sh anymore, as
  network_create will set it. There's also network_bridge_create, which
  only gets used by osmo-ran (which we don't run in jenkins). Add a
  check to this function to ensure NET_NAME is set before calling it,
  which osmo-ran is already doing.

Related: OS#5802
Change-Id: Ifcd384272c56d585e220e2588f2186dc110902ed
2023-01-17 09:39:52 +01:00
Oliver Smith f997b4e771 network_create: find free subnet automatically
Try multiple subnet numbers until successfully creating a network. This
way we can run the same ttcn3 testsuite multiple times in parallel
without conflicts (e.g. once against latest, once against nightly). Also
we don't need to make sure each new testsuite has a unique subnet
number anymore.

I've considered also adjusting network_bridge_create, but that gets used
exclusively by osmo-ran/jenkins.sh, a script which we don't actually run
in jenkins. It seems that in this script it makes more sense to not get
a random subnet number.

Related: OS#5802
Change-Id: I57152b08ef0f38e17e7019a8df032189b03f56cf
2023-01-16 15:19:29 +00:00
Oliver Smith 4cb0fac1b0 ttcn3-*/jenkins*.sh: use $SUBNET everywhere
Use the SUBNET variable instead of hardcoding it in some places. Split
commands across multiple lines while at it to improve readability.

Related: OS#5802
Change-Id: I08f83089ef97f5f92d4bbfa5743301e7375e9f0f
2023-01-16 11:41:11 +00:00
Vadim Yanitskiy ea90e44ab0 */Dockerfile: clone from gerrit.osmocom.org using https://
* Do not clone using deprecated git://, use https:// instead.
* Clone from the main repo gerrit.osmocom.org (if possible).
* Use the gitiles plugin to fetch the last commit from Gerrit.

Change-Id: I204fa6e3e3ebbdb8732393b897fca35659d61ae8
2023-01-06 23:10:13 +07:00
Vadim Yanitskiy aa27022cf8 ttcn3-upf-test: fetch /tmp/commit from gerrit, not from cgit
Change-Id: Id327720258a9ece1efb79db0d7c4fcbe19864c92
2023-01-06 23:09:04 +07:00
Oliver Smith 9a2556824a scripts/regen_doc: use SUBNET variable
Add a $SUBNET parameter and use it throughout the script, similar to
other ttcn3-*/jenkins.sh scripts. This is in preparation for figuring
out a free network in network_create() automatically in a future patch.

Related: OS#5802
Change-Id: I3bda4bd7280469ad5ee02104295134a2e0b768e3
2022-12-22 13:59:10 +01:00
Oliver Smith 68cddfad72 ttcn3-ggsn-test: cp initrd-ggsn.sh to VOL_BASE_DIR
Prepare for a future patch where a free subnet will be figured out
automatically instead of having a hardcoded one, by moving
initrd-ggsn.sh to $VOL_BASE_DIR as the subnet will be replaced in files
in this directory.

Related: OS#5802
Change-Id: Ie4f35b77a2bff20f2a0479890a429754768cafd2
2022-12-22 13:26:41 +01:00
Oliver Smith 0974da58cd jenkins-common: tweak echo messages
Use 'set +x' before echo, so messages are not printed twice and the
output becomes more readable.

Example:
  + echo Creating network ttcn3-bts-test
  Creating network ttcn3-bts-test

Related: OS#5802
Change-Id: I213cb80bd1d9401281ae1fb7394b2319453550dd
2022-12-22 13:26:41 +01:00
Oliver Smith a47ab326c5 *-repo-install-test: remove
Remove the docker containers for repo-install-test, as it is now running
in qemu + kvm.

Related: OS#5365
Depends: osmo-ci Ie7f1bccb05779cb3614016c0b965b810bbb1471b
Change-Id: Ic40fddcc6b30318b3a6e63fe99b010939b95be25
2022-12-08 14:14:08 +01:00
Harald Welte c4d1cc59b0 ttcn3-docker-run.sh: Use interface "up" flag, not operstate
Don't use the "operstate" sysfs attribute to determine if an interface
is "up", use the actual UP-flag (0x01) in the "flags" sysfs attribute.

The "operstate" attribute may at least occasionally be "unknown" and
remain in that state (causing jenkins jobs to wait indefinitely), while
the flags (which we don't look at before this patch) indicates it is "up".

This is a fixup to the below commit:

commit d2014603a7
Author: Harald Welte <laforge@osmocom.org>
Date:   Wed Feb 3 22:05:43 2021 +0100

    debian-stretch-titan: Wait for interface to be _up_ not just its existance

Change-Id: Ib5c3bbe470ce874217437c2518df5ae07f0d8301
Closes: OS#5803
2022-12-02 11:15:34 +00:00
Oliver Smith 36c6ff8f11 osmo-gsm-tester: fix getting latest commit
Get the latest commit from gerrit.osmocom.org, because after we moved
repositories from git.osmocom.org it currently answers with a 404.

Related: https://osmocom.org/projects/cellular-infrastructure/wiki/Git_infrastructure
Change-Id: I0e2215d067dec1e2327f765b5a97ba7512812647
2022-12-01 14:50:39 +01:00
Oliver Smith 193feff80f release-tarball-build-dist: fix permission errors
Run all commands inside the docker containers as a user with the same
UID as on the host system, not as root. This is a good idea in general
and also fixes permission problems when jenkins tries to wipe the
workspace.

Related: OS#5793
Change-Id: I0d949e5ab4b1a709d18a316def0a98c3b244457e
2022-11-30 17:28:11 +01:00
Oliver Smith 858178e4e3 release-tarball-build-dist: fix missing dir crash
Don't fail if no tarball was generated and therefore the
_release_tarballs directory does not exist.

Related: OS#5793
Change-Id: Ib7c551e5376776eb267140bc4b897d5bb1634cbc
2022-11-30 17:28:08 +01:00