Commit Graph

982 Commits

Author SHA1 Message Date
Vadim Yanitskiy aa27022cf8 ttcn3-upf-test: fetch /tmp/commit from gerrit, not from cgit
Change-Id: Id327720258a9ece1efb79db0d7c4fcbe19864c92
2023-01-06 23:09:04 +07:00
Oliver Smith 9a2556824a scripts/regen_doc: use SUBNET variable
Add a $SUBNET parameter and use it throughout the script, similar to
other ttcn3-*/jenkins.sh scripts. This is in preparation for figuring
out a free network in network_create() automatically in a future patch.

Related: OS#5802
Change-Id: I3bda4bd7280469ad5ee02104295134a2e0b768e3
2022-12-22 13:59:10 +01:00
Oliver Smith 68cddfad72 ttcn3-ggsn-test: cp initrd-ggsn.sh to VOL_BASE_DIR
Prepare for a future patch where a free subnet will be figured out
automatically instead of having a hardcoded one, by moving
initrd-ggsn.sh to $VOL_BASE_DIR as the subnet will be replaced in files
in this directory.

Related: OS#5802
Change-Id: Ie4f35b77a2bff20f2a0479890a429754768cafd2
2022-12-22 13:26:41 +01:00
Oliver Smith 0974da58cd jenkins-common: tweak echo messages
Use 'set +x' before echo, so messages are not printed twice and the
output becomes more readable.

Example:
  + echo Creating network ttcn3-bts-test
  Creating network ttcn3-bts-test

Related: OS#5802
Change-Id: I213cb80bd1d9401281ae1fb7394b2319453550dd
2022-12-22 13:26:41 +01:00
Oliver Smith a47ab326c5 *-repo-install-test: remove
Remove the docker containers for repo-install-test, as it is now running
in qemu + kvm.

Related: OS#5365
Depends: osmo-ci Ie7f1bccb05779cb3614016c0b965b810bbb1471b
Change-Id: Ic40fddcc6b30318b3a6e63fe99b010939b95be25
2022-12-08 14:14:08 +01:00
Harald Welte c4d1cc59b0 ttcn3-docker-run.sh: Use interface "up" flag, not operstate
Don't use the "operstate" sysfs attribute to determine if an interface
is "up", use the actual UP-flag (0x01) in the "flags" sysfs attribute.

The "operstate" attribute may at least occasionally be "unknown" and
remain in that state (causing jenkins jobs to wait indefinitely), while
the flags (which we don't look at before this patch) indicates it is "up".

This is a fixup to the below commit:

commit d2014603a7
Author: Harald Welte <laforge@osmocom.org>
Date:   Wed Feb 3 22:05:43 2021 +0100

    debian-stretch-titan: Wait for interface to be _up_ not just its existance

Change-Id: Ib5c3bbe470ce874217437c2518df5ae07f0d8301
Closes: OS#5803
2022-12-02 11:15:34 +00:00
Oliver Smith 36c6ff8f11 osmo-gsm-tester: fix getting latest commit
Get the latest commit from gerrit.osmocom.org, because after we moved
repositories from git.osmocom.org it currently answers with a 404.

Related: https://osmocom.org/projects/cellular-infrastructure/wiki/Git_infrastructure
Change-Id: I0e2215d067dec1e2327f765b5a97ba7512812647
2022-12-01 14:50:39 +01:00
Oliver Smith 193feff80f release-tarball-build-dist: fix permission errors
Run all commands inside the docker containers as a user with the same
UID as on the host system, not as root. This is a good idea in general
and also fixes permission problems when jenkins tries to wipe the
workspace.

Related: OS#5793
Change-Id: I0d949e5ab4b1a709d18a316def0a98c3b244457e
2022-11-30 17:28:11 +01:00
Oliver Smith 858178e4e3 release-tarball-build-dist: fix missing dir crash
Don't fail if no tarball was generated and therefore the
_release_tarballs directory does not exist.

Related: OS#5793
Change-Id: Ib7c551e5376776eb267140bc4b897d5bb1634cbc
2022-11-30 17:28:08 +01:00
Oliver Smith 757396a61b release-tarball-build-dist: check exists on server
Previously this job relied on always running on the same jenkins node,
and having the previously built release tarballs in a workspace
directory that does not get removed. It would only skip building a
release tarball if the file already exists locally.

As part of OS#5793 this job needs to be moved away from that jenkins
node. When trying to run the job on a different node, it will build all
release tarballs again which takes unnecessarsily long and actually
fails on libosmocore-0.9.4 due to a missing python2.

This probably happens because the job was refactored at some point and I
didn't realize that the python2 dep is now missing as the previous
tarballs existed.

In general it doesn't make much sense to build previous release tarballs
again and to always keep the legacy environments around for that. Change
the code to check if a tarball exists on the server, and skip building
the tarball in that case.

Related: OS#5793
Related: https://jenkins.osmocom.org/jenkins/view/All%20no%20Gerrit/job/Osmocom-release-tarballs/1281/console
Change-Id: I4b8c149c9cdbe7c613eea5d9be15794de5e5ddce
2022-11-30 16:52:13 +01:00
Oliver Smith c4f160e2c2 release-tarball-build-dist: move rsync into docker
Prepare to use ssh inside the docker container to check if tarballs
already exist, see the next patch.

Remove the '' around UserKnownHostsFile as using SSH_COMMAND in the next
patch without rsync fails otherwise with:
  command-line: line 0: Bad configuration option: 'userknownhostsfile

Change-Id: I6dfe5d587d05063c6cf2c9ec683e7b7e499b79c1
2022-11-30 16:51:27 +01:00
Oliver Smith 59f3aa83d5 release-tarball-build-dist: order install pkgs
Change-Id: I059f400db20e858b379704363e32d39a7897984a
2022-11-30 16:04:20 +01:00
Harald Welte 9f5e67b95d upgrade gerrit to 3.4.8
Change-Id: I0be6e5f0c616b6c671635da62ba02afff2985592
2022-11-27 10:47:23 +01:00
Pau Espin 0ecbb795c5 ttcn3-{pgw,ggsn}-test: Update smf.yml with new metrics section location
The "metrics" section was moved inside each program node to avoid
clashes when several network programs are run in the same process and
use the same config file.

Depends: open5gs.git 2d4fbf92eb1be9ffe84df6dc103ee7401d1d3b0f
Change-Id: Iae16bfccfbaaed37701e671ba619f8082f55506d
2022-11-21 11:28:52 +01:00
Vadim Yanitskiy 9b6cc6ac70 open5gs-latest: migrate from debian:buster to debian:bullseye
Change-Id: Ia09aa712a916686f7220da9a5d2f4a02a8b7b8db
2022-11-15 22:41:23 +07:00
Vadim Yanitskiy ba5f99aac0 ttcn3-ggsn-test-ogs: update freeDiameter-smf.conf
Recent open5gs changed location of the TLS key and certificate files:

  commit 0859dd44530a944076c207c750188572effc2709
  Author: Sukchan Lee <acetcom@gmail.com>
  Date:   Sat Nov 12 09:37:43 2022 +0900

      Follow-up on #1865

Updating paths makes the open5gs-master work, however the -latest
still installs these files to '/etc/freeDiameter/'.  Let's remove
both 'TLS_Cred' and 'TLS_CA' params, we are not using TLS anyway.

Change-Id: Iacd7287f217db7a23ceece1d4508ef674b696d35
2022-11-15 22:41:23 +07:00
Vadim Yanitskiy ff221f9af5 ttcn3-pgw-test: update freeDiameter-smf.conf
Recent open5gs changed location of the TLS key and certificate files:

  commit 0859dd44530a944076c207c750188572effc2709
  Author: Sukchan Lee <acetcom@gmail.com>
  Date:   Sat Nov 12 09:37:43 2022 +0900

      Follow-up on #1865

Updating paths makes the open5gs-master work, however the -latest
still installs these files to '/etc/freeDiameter/'.  Let's remove
both 'TLS_Cred' and 'TLS_CA' params, we are not using TLS anyway.

Change-Id: Ic90f713fb127f8d5407c18553b29b3c2be141420
2022-11-15 22:41:08 +07:00
Daniel Willmann df4522ade4 hnbgw: Only build with_pfcp on master
The functionality is not in -latest yet so running osmo-hnbgw with this
configuration fails which in turn fails the test in jenkins instead of
just marking it unstable.

Change-Id: I4309c323c1d61e8f22dae499c407d57999f6f13a
2022-11-07 10:17:36 +00:00
Oliver Smith a0cd1869b2 debian-buster-jenkins: add more pysim related deps
Install all depends to properly generate the manuals. Otherwise it
prints errors like the following and the resulting manual has empty
sections:
  /build/docs/shell.rst:329: ERROR: Failed to import "LinFixedEF" from "pySim.filesystem".
  No module named 'smartcard'

Get the requirements.txt directly from the git repository, so we don't
need to update the list of dependencies here. Remove the dependencies
from the list that I added recently for pysim, and which are are also
in requirements.txt.

Add swig, as otherwise pyscard fails to install.

Related: OS#5497
Change-Id: I13a0b0dc8be81bf4034b08b1ef1100f1420fa3a1
2022-11-04 10:19:05 +00:00
Daniel Willmann 98c48a5cfa ttcn3-bsc-test: Fix ttcn3-bsc_sccplite-latest
Re-add the msc 0->mgw config line since the "latest" version of osmo-bsc still uses
it. This was probably caused by fixing fallout from osmo-bsc.git commit
da4af65a51ee8b8d7b380330c0301de293347563 in master.

The config line is ignored in master so should be safe to keep until a
new osmo-bsc version is released.

Change-Id: I85231bf66a78232567eb91b92b8542ca7f728beb
2022-11-02 19:24:17 +01:00
Oliver Smith 729efb0202 debian-buster-jenkins: add pysim doc/lint depends
The lint and docs parts of pysim's contrib/jenkins.sh will run on a
different jenkins node than the tests (which has to run on simtester).
Add the depends for lint and docs to debian-buster-jenkins, so we can
run them in docker.

The python libraries construct, pytlv, pyyaml are needed so pylint
doesn't print false errors like "Undefined variable 'TLV'".

Related: OS#5497
Change-Id: Id5c75725d2fab46b29773fa4f637fa2d73fa7291
2022-10-24 14:13:00 +00:00
Pau Espin 9a330b6fc3 ttcn3-bsc: Update osmo-bsc cfg files to use mgw pooling VTY commands
OsmoBSC has supported this VTY interface since more than a year ago.
Let's update the config files to use the new "mgw" node.

The recently submitted VTY commands without the redundant "mgw" prefix
are still not used here in order to have the config file work with
latest release which still doesn't support those.

Change-Id: Iabf117f9e6de02cac16e44d9a0ca32a30d71847c
Related: SYS#5987
2022-10-19 13:50:13 +02:00
Oliver Smith 4077d8aad5 debian-buster-jenkins: skip llvm for arch !x86_64
The pre-built LLVM toolchain we are downloading is built for x86_64, so
this fails on other architectures.

Related: OS#5260
Change-Id: Ie5a851d8c4e808ced09b20d7478679bf1ecc1cbb
2022-10-17 11:06:34 +02:00
Oliver Smith a4d67a24f1 debian-buster-jenkins: add LLVMEmbeddedToolchainForArm
This is needed for simtrace2. As the bootloader goes beyond partition
size in modern gcc, we'll use clang instead.

Related: OS#5260
Related: simtrace2 I2aa2e20e75e334560dbe1f6db9fd1491873ff91f
Change-Id: I4f3fd7f7a40e5fa00bbfc713c1365f573febfe41
2022-10-13 14:47:41 +02:00
Oliver Smith 0fec30c698 debian-buster-jenkins: order pkgs alphabetically
Change-Id: I32dffc65239f1ad650b9e8d6ed6e4fe48878b916
2022-10-13 14:47:41 +02:00
Oliver Smith bc443c4e97 Revert "debian-buster-build: add LLVMEmbeddedToolchainForArm"
Wrong docker container, debian-buster-jenkins is used for the build, not
debian-buster-build. The next patches will adjust the right one.
This reverts commit 1ce91ecfb0.

Change-Id: Idff1d5a263181070133743c781615b1102311efb
2022-10-13 14:47:35 +02:00
Oliver Smith 1ce91ecfb0 debian-buster-build: add LLVMEmbeddedToolchainForArm
This is needed for simtrace2. As the bootloader goes beyond partition
size in modern gcc, we'll use clang instead.

Related: OS#5260
Related: simtrace2 I2aa2e20e75e334560dbe1f6db9fd1491873ff91f
Change-Id: Ib82a53fa7edc62d21e772efbb9b2c049d1b50c4d
2022-10-13 13:11:04 +02:00
Oliver Smith f721f00ec1 debian-buster-build: order pkgs alphabetically
Change-Id: I16da41b9bcb3d1137218b0ed5c2f6adf2a723fce
2022-10-13 11:34:22 +02:00
Pau Espin 5761378906 ttcn3-mgw: Increase number of enpoints in osmo-mgw.cfg
This is needed by test TC_crcx_osmux_257

Related: osmo-ttcn3-hacks.git Change-Id I74e6c760e076fe2547b6297a54524255fb8b
Related: SYS#5987
Change-Id: I14e3abdf63c585e4518b0c0a61dbc57e6710a998
2022-10-07 13:25:24 +02:00
Pau Espin 8bf8057668 ttcn3-mgw: jenkins.sh Fix centos tests
The sed lines dropping the new configs must be applied to any non-master
run.

Fixes: e077fec684
Change-Id: I369bb61f3979bd9118fad17c3d202253411ba14b
2022-10-07 13:25:24 +02:00
Pau Espin e077fec684 ttcn3-mgw: Set osmux bind-ip(-v6) VTY configs
Until now we forgot to properly configure the osmux socket local ip, but
that was fine because 0.0.0.0 was taken as a default.
With addition of IPv6, this changed, and the socket is not bound unless
an IP address is set (to allow conditional use of IPv4, IPv6 or both).

Depends: osmo-mgw.git Change-Id I446cd7da217e9f4a74995d7784ae55dcc60a29b7
Change-Id: Ib7e9428a10238fae395a1707d6034dc5c97b9024
2022-10-05 08:45:45 +00:00
Vadim Yanitskiy 5e9af962ba ttcn3-pcu-test: osmo-pcu.cfg: use 'gsmtap-remote-host'
Change-Id: Ib7d6e564e12db08a8dd4890426d2599b3260fa9d
2022-10-02 14:44:56 +07:00
Vadim Yanitskiy c80a5e0db3 ttcn3-pcu-test: osmo-pcu.cfg: use 'gsmtap-category enable-all'
Change-Id: I19fbb75890935a338c31b7eb5e624ec988f91468
2022-10-02 14:44:27 +07:00
Neels Hofmeyr 6f366b30a9 add ttcn3-upf-test
Related: I43cd55c9395f2c706369afe1a9a7f475be47339f (osmo-ci)
Related: I5964979b3db86268f6011df0afbee7131557f405 (osmo-ci)
Change-Id: I7a651bb85861de4b2677a731b9f17fa0d790c621
2022-09-22 02:01:52 +02:00
Neels Hofmeyr 4ee669ee3a add osmo-upf-master
Will be used by ttcn3-upf-test in subsequent patch
I7a651bb85861de4b2677a731b9f17fa0d790c621.

Change-Id: Iceec912eef05bf4903ccc1fc30b0c7362145a1f1
2022-09-22 02:01:09 +02:00
Neels Hofmeyr c6ece0d7d4 .gitignore vim swp files
Change-Id: I5e67c42271aca9f81711e166324f70663e34cfcf
2022-09-21 21:58:56 +02:00
Pau Espin d8f641bd39 ttcn3-hnbgw: sed junit file in the clean_up trap
Same as done in BTS_Tests. This makes sure the files are always properly
updated even if something goes wrong (such as docker kill failing to
stop hnbgw because it exited earlier due to unsupported feature).

Change-Id: Iac3bd9cf3448e18930dcef6c9ae4b6530939ffe6
2022-09-21 14:37:01 +02:00
Pau Espin e406dc12f9 ttcn3-hnbgw: Set different junit xml file name prefix for with-pfcp variant
Similar to what's done in BTS_Tests and REMSIM_Tests

Change-Id: Iee69774ae8885ab216d0d707ee5fd0269a438c83
2022-09-21 14:32:55 +02:00
Pau Espin a719a8db61 Use gerrit as osmo-ttcn3-hacks.git git remote
Other remotes are mirrors of gerrit one, which means there's some delay
between pushing some ref to the gerrit remote and having them available
in the mirrors.
Hence, it becomes annoying while developing and new stuff to test is
pushed. Let's simply use gerrit since it's the master remote.

Change-Id: Ic87c196f8b91a3a3e6ddde2cca36482ce7070df7
2022-09-20 12:09:32 +02:00
Neels Hofmeyr 85f0b311f9 add ttcn3-hnbgw-test variant with-pfcp
Run HNBGW tests a second time with PFCP enabled. Just run all the same
tests again, no matter if they are related to PS RAB Assignment or not,
to also ensure no ill side effects from PFCP configuration.

Related: SYS#5895
Depends: I511e758807e0512c18f3f9e0a8c4699b9a3f5992 (osmo-ttcn3-hacks)
Change-Id: I02b60941343000a4618e95f56326bec170c32bfe
2022-09-15 14:44:15 +02:00
Neels Hofmeyr 395cdbb41f osmo-hnbgw-master: build with --enable-pfcp
Change-Id: If84261cba2bf3b75c454fd5d16fd19a88a468eb7
2022-09-14 17:21:20 +02:00
Pau Espin 5226db6c01 ttcn3-bts: Add osmux configurations
Requires: osmo-ttcn3-hacks.git I1af23c7a60b05edc3b544f1fea0023f48e89f7a7
Requires: osmo-bts.git Ib80be434c06d07b3611bd18ae25dff8b14a7aad9
Related: SYS#5987
Change-Id: I185b77eb4fa05501f098d89b80b66168349175bb
2022-09-14 12:17:14 +00:00
Pau Espin e5f5f273cf ttcn3-hnbgw: Enable gsmtap logging
Change-Id: I2c5c98349190bc6c37013acd2bd84887cbe1d059
2022-09-12 18:27:23 +02:00
Pau Espin dfda07bcc4 osmo-bts-master: Depend on libosmo-netif
Since osmo-bts.git a2dc808acc5b99122e97c9013cb1ec2ae0c4a2a1, osmo-bts
depends on libosmo-netif. Let's add the dependency when building.

Change-Id: If033ed7f25bb69a66ecff56b2a1781d6339a6d7e
2022-09-07 11:37:37 +02:00
Harald Welte f95b7c8bad debian-bullseye-titan: Discontinue the use of git://
Change-Id: I188a04dd6ecae3c92186d5cbf6cd002ad518efc3
2022-08-31 13:07:46 +02:00
Harald Welte 1c2fc48991 debian-bullseye-titan: Use gitea, not obsolete cgit
When downloading the deps/Makefile, use gitea instead of the obsolete
and now defunct cgit deep-link

Change-Id: Ifbcb992e70a1faefc3829df28f8bf4dfaf2143e1
Related: OS#5670
2022-08-31 12:55:18 +02:00
Pau Espin bb6e5d1acb ttcn3-bsc: Enable OSMUX feature in osmo-bts-omldummy
This feature is used to indicate to the BSC that the BTS supports Osmux.

Requires: libosmocore 18c6a8183f92915e77368ecffb1cbf7f555453a3
Related: SYS#5987
Change-Id: Ia402b7514b636750442d0859d5ebc3fcad67dd9f
2022-08-30 16:00:09 +00:00
Vadim Yanitskiy d10cc6a598 osmo-msc-master: install libsqlite3-dev/sqlite-devel
Since recenly, osmo-msc is using libsqlite3 directly.

Change-Id: I4b0ecfcc9a25797eb8e12f07e039160dfc296d4c
2022-08-17 05:14:39 +07:00
Vadim Yanitskiy 08586306ba osmo-hlr-master: install libsqlite3-dev/sqlite-devel
osmo-hlr is using libsqlite3 directly, not via libdbd.

Change-Id: I99e43dff8f94fbef1a2dd9934caf6ba1fa7cc1f7
2022-08-17 05:14:33 +07:00
Oliver Smith 278ed47265 fix_perms: use debian:bullseye
Use debian:bullseye instead of debian-bullseye-build. Building the
latter requires a lot of time, it's definitively not needed for just
running chmod. Use debian:bullseye, since we use it as base for most
images and it's therefore very likely that it's already downloaded
(and if not, it would get downloaded here).

Change-Id: I88f513a0a8ee04628842a7aa1b663c390d2032cd
2022-08-04 12:45:29 +00:00