Commit Graph

649 Commits

Author SHA1 Message Date
Harald Welte cb688f8e49 gerrit: update to 3.2.7 for security reasons
Change-Id: Ib51cb5466ec2eddeb76e1853a4c1206f9a8e5fd0
2021-02-15 12:29:22 +01:00
Oliver Smith 19594be9e8 Revert "RFC: allow to set configuration and/or specific testcases"
Fix error message reported by Pau:
  docker: invalid reference format: repository name must be lowercase.

This happens in the "docker run" command after the "Starting container
to merge logs" message, because the arguments to --entrypoint are not in
quotation marks. The command fails.

Logs were merged anyway, because
If03422bb8fb126fe6f204a4f8bc6edf0cbb7f194 had already reverted half the
patch and added the log merging back to the Dockerfile.

This reverts commit 73663b01f2.

Change-Id: Ie6f8270230e1f0372b63d610b7868ea8719b18ad
2021-02-12 19:07:26 +01:00
Oliver Smith 6f6724178b ttcn3: use REGISTRY arg with debian-stretch-titan
Allow jenkins to fetch the image from our private docker registry.
Outside of jenkins, the image is built locally just like before.

Related: OS#5017
Change-Id: I46cc176ea09d8badc359b627d7ce2f459211258c
2021-02-11 16:27:23 +01:00
Oliver Smith ce824cc3e1 ttcn3-{fr,gbproxy}-test: use ttcn3-docker-run too
Move the shared pipework script to the base image, and call it in
ttcn3-docker-run.sh if WAIT_FOR_NETDEV is set. Use ttcn3-docker-run.sh
as entrypoint in both Dockerfiles and remove the custom entrypoint
scripts (which are the same as ttcn3-docker-run.sh now).

Related: OS#5017
Change-Id: I2889abe94ed522a205890e5cb39e09cbebfbd820
2021-02-11 15:45:40 +01:00
Oliver Smith 2b38b8e779 ttcn3: move shared run code to script
While I'm at it with tidying up the Dockerfiles, create a
ttcn3-docker-run.sh with shared run code.

Related: OS#5017
Change-Id: Id90769707158f0488eca2313c57b99ea7a4a27c8
2021-02-11 15:45:40 +01:00
Oliver Smith 914a486ef1 debian-stretch-titan: prepare: start/stop links
Create symlinks to ttcn3-*-start.sh and ttcn3-*-stop.sh in the
prepare.sh script instead of in each of the ttcn3 Dockerfiles.

Related: OS#5017
Change-Id: I634cf71cff7936efe6e0461d21dc1119de922ada
2021-02-11 15:45:40 +01:00
Oliver Smith 9206cf6b28 debian-stretch-titan: prepare: run 'make deps'
Run 'make deps' in ttcn3-docker-prepare.sh, if needed.

Related: OS#5017
Change-Id: I9085203b27d310b63a035fd71f7c2a78d02710d4
2021-02-11 15:45:40 +01:00
Oliver Smith 892d910444 ttcn3: move prepare code to shared script
Move the git fetch/checkout code and make call to build the testsuite,
to debian-stretch-titan/ttcn3-docker-prepare.sh. In the next patch, I
will extend the script to update deps right before building too (e.g.
because OSMO_TTCN3_BRANCH changed).

Related: OS#5017
Change-Id: I4b5bedf058dc527e821f9b7204c632820e671af9
2021-02-11 15:45:40 +01:00
Oliver Smith 73d23109b1 debian-stretch-titan: update deps on change
After the initial clone of osmo-ttcn3-hacks and deps, let docker
download deps/Makefile to invalidate the cache if the file changed.

Run "git pull" and "make deps" afterwards, but only if the Makefile is
different. The "if" saves time in the initial build of the image, it
avoids the "git fetch" on every dependency repository during "make deps".

Related: OS#5017
Change-Id: I56673312cfb23375d67900016aaac1931f677275
2021-02-11 15:45:40 +01:00
Oliver Smith 61fed0ad39 ttcn3: move initial clone to debian-stretch-titan
Clone the osmo-ttcn3-hacks and all dependency repositories less often by
moving related commands to the shared debian-stretch-titan image.

Remove the 'git checkout -f -B master origin/master' line, because the
master branch is checked out by default.

While at it, move the shared "git config" commands too, and move them
before cloning the repositories, so they don't run again whenever the
deps change (logic to invalidate the cache if deps change will be added
in the next patch).

Related: OS#5017
Change-Id: I2bb142dce061eba4b6a828c4e435510e309989fd
2021-02-11 15:45:40 +01:00
Oliver Smith db3f98113c ttcn3: remove /root/projects/git symlink
Remove leftover from old TTCN-3 build scripts, before refactoring ttcn3
Dockerfiles. This line has already been removed in 357ec806 from 2017 for
ggsn-test.

In osmo-ttcn3-hacks.git, this is only referenced in the obsolete
bin/install.script (looks like we could remove that, together with the
rest of the bin dir?).

Related: OS#5017
Change-Id: Id23e7fae58ba246916a38aa0a10035d4f67f7588
2021-02-11 15:45:40 +01:00
Harald Welte 1927b88800 osmo-sip-master: Don't install packages not required
We don't need to install dozens of packages that osmo-sip-connector
never had as an upstream dependency.

Change-Id: I604c9843866c100f12574f1ca37ff853a1b64f42
2021-02-11 12:52:21 +01:00
Harald Welte 57b6011e28 redmine: Make changeset keywords work with OS# annotation
In Osmocom we annotate osmocom issues as OS#1234 and not just as #1234,
in order to distinguish them from redmine or coverity issues.

Change-Id: I04a97434433a022f47a759a8219458e8772ae71e
Related: OS#5005, OS#3291
2021-02-10 16:57:26 +01:00
Daniel Willmann 60f4d39500 gbproxy: Fix ip-sns VTY config
Change-Id: I8faa5d29bfffe50c76c1b907717144ff893126a3
Related: SYS#5354
Depends: Ida979f3b9daa5f7280a629441e4006a7635653b0 (libosmocore.git)
2021-02-10 13:57:31 +01:00
Daniel Willmann ba06957cf4 Add osmo-gbproxy-* container for osmo-gbproxy
Uses the new repo split off of osmo-sgsn

Related: OS#4992
Change-Id: I1e7ede4d1da54e3bcb286213b34401bd9dcf7cc1
2021-02-04 16:48:23 +01:00
Harald Welte bd94a1443e ttcn3-fr-tests: Configure MTU to 1700
On our deb10fr VMs we have the modified kernel HDLC module supporting
the frame relay MTU up to 1700 bytes, so let's extend our tests to cover
that.  Mainline kernels only support 1500 bytes.

Depends: osmo-ttcn3-hacks.git I8e38ecf6b270c81bd73ee43b1fa0b259a999c14b
Change-Id: Id25532edbf5e1a918ad038723da464723d6f03f0
2021-02-04 15:01:57 +01:00
Harald Welte ed6163df50 ttcn3-fr-tests: Disable junit-xml generation for FRNET_Tests
FRNET_Tests is not a test suite, but just a stub against which we
execute FR_Tests.  Hence, we don't want it to generate a junit-xml,
as that doesn't contain any errors and only upsets our jenkins
test results analyzer, assuming the tests have failed.

Change-Id: Idec2bf8da30ccd211b21901d56979143ce3a172f
Requires: osmo-ttcn3-hacks.git Id296e62fb86731492d42370173a48f217b2fbdc0
2021-02-04 10:38:15 +01:00
Harald Welte 18564ba9c2 New ttcn3-fr-test container
Change-Id: I32433871e25de46ef58b70af46400cbb4dc0dbc5
2021-02-03 22:20:20 +01:00
Vadim Yanitskiy 0b9f7c338b osmo-pcu-master/Dockerfile: add missing libosmoctrl dependency
Since Id35f40d05f3e081f32fddbf1fa34cb338db452ca, osmo-pcu also
depends on libosmoctrl.  Debian based images work just fine,
because they depend on libosmocore-dev, while for CentOS we
need to specify all sub-libraries explicitly.

Change-Id: I6cccb77432b2b8fcb9f90c5205f7f1fb9dc41910
2021-02-01 14:19:44 +01:00
Pau Espin 0d6b421aa7 ttcn3-pcu: Update configs to support NACC tests
Change-Id: If027812940579a7f344a36543e85518cc096905b
2021-02-01 11:21:06 +00:00
Alexander Couzens c83c5d627f sgsn: change configuration to the new NS2
Change the whole vty configuration for NS to be more flexible
and support more setups. Old configurations are invalid.

For further information see:
https://osmocom.org/projects/libosmocore/wiki/Network_service_(NS)

Depends-on: Ie9306ab4d4738c2c57a69987086e22771b30657e (osmo-sgsn)
Change-Id: I65fb4e52d22617cf8488d8ab77c970f84995560d
2021-01-28 21:55:24 +01:00
Harald Welte 366ace7461 ttcn3-gbproxy-test: s/sgsn/gbproxy/
the jenkins.sh script was copied from the SGSN test suite and still
mentioned sgsn at several places when actually intending to mention
gbproxy.

Change-Id: I8709121d8501da4afc1c8dda70356096d331a9b0
2021-01-25 12:48:02 +00:00
Oliver Smith 4407e0e3aa debian10-repo-install-test: new container
Related: OS#4969
Change-Id: I7addb30aa3f8564dcbdc3f6cf2e2e0cfdf4dd02d
2021-01-25 09:24:03 +00:00
Oliver Smith 26bd12d73b rename {debian => debian9}-repo-install-test
Prepare to add debian10-repo-install-test. Make it consistent with
centos8-repo-install-test.

Related: OS#4969
Change-Id: I2ea18997019ebaa013c258996f5131386bcd6426
2021-01-25 09:24:03 +00:00
Oliver Smith 0861b9c7b8 debian-repo-install-test: remove Release.key
Make debian-repo-install-test simpler before copying it for debian10.
Don't install Release.key, as it is getting downloaded on demand in the
related repo-install-test script since osmo-ci
I91e7a208d8f5cb50f8baa2fde0eb979aae91da8f.

Related: OS#4969
Change-Id: Ia2ba9de264531502e2b0b9f42d7a4ecd34375851
2021-01-25 09:24:03 +00:00
Harald Welte 21b578c784 ttcn3-pcu-test-sns: Fix syntax errors in config file of previous commit
Change-Id: Ia291579d792019779ca40bc3cc1955dede6aa2e0
Fixes: I401f53bddd81e8386c01392d9a59c3b5ca8e9802
2021-01-25 09:54:41 +01:00
Vadim Yanitskiy e9c7b86978 ttcn3-pcu-test-sns: fix DTE 'Encoding an unbound integer value'
Starting from build #245 [1] all test cases fail due to DTE:

  RAW_NS.ttcnpp:62 Dynamic test case error:
    Text encoder: Encoding an unbound integer value.

This happens because fields 'data_weight' and 'signalling_weight'
are both unbound for two additional NS providers.  Fix this.

[1] https://jenkins.osmocom.org/jenkins/view/TTCN3-centos/job/TTCN3-centos-pcu-test-sns/245/

Change-Id: I401f53bddd81e8386c01392d9a59c3b5ca8e9802
Fixes: Ic607b3edc3bf724a8b2dbd6be8c806002c229509
2021-01-24 15:22:29 +01:00
Harald Welte 22b58d7ecc osmo-gbproxy: fix configuration
also, only change those values from their default values that are
neccessary to change; fall-back on the defaults whenever possible.

Change-Id: I5fba21ddf1854ed2b4f829785ab016dfa284456e
2021-01-21 20:54:18 +01:00
Harald Welte 98365d159f gbproxy: Use separate NS-VC for data + signaling
This follows the change implemented in osmo-ttcn3-hacks.git
If0e404bdf2c30a5e18748695608611be83f61109 to use data-only
and signalling-only NS-VCs on the SGSN side

Change-Id: I58f8a6d1c8d01551d366bd7d0dbfb892cce512ae
Requires: osmo-ttcn3-hacks.git If0e404bdf2c30a5e18748695608611be83f61109
Related: OS#4953
2021-01-21 09:43:20 +00:00
Harald Welte 9f53e36985 gbproxy,pcu,sgsn: Update config files
In upstream I9798e639b4bc8658482945970775b012b5840779 we introduce
two additional fields per NSVC (data_weight, signalling_weight). Make
sure those are specified everywhere.

Related: OS#4953
Requires: osmo-ttcn3-hacks.git I9798e639b4bc8658482945970775b012b5840779
Change-Id: Ic607b3edc3bf724a8b2dbd6be8c806002c229509
2021-01-21 09:43:20 +00:00
Alexander Couzens 28607d6bf5 ttcn3-pcu-test/sns: add configuration for 2nd and 3rd nsvc
With the change to NS_Provider the configruation has to be extended to also include
the other nsvcs.

osmo-ttcn3-hacks: c316572db111 ("RAW_NS: rework NS connection to use NS_Provider")
Change-Id: I8020f808c06054ee38427de65b8c3867817d4ad2
2021-01-18 13:24:54 +01:00
Harald Welte d12441a935 gbproxy: Update configs for SGSN poool with 2 SGSN, NRI, ...
Change-Id: Iac57e079d1375f186ddc200471bad1fa622c8860
2021-01-17 19:26:34 +01:00
Oliver Smith ee7107f8ee fpga-build: don't write path to /etc/environment
PATH isn't overwritten anymore when jenkins runs docker in osmo-ci.git's
master-builds.yml / gerrit-verifications.yml, therefore we can remove
this hack.

Change-Id: I5bff98f7af1a2f2de88c8d96d1e30de960057d01
2021-01-13 15:56:17 +01:00
Oliver Smith 8f60d951da Cosmetic: debian-stretch-jenkins, osmo-gsm-tester: fix indent
Change-Id: Ia6b12b2c35f69eb0434797b29ee0ef676b032250
2021-01-13 15:56:06 +01:00
Oliver Smith f92edcc32f debian-stretch-jenkins,fpga-build: add gsm-manuals
Prepare to remove 'build-deps.sh osmo-gsm-manuals' calls from all
projects.

Related: OS#4912
Change-Id: Id402e0ea372b5ca8a6c8f6f5beb190544c888207
2021-01-13 15:55:52 +01:00
Oliver Smith b68cfd7fa9 fpga-build: add osmo-ci
Clone osmo-ci.git, and install all files from scripts/* to
/usr/local/bin.

Related: OS#4911
Change-Id: I3625d6f10e566101fb25963757da6827670ca41b
2021-01-13 15:54:23 +01:00
Alexander Couzens 26003afcbc make osmo-gbproxy.cfg in ttcn3-gbproxy and ttcn3-gbproxy-fr to look similiar
Reduces human error when changing the configruation for both
cases.

Change-Id: I807589cc04f23d483695467320d34d79eaf5d290
2021-01-12 12:20:24 +01:00
Alexander Couzens 460e3070d3 ttcn3-gbproxy-test-fr: fix SNS ip address
Change-Id: Iba5aee47fb237884d4b0238b9cef4e2370e7ce09
2021-01-12 12:20:15 +01:00
Oliver Smith 8f2210f528 debian-stretch-jenkins, osmo-gsm-tester: add osmo-ci
Clone osmo-ci.git, and install all files from scripts/* to
/usr/local/bin. Together with osmo-ci
I45bd7ea56849dab839a98cfd52806f7cd288094e, this will make overwriting
PATH obsolete.

Related: OS#4911
Change-Id: I0820f13cd740f7d4a8999d279cef6ae293a67d81
2021-01-12 08:26:25 +00:00
Alexander Couzens 663c77203b gbproxy-fr: Enable IP-SNS towards SGSN
Change-Id: Id59cc404c355a3f494ad60be8d3a499b217084ec
2021-01-11 22:50:59 +01:00
Daniel Willmann 6ef07ae1b9 gbproxy: Enable IP-SNS towards SGSN
Change-Id: Iebbad7131d73c15ef7ded5eadce882c653b8bf2c
2021-01-11 01:51:24 +01:00
Daniel Willmann 096f6a0030 ttcn3-gbproxy-test: Fix pcap capture with dumpcap
In commit 2279aac6 dumpcap is used to capture pcaps, but dumpcap fails
if the directory isn't writable for everyone.
Commit 62ac27779 only fixed this issue for frame relay, this simply
mirrors the change for ttcn3-gbproxy-test

Change-Id: I11dcf9efd0b06544a82e31dec03fe76e182fd0d3
Related: OS#4518 SYS#5115
2021-01-08 16:51:37 +01:00
Daniel Willmann da8c47ecb5 ttcn3-gbproxy-test: Fix osmo-gbproxy config
Change-Id: If6fd41d0cecb807f002d87e18d4b0d80f41977ef
2021-01-05 18:48:46 +01:00
Harald Welte a6fc3bf44c osmo-gbproxy: Change config file to comply with change in upstream
In osmo-sgsn Change-Id Id67592aa7712e5e04e7264b2fb8f26d57eb7e69e we
have changed the config file syntax and must adjust here accordingly.

Change-Id: I8770baac2298ee9a71d7428ea30600751783b4f9
Depends: osmo-sgsn Id67592aa7712e5e04e7264b2fb8f26d57eb7e69e
2020-12-30 00:15:25 +01:00
Pau Espin d3bd2c2ba9 Introduce osmo-ran docker image set up
See osmo-ran/README.md in this commit for a description.

Related: SYS#4889
Change-Id: If5d22e9fa818310cbb4adc34bd7aceb4416ec969
2020-12-18 11:45:33 +00:00
Harald Welte 10c2ba7ea4 fpga-build: install missing toosls required for 'publish' and manuals
Change-Id: I7b416117e80133fcf4c07ee540d15783f4576fbd
2020-12-17 17:14:25 +01:00
Harald Welte 43ec5b7eab fpga-build: Make sure PATH is also set for non-root users
Change-Id: I16bf9c8cafbad85a6ec77f17b034c73f530565b9
2020-12-17 16:31:37 +01:00
Harald Welte bd4e9c2d9d fpga-build: Create 'build' user like in 'debian-stretch-jenkins'
Change-Id: Id99167568751b19f3454831e69eacdbadaf8aee4
2020-12-17 15:37:15 +01:00
Harald Welte 7500aebce7 fpga-build: Add packages required for rendering manuals
Change-Id: Ic9bec0689b3571db9cafa8a1671aa3bc68c3f4e5
2020-12-17 15:37:15 +01:00
Vadim Yanitskiy c52dbbe7f0 ttcn3-bts-test: fix: sleep 1 second before respawning the IUT
There has been a lot of changes merged to both osmo-{bsc,bts}, so
now the later seems to be respawning faster then before.  Because
of that, osmo-bts-trx is now reaching the limit of 500 runs on
Jenkins right in the middle of ttcn3-bts-test execution:

  respawn.sh: exiting after 500 runs

causing the remaining test cases to fail due to:

  "BTS_Tests.ttcn:253 : Timeout waiting for RSL bring up"

Most likely, the IUT respawns several times in the windows between
the test cases, i.e. after TITAN finishes one test case and before
it starts another.  Let's instruct respawn.sh to sleep 1 second
before starting the process again.

Change-Id: I09e5a8e7c4d28424cd0d004a8bae3cf0ade2d838
2020-12-16 14:07:12 +00:00