Commit Graph

267 Commits

Author SHA1 Message Date
Oliver Smith 0cdf1db366 jobs/ttcn3-testsuites-kernel-git: trigger manually
Related: OS#3208
Change-Id: I3a141372b0648a03b35b2b274949a001851f6ca6
2021-03-04 10:56:24 +01:00
Oliver Smith 6f2f1cbd33 jobs/ttcn3: add new ggsn-test-kernel-latest jobs
Add new nightly jobs, as requested in OS#3208:
- ttcn3-ggsn-test-kernel-latest-torvalds
- ttcn3-ggsn-test-kernel-latest-net-next

Note that they are in ttcn3-testsuites.yml and not
testsuites-kernel-git.yml, because the KERNEL_URL etc. parameters are
not configurable. These new jobs are supposed to run every night with
the same hardcoded git repositories, the other job from
testsuites-kernel-git.yml is for manual runs with a freely configurable
kernel URL.

Depends: docker-playground Iaef87c3418b8e6f1e427b2abd9d40e9e28dc63e9
Related: OS#3208
Change-Id: I6918b953b64b0d81805fd02b1a8469a8db20f938
2021-03-04 10:56:13 +01:00
Oliver Smith f6d567885d jobs/ttcn3: split *-kernel-git to own file
Move ttcn3-ggsn-test-kernel-git into its own file, so the parameters
that are only relevant for cloning a kernel from git, do not show up in
all other TTCN-3 jenkins jobs.

Related: OS#3208
Change-Id: Iafbe6139db47c2918dc1fd7c3bacf38da326d9c8
2021-03-02 13:26:08 +00:00
Harald Welte 12386e706a ttcn3-testsuites: Enable TTCN3 for osmo-smlc-latest
now that osmo-smlc is part of network:osmocom:latest, test it both
on debian9 + centos8

Change-Id: I023e47531b24f540645186f3cbf89f5025b7b48b
2021-03-02 13:41:38 +01:00
Oliver Smith 9cda811f02 jobs/ttcn3: describe ttcn3-ggsn-test-kernel-*
Related: OS#1943
Change-Id: If9975e8df46d51ef66c7a9faaf11fc0449f32f34
2021-03-02 11:18:44 +00:00
Oliver Smith e007899ab5 jobs/ttcn3: disable failing jobs
As decided in the meeting, disable jobs in the config instead of
manually disabling them in the web UI.

Change-Id: I11e9504cace39d7377e993537c6746fe154b3f12
2021-03-02 11:18:10 +00:00
Oliver Smith 1cc397205d jobs/ttcn3: add KERNEL_* parameters
Make it possible to run the jenkins job with a different kernel
repository, by exposing KERNEL_URL, KERNEL_REMOTE_NAME and
KERNEL_BRANCH.

Related: OS#3208
Change-Id: I5d4202a67a24d9c15a5b211fa29ce9d5b5a9d9c1
2021-03-01 12:54:55 +00:00
Oliver Smith 718448606f jobs/ttcn3: rename ttcn3-ggsn-test-kernel-net-next
Change the name of the job to ttcn3-ggsn-test-kernel-git. A follow-up
patch will add parameters to the jenkins job to specify a different
repository than net-next, therefore the generic name makes more sense.

Related: OS#3208
Change-Id: I409f49f88f0a75c782dd3c90c5051e8287644138
2021-03-01 12:54:55 +00:00
Oliver Smith bce53ba7d0 jobs/ttcn3: add osmo-ggsn kernel tests
Run osmo-ggsn ttcn3 tests against the gtp kernel module from the debian
kernel and from HEAD of the linux netdev/net-next git repository.

Depends: docker-playground I1f337af1e2de6db05b22636bc31a535404235559
Related: OS#3208
Change-Id: I4c496af78820d95549da22c1271bafe911f7eefb
2021-02-26 16:49:07 +01:00
Oliver Smith 4521517d1f jobs/ttcn3: tweak shell cmd
Move 'cd' and './jenkins.sh' commands towards the end, so they are not
repeated in the case block of each pattern. This is in preparation for
the ggsn kernel mod test, which will need new patterns.

Related: OS#3208
Change-Id: I0fac24b961b1abb09317144ec2f65d4e21eb70c2
2021-02-26 16:14:12 +01:00
Oliver Smith 0001acdde8 jobs/ttcn3: add wipe_workspace to job template
Prepare for the ggsn kernel module test, where we don't want to wipe the
workspace with the cloned linux git tree.

Related: OS#3208
Change-Id: Ic5843513c376d2b78be8ab90b21a747d31a827f1
2021-02-26 12:57:23 +01:00
Harald Welte 89bf3592c2 ttcn3-testsuites: Enable testing of osmo-cbc "latest"
We do have "latest" packages, so we can start testing it

Change-Id: I9f8fb03d9a02da7174bc1aa2aef412e7dbc0724e
2021-02-23 20:26:45 +01:00
Harald Welte 17f23faf37 jobs: Fix names of commented-out SMLC test containers
This was a copy-+paste introduced in Ib1f374974444cdd5d829c4e57153137ecd9149f1

Change-Id: I8b315e2df34ccd9db78173ee6e83b4d8ec85e8bf
2021-02-22 14:13:13 +00:00
Harald Welte cf95a6f39c ttcn3-testsuites: Add osmo-cbc tests
Change-Id: I29eb72570d1f80c0f690878597c03afad5bb7b10
2021-02-22 14:12:49 +00:00
Oliver Smith e99cb64e2e jobs/registry-triggers: add for osmo-ttcn3-hacks
Trigger registry-rebuild-upload-titan on changes in
osmo-ttcn3-hacks.git. Write registry-triggers.yml with a job template,
so we could add more triggers from git repos -> registry easily if
needed in the future.

Related: OS#5017
Change-Id: Ib6a27be6351ce821c7023a1f75a82b1ade2ffa49
2021-02-11 18:03:38 +00:00
Oliver Smith 7433811c62 jobs/registry-rebuild-upload-titan: new job
Trigger for this job will be added in follow-up patch.

Related: OS#5017
Change-Id: I2c4b264abf760894edb0788054fd987f9346b6ec
2021-02-11 18:03:38 +00:00
Oliver Smith 9bfdbd13e8 jobs/registry-update-base-images: fix typos
Change-Id: Ifc6c85e638818113182802841c3e0e4a7e6cfda8
2021-02-11 15:50:32 +00:00
Oliver Smith 2b22fa2f5a jobs/master-builds: libosmocore: add triggers
Add missing triggers for osmo-gbproxy, osmo-trx.

Related: OS#4992
Change-Id: I1bc590cc9560b1780cccd99f7ca86700bd9a6ad9
2021-02-11 12:28:24 +01:00
Oliver Smith ae46ae9fc2 repo-install-test: add label for relevant nodes
Add the slave axis again, so the jobs aren't stuck forever. I had
assumed that without the axis, it would run on any node, but that's not
how it works. Add a label for this job, with several nodes attached,
like we do it for TTCN-3, master-builds, gerrit-verifications etc.

Related: https://jenkins.osmocom.org/jenkins/label/repo-install-test/
Related: OS#4567
Fixes: fcf669 ("repo-install-test: run on all build slaves again")
Change-Id: I276ab47f76a0f4db542ca99825ebb019236b4d27
2021-02-10 13:02:59 +01:00
Oliver Smith fcf6699f56 repo-install-test: run on all build slaves again
It was not possible to reproduce the weird rpm errors on
admin2-deb9build, which had lead to limiting the build slaves to
build2-deb9build-ansible. Enable building on all again.

Closes: OS#4567
Change-Id: I82ef1f0c581de8ee826adedd9ecde6b4adaa36ba
2021-02-08 11:42:28 +01:00
Harald Welte 2933da3810 master + gerrit jenkins jobs: Add osmo-gbproxy
osmo-gbproxy is moving to its own reporitory

Change-Id: Id29c83bdcd9b626bb7920738c8b1f945ef7f3671
2021-02-03 08:38:06 +00:00
Oliver Smith 00b7181760 repo-install-test: add 'debian10'
Related: OS#4969
Depends: docker-playground I7addb30aa3f8564dcbdc3f6cf2e2e0cfdf4dd02d
Change-Id: If0fc12464b571dc42b33f2a077c77ea6e5120b8d
2021-01-25 10:31:11 +01:00
Oliver Smith 137d39c764 repo-install-test: rename 'debian' to 'debian9'
Related: OS#4969
Depends: docker-playground I2ea18997019ebaa013c258996f5131386bcd6426
Change-Id: Iaa2202cca4072b4dc0309e011aba6cb33ed5b8aa
2021-01-25 10:28:16 +01:00
Oliver Smith 867b6de117 jobs/repo-install-test: run a few hours later
Give OBS more time to build the repository, before verifying that we can
install all packages from the repository. Apparently, OBS publishes the
repository in WIP state, before all packages for a distribution have
been built.

This leads to problems in the "nightly" and "next" repositories. In
contrary to "latest", we do not bump soname versions when doing ABI
changes, so we require the user to have all installed Osmocom packages
built from the same timestamp. With recent changes in the OBS scripts,
we enforce this by having all packages built from the same timestamp
depend on the exact version of a dummy package with that timestamp as
version.

The repo-install-test installs all packages from the binary repository,
and so it fails, as it should, if the repository is in an inconsistent
state with some packages built today and some packages built yesterday.

Related: OS#4733
Change-Id: I8df9b449d6213b5dca6fd9bf5c06b5c96d468f66
2021-01-21 10:44:59 +01:00
Oliver Smith 48c966a305 Cosmetic: jobs/obs: update repo-install-test name
Change-Id: Ic5712173ec79d286fb3591364636a38f6af74503
2021-01-21 10:30:05 +01:00
Oliver Smith 9dadec3209 jobs: remove duplicate docker_run
docker_run was duplicated for osmo-e1-hardware and no2bootloader, so the
'-e PATH' line could be removed from the global docker_run. It was
overriding the PATH, which then did not contain the path to the compiler
toolchain anymore.

This workaround is not needed anymore since de5aa17d6 ('jobs: don't
overwrite PATH in "docker run"').

Related: OS#4911
Change-Id: I97a4add17d9fa1bd28ab0ceb054b9a8d948b6f86
2021-01-13 12:40:18 +01:00
Oliver Smith 212e43fa1c jobs: update OSMO_GSM_MANUALS_DIR
Use new location inside / outside docker, where the repository was
cloned already. So it does not need to be cloned during the job.

Roll out: make sure that the docker images are already built! (or let me
merge it)

Related: OS#4912
Depends: docker-playground Id402e0ea372b5ca8a6c8f6f5beb190544c888207
Change-Id: Ibe91a613162687589e006cba99193606fb8a3eb9
2021-01-13 12:40:18 +01:00
Oliver Smith 5150f0ec62 jobs/osmo-gsm-manuals-trigger: new job
On change, roll out osmo-gsm-manuals to relevant build environments.

Related: OS#4912
Change-Id: I104525826068b016b5e06ea52567da4d7beaf7a4
2021-01-13 12:38:12 +01:00
Oliver Smith 24a5609f30 jobs: add missing OSMO_GSM_MANUALS_DIR
Add the variable to projects that don't use docker at all or overwrite
docker_run instead of using the global variable that has
OSMO_GSM_MANUALS_DIR defined.

Related: OS#4912
Change-Id: I65102655b4b3e907a0b0de8026f8f9af76281f90
2021-01-12 13:54:55 +01:00
Oliver Smith de5aa17d6d jobs: don't overwrite PATH in "docker run"
Don't mount $HOME/bin to /build_bin, and don't overwrite PATH to include
/build_bin anymore. This isn't needed because the scripts are installed
to /usr/local/bin inside the docker images now.

Depends: docker-playground I0820f13cd740f7d4a8999d279cef6ae293a67d81
Related: OS#4911
Change-Id: I45bd7ea56849dab839a98cfd52806f7cd288094e
2021-01-12 09:15:45 +01:00
Oliver Smith 4cbc445616 osmo-build-dep.sh: don't build osmo-gsm-manuals
Save time by only cloning the repository, and not running autoreconf
-fi, ./configure, make and make install. Especially the tests during
make took up significant time, that slowed every project depending on
osmo-gsm-manuals down while being built through master-builds or
gerrit-verifications jobs. Set OSMO_GSM_MANUALS_DIR to the clone
location.

This is an interim measure, I'll submit more patches soon that remove
the 'osmo-build-dep.sh osmo-gsm-manuals' calls from all projects.

Change-Id: I5238cf3f93ded97ed2b44d27868123a646e122dc
Related: OS#4912
2021-01-12 09:14:38 +01:00
Daniel Willmann e7b1594497 Add timeout to gerrit verifications
Gerrit verification jobs sometimes hang (usually during the VTY tests).
At some point we should just time out, default is 30 minutes

Change-Id: I6fc6ee976f2d88efdab1582a418d1adcd384c850
2021-01-04 18:40:18 +01:00
Pau Espin Pedrol d386689e57 jobs: ogt: Update default suite for osmo-gsm-tester_virtual job
Since osmo-nitb is deprecated, the test was moved to use the "new" split
stack.

Change-Id: I6cc47f7a748339de406c1216c718a0d0042955d4
2020-12-21 18:38:55 +01:00
Harald Welte 09891fbb95 Add master-no2firmware build job
This is the DFU bootloader we use in icE1usb and e1-tracer.

Change-Id: Iaedb4e8f487c11b0247c27cba403fe2dfcd6b708
2020-12-19 11:20:16 +01:00
Harald Welte cbce526b0f Add master + gerrit job for osmo-e1-hardware
Change-Id: I02295e157f909bca985c1919a7828da0554ee1ef
2020-12-17 18:48:28 +01:00
Harald Welte 660d7ba7c7 add registry-rebuild-upload-fpga-build.yml
This will rune once per week and make sure that registry.osmocom.org
has a fpga-build container that the buld slaves can use.

Change-Id: Ie700d7c6e3c5e794edd81c3acc4b689e05d6864d
2020-12-17 15:54:41 +01:00
Harald Welte b4e042736c update-osmo-ci-on-slaves: Add build slaves on gtplab0
Change-Id: I555cb26be138e2969d07ad561fe8eba8994f2429
2020-12-17 13:50:04 +01:00
Harald Welte bfccd70721 jobs: Add ttcn3-gbproxy-test-fr for Frame Relay testing
this job can only run on a specific type of buildslave: A system
with Linux kernel HDLC support.

Change-Id: Id440c70a8f21583bce109366f44cdc22e0ca1ae8
2020-12-17 12:32:10 +01:00
Pau Espin Pedrol e935398ae9 jobs: repo-install-test: Use centos8 as distro name
We use centos8 instead of centos in all docker-playground.git setups and
the infrastructure there expects that kind of naming.

Related: OS#4888
Change-Id: Idfbb2c4fc1ca10741406c8ab8930dabe8ce632ee
2020-12-07 12:54:17 +01:00
Harald Welte 1f5faf85bd remove all debian8 slaves
we cannot even create new slaves as lxc-create doesn't support debian
jessie anymore.  Let's focus on Debian 9 + Debian 10

Change-Id: I2fddd460f7d1db755cc9b732b2be80494d26e091
2020-11-15 10:01:03 +01:00
Harald Welte f8b9737728 jobs: master + gerrit: Mark them as running on debian9. not debian8
We actually do the verification inside a (debian 9) docker container anyway,
so there's no need to run those on the old debian8 slaves.

Change-Id: I2168bd2f0e6221518ece111e29dc604c33eaca6a
2020-11-14 23:24:36 +01:00
Vadim Yanitskiy 905a1e6fc8 jobs/master-builds.yml: enable manuals for all osmo-bts variants
Since Idba84164b90e3d183a20b5eb69cbfe15745e447c, we started to
generate separate PDFs for different osmo-bts-variants, so
let's enable them all.  Otherwise only osmo-bts-{virtual,sysmo}
PDFs are generated and uploaded to the server.

Change-Id: I517be2d475f57026dab7f001d2298cf1a1aa2c7c
Related: SYS#4937
2020-11-06 21:52:38 +07:00
Daniel Willmann 5806d0a63f jjb: Add ttcn3-gbproxy-test to ttcn3-testsuites.yml
Fixes: OS#4850
Change-Id: I05d1855a6daea6a67df01a1f9fa65955cfd72661
2020-11-05 18:54:37 +01:00
Harald Welte 262f164fb2 Add jenkins job to update docker base images on registry.osmocom.org
Change-Id: Iec2d2e3a43b074cb60f75cbe852351ffa8e0009e
Related: OS#4839
2020-11-04 19:30:57 +00:00
Harald Welte 7685f9c349 ttcn3-testsuites: Set REGISTRY_HOST="registry.osmocom.org"
This will make the Dockerfiles from docker-playground.git
use registry.osmocom.org rather than the public docker.io for base
distribution images like debian:stretch or the like.

This will avoid any strange timeout/EOF problems while doing
docker build --pull in our test jobs.

Change-Id: If4275cf3c8a5b70a67d742950a35ae8ead59a52e
Closes: OS#4839
2020-11-02 16:57:06 +00:00
Pau Espin 57a38c7daf jjb: obs: Trigger jobs at sme point during 00H instead of 01H
There's no real need to wait until 01:00, let's try to get packages
built before.

Change-Id: I9db7108ecaab418f9b657d30c02622c56dc04798
2020-10-22 06:11:42 +00:00
Pau Espin c5ebc06b74 jjb: ttcn3-testsuites: Spread all test grouped around the day
Before this patch, only the debian+master jobs were spread around
several hours, while debian+latest and centos+nightly were all triggered
at midnight.
Let's instead run all flavours of teh same test (debian+nightly/latest,
centos) around same time but not concurrently by marking blocking one
each other so that they are run one after the other. Then, each group is
separated by a given time spreading the load over the night + morning.

This also means we no longer start tests at 00:00, which means docker
images will use software from the day after, since the nightly
repositories are built around 01:00.

Related: SYS#5121
Change-Id: Ib1f374974444cdd5d829c4e57153137ecd9149f1
2020-10-22 06:11:42 +00:00
Neels Hofmeyr 2dc35de85b jenkins: add osmo-smlc to coverity and ttcn3 jobs
Change-Id: I690962cd8352e255a2bf0ae16aa8ddda68edf10a
2020-10-21 00:55:59 +02:00
Pau Espin cf17475839 jobs: Enable --without-sse build variant for osmo-trx
Change-Id: I47a2067dc25335557dfa93f291f6ca9cd4959735
2020-09-18 21:15:10 +02:00
Harald Welte 53e344d574 jenkins: add master + gerrit for osmo-smlc
Change-Id: Iaeb064ed8e7d08db305f1928dc26d16dc6c889dd
2020-08-21 20:17:49 +02:00