Commit Graph

546 Commits

Author SHA1 Message Date
Oliver Smith fc4579cf76 jobs/osmocom-obs: run against obs.osmocom.org too
Split the OBS related jenkins jobs into two, one that uploads to the
new obs.osmocom.org and one that uploads to build.opensuse.org.

Set an alias for "osc" that sets the right server, and set the
expand_aliases shopt so the bash scripts that source common-obs.sh will
not ignore the alias.

Related: OS#5557
Change-Id: Ib271e16e93ebc58ed1ecb0ea881e1f1370e40928
2022-06-27 13:31:44 +02:00
Oliver Smith 6e7afd94d3 jobs/ttcn3-testsuites: drop 2021q1, 2021q4
Not needed anymore, as discussed in related issue.

Related: SYS#6007
Change-Id: Id8f7d7c198647df60b684fd5767e77cadff60a76
2022-06-21 14:40:27 +02:00
Oliver Smith 51ed5421f1 jobs, scripts: add 2022q2
Related: SYS#6007
Change-Id: I59198f38ba817f56f6b24eae163297393587ec0b
2022-06-21 13:22:05 +02:00
Oliver Smith 3577608180 jobs/master-builds: disable master-osmo-opencm3-projects
As discussed in the team meeting, disable it for now.

Change-Id: I4a79a146042d5cf586f5273960a9a2b92b45b1be
2022-06-21 11:39:32 +02:00
Neels Hofmeyr 38d569d45f add libosmo-pfcp
Change-Id: Icb75adec886cf1053b80c968fea59e597ed289a7
2022-06-17 16:33:10 +02:00
Oliver Smith f6e305928a jobs/update-osmo-ci: gtp0-deb{10 => 11}build32
Related: OS#5453
Change-Id: I4b10550f4274995e70bf32f013bffecc1039d8a0
2022-05-18 16:43:01 +02:00
Oliver Smith c825551ca8 jobs: TTCN3-centos: set OSMOCOM_REPO_TESTSUITE_MIRROR
In previous patch Id114d55edc2ba92f7851243ab7df51db332079c4, only the
OSMOCOM_REPO_MIRROR should have been overridden. However
OSMOCOM_REPO_TESTSUITE_MIRROR defaults to OSMOCOM_REPO_MIRROR, so
explicitly set it in this patch to the opensuse mirror.

This fixes problems while building debian-bullseye-titan caused by the
different directory structure of both mirrors, and OSMOCOM_REPO_PATH
intentionally not taken into account while building the testsuite
docker image.

This is part 2/2 of fixing TTCN3-centos-bts-test, which has been failing
since OSMOCOM_REPO_MIRROR was changed in osmo-ci.git. Part 1 is in
docker-playground I78e0445a1b82e5cd72ecaa86e8fe25516b19f485.

Change-Id: I8201f34a0f9747eea78c358a626cc3981d7407c4
2022-05-13 11:15:00 +02:00
Oliver Smith 526f1e12d3 jobs/ttcn3-testsuites: centos: use osmocom mirror
Lately we've been seeing a lot of build failures from the TTCN3-centos
jobs running against the nightly repository. It seems that the mirror we
get redirected to isn't syncing properly. Use the Osmocom mirror
instead.

Fix for:
  Nightly packages of the Osmocom project (CentOS 190 kB/s | 1.7 kB     00:00
  Nightly packages of the Osmocom project (CentOS 1.8 kB/s | 634  B     00:00
  [91mErrors during downloading metadata for repository 'network_osmocom_nightly':
    - Status code: 404 for 7062058d3e234003a6c3595331cf3fc100-filelists.xml.gz (IP: 134.76.12.6)
    - Status code: 404 for ad91db8cb719947d9abc971661c588e8c6-primary.xml.gz (IP: 134.76.12.6)
  [0m[91mError: Failed to download metadata for repo 'network_osmocom_nightly': Yum repo downloading error: Downloading error(s): repodata/ad91db8cb7273beaefca0e473d9c4dd12d12786819947d9abc971661c588e8c6-primary.xml.gz - Cannot download, all mirrors were already tried without success; repodata/7062058d3e5395b4b02570496e41e19e8fd306f5234003a6c3595331cf3fc100-filelists.xml.gz - Cannot download, all mirrors were already tried without success

Change-Id: Id114d55edc2ba92f7851243ab7df51db332079c4
2022-05-05 15:05:50 +02:00
Oliver Smith 382aebd040 treewide: rename rpi4-raspbian10 to rpi4-raspbian11
The raspberries have been upgraded to the debian 11 based raspberry pi
OS. Adjust the name to avoid confusion.

Related: OS#5453
Change-Id: I0b2e08b11d83243e81b2bb4412ffcc9bc59821ff
2022-05-02 13:29:50 +00:00
Harald Welte 032c0de4b8 dahdi-linux: Add gerrit build verification against master
Now that master-dahdi-linux-master is passing, we should verify any
future patches also against master.

Change-Id: I86cfd7e868dcaeeb6c6dbc6f08046a70b4582cc7
2022-04-24 19:48:47 +02:00
Harald Welte 5b933d8aea dahdi: use buster, not stretch
stretch has too old gcc which doesn't support -Wno-format-truncation
which is used in dahdi-linux since 2018.

Related: OS#5407
Change-Id: I4fca722e67b2c649dea4f9799d277cd568bcc493
2022-04-24 18:20:58 +02:00
Oliver Smith 7abb4ca810 OBS, ttcn3-testsuites: add 2022q1
Related: SYS#5887
Change-Id: Idadb541b49e57b4403a6a6e4c966bcba9c6651db
2022-04-13 19:38:18 +02:00
Pau Espin 99578e8653 jobs: Add ttcn3-pgw-test jenkins job
Change-Id: I363a7a8eb524abfeb45c81603c29cea96f86a787
2022-04-07 17:55:39 +02:00
Oliver Smith f5ab1346db jobs/ttcn3-testsuites: adjust nplab-m3ua timers
Fix sporadic errors related to the clean up script running while images
being built:

  failed to get digest sha256:8ea2ba9a1...

Closes: OS#5447
Change-Id: If722fddce8de65a1ae012a46d6a202f430e0c69d
2022-02-28 10:42:24 +01:00
Daniel Willmann 5ecc602efe Reenable ttcn3-hnbgw-test
Now that mgw support is in osmo-hnbgw master and docker/ttcn3 testsuite
is working we can enable the test again.

Change-Id: I4c7d1ee876e90d52827b2d8cc57342298dd44061
Related: OS#5152
2022-02-24 11:43:39 +01:00
Oliver Smith 8922843ec2 jobs/ttcn3-testsuites.yml: add ttcn3-fr-test
Add a configuration for the job to the yml file. It looks like this job
was created manually, or the configuration was just not pushed to
gerrit.

This makes e-mail notifications consistent and fixes missing colors in
build output.

Change-Id: I14995dea0a0d223b78e20b49953d5c814c1ad4a1
2022-02-22 11:55:13 +00:00
Oliver Smith f271bea63d jobs/gerrit-lint: don't verify dahdi-linux
Closes: OS#5465
Change-Id: I41ede04849da033a497daf39b34828bed00ab724
2022-02-22 11:33:25 +01:00
Harald Welte 8349494c9e jenkins-jobs: Add master + gerrit for dahdi-tools
Change-Id: I9c007e070e168bfe6509f50dbc3b4e0846c31356
2022-02-21 21:23:58 +01:00
Pau Espin ef0e042ae8 jobs/ttcn3-testsuites.yml: Add ttcn3-ggsn-test-ogs
Change-Id: I61950f4fc613faae3a731ace394b76c8754bd3c4
2022-02-21 13:08:48 +00:00
Oliver Smith b712491a56 jobs/gerrit-verifications: build ttcn3 in docker
Build the testsuites in the same docker container during gerrit
verification, as it will be the case when building and running the
testsuites in the various ttcn3-* jenkins jobs.

This avoids the need to install eclipse-titan and libfftranscode on the
jenkins nodes.

Related: OS#5452
Change-Id: I6a667255bb55a945b4c6279d711142aa252c6996
2022-02-21 08:08:00 +00:00
Pau Espin ef9b2c4062 Use docker image debian-bullseye-erlang instead of debian-buster-erlang
Let's use newer debian to avoid problems with older erlang. Furthermore,
the new image builds rebar3 to avoid issues with unmatching erlang
versions.

Change-Id: I7b1956c515daccf6ab1ff87031c6fec649cadb4b
2022-02-15 20:36:10 +01:00
Oliver Smith 5bf4022a5b jobs/gerrit-lint: run on docker-playground too
Change-Id: I7213155ccd61a006231609b1d7ae1eec187b3e7b
2022-02-11 15:44:54 +01:00
Harald Welte 5cff7924ec jobs/master-builds.yml: Add master-pysim to publish manual
We only had gerrit build verification for pysim so far, but no 'master'
job that periodically builds/tests master (and publishes the manual).

As a reult, the pySim manual was still the original version from April
2021, while the code has of course progressed quite a bit in git since.

Change-Id: I4dce05cdb5f2c574256378d5fb66cff1c329c141
Closes: OS#5271
2022-02-09 17:48:04 +01:00
Pau Espin 1982f52f8e Deploy osmo-ci to ogt nodes and update it periodically
We need osmo-ci in those nodes in order for the docker old images to be
cleaned through cron entry installed by ansible docker role, which uses
/home/jenkins/osmo-ci/scripts/docker-cleanup.sh.

Related: OS#5441
Change-Id: Ieb6db0b24dce6099cfa24871a957471ca2c8bcee
2022-02-07 11:29:26 +01:00
Oliver Smith 7ad596e4d9 jobs/master-builds-dahdi.yml: new file
Related: OS#5407
Depends: dahdi-linux I904ab66a1ecd72492642ac2cc4cb102c7283c590
Change-Id: I8a479d0a214ff56c5b66f468a1c2b1b2f674e091
2022-02-04 15:05:04 +01:00
Oliver Smith b3cef938c9 jobs/gerrit-verifications-dahdi.yml: new file
Add gerrit verifications for the out-of-tree dahdi-linux kernel module.
Put this in a separate file (not gerrit-verifications.yml), because:
* not only gerrit git repo gets cloned, but also linux.git, and caching
  needs to be done properly for it
* so we can have one separate job per linux version that gets tested

Test v4.19 and v5.10 for now, as suggested in the issue.

Related: OS#5407
Depends: docker-playground Id72d19ad08681cd7cb3194de2226292f19e96df5
Change-Id: I65c7663a6b8045796536a727e4adf5554f16b2a9
2022-02-04 14:40:17 +01:00
Oliver Smith b7bf1b735d jobs/gerrit-lint: add dahdi-linux
Related: OS#5407
Change-Id: I7fdb40e40fb8cf8c9072a4e898aeffa43d1d7ae0
2022-02-04 12:36:28 +01:00
Oliver Smith 68d8fab771 jobs/registry-update-base-images: centos8 -> alma
Follow up on the change of using almalinux instead of centos8 in
docker-playground, with providing the almalinux base images in the
Osmocom registry.

Related: SYS#5818
Related: docker-playground I30e1a773b901b1d2187214445116c7f2aecc4e36
Change-Id: I93a8892da628b8d2f9cbb2a6453e8ab3153a9c4a
2022-02-03 09:31:58 +01:00
Oliver Smith c04fb387ea jobs/{master-builds,gerrit-*}: add osmo-bsc-nat
Related: SYS#5560
Change-Id: I240cb614bf3905d04bccc6a00c72567a2ad722d8
2022-01-31 14:05:34 +01:00
Daniel Willmann a96eeaade9 Disable ttcn3-hnbgw-test for now
Change-Id: Ia385c4155ffed761c5887fc4d6c76163ca732527
2022-01-26 11:44:46 +01:00
Harald Welte 8a3cd203f8 jenkins-jobs: add master build for opencm3 projects
Change-Id: I95f84079478ce57d8d5c0cffd71bc67e1605e68e
2022-01-18 14:58:41 +00:00
Oliver Smith 6350b2f537 Revert "remove linter jobs for osmo-e1d and osmo-e1-firmware"
Enable the linter again, as we decided to use a repo-specific checkpatch
config in these.

This reverts commit 2c6aa82c9a.

Related: OS#5399
Change-Id: Ib79a20658bfae64d9b718e53e6a9393708a4e694
2022-01-18 09:47:10 +01:00
Oliver Smith 3ee13bd9cd jobs: explicitly enable ansi color wrapper
For some reason (jenkins upgrade?), output is not colored anymore.
Explicitly enable the ansi color wrapper in the jjb configs, where we
have such colors in the output.

Change-Id: I2d3faaf608ae9d12573f5c0f740ff7ee4b33358e
2022-01-17 16:36:03 +01:00
Pau Espin 6942211175 jobs: ogt: Rename osmo-iuh->osmo-hnbgw build jobs
The real target was not osmo-iuh itself but osmo-hnbgw. Since osmo-hnbgw
is inits own repository now, let's rename it.

Change-Id: I72e93683ea355cf0886f08a3f31568f58ff42473
2022-01-12 10:34:06 +01:00
Neels Hofmeyr 09a4c75e2a jobs: disable ttcn3-upf-test
Change-Id: I0518a65ee68fc45bf65e10f327b1d590d7456d88
2022-01-12 03:53:25 +01:00
Harald Welte 685a362e0f cosmetic: Fix typo (no canes involved)
Change-Id: I4b3dbe6fdb6053a8dd2a6b4b3d06552df1107fdf
2022-01-10 16:16:07 +01:00
Harald Welte 2c6aa82c9a remove linter jobs for osmo-e1d and osmo-e1-firmware
tnt will remain to use his slightly not-really-osmocom coding style,
as expressed in https://gerrit.osmocom.org/c/osmo-e1-hardware/+/26841

Change-Id: If2b98bd19ce1d89970dc266119e83d2a1c648454
Related: OS#5399
2022-01-10 16:12:16 +01:00
Pau Espin 702fd8ff94 Add new repo osmo-hnbgw (nightly) to build jobs and scripts
Change-Id: I2fdbd651e4b50191e1a67e183590de99d6366ca5
2022-01-05 11:39:41 +01:00
Pau Espin 7f89d91666 jobs/master-builds: Place osmo-hnodeb properly in dependency tree
Change-Id: Id66a8be3f665ff4dc88a754d072939fbda16d719
2022-01-04 19:22:37 +01:00
Neels Hofmeyr 0c5869f359 jobs: add osmo-upf (gerrit, master builds, ttcn3 tests)
Change-Id: I43cd55c9395f2c706369afe1a9a7f475be47339f
2021-12-28 15:57:54 +01:00
Oliver Smith 37fe0ed2f4 OBS, ttcn3-testsuites: add 2021q4
Related: SYS#5726
Change-Id: I4913218b192cf0cb1fb74b239ced9a0501c2eb48
2021-12-23 09:15:48 +00:00
Pau Espin 9832c6aa4e jobs: Automatically push ttcn3-bts-tests to osmocom registry
This image used to be pushed to the sysmocom registry, before the
osmocom one existed. Let's make it available in the osmocom one now that
we have it instead.

The new job triggers upon conclusion of the
registry-rebuild-upload-titan job, since anyway the ttcn3-bts-tests is
based on that image and hence requires it to be built prior to it.

Related: SYS#5765
Change-Id: I65e4e5a9e539de5bfd881e08d7c5842f2266ecee
2021-12-20 11:39:26 +01:00
Oliver Smith 37f480d441 registry-rebuild-upload-titan: s/stretch/bullseye/
Depends: docker-playground Ib3bdfa3bec8f8ef42c55ca61cdee8fbca923874f
Related: OS#4969
Change-Id: Ic117725f765a83cf3d2955e19441795fe6415dd2
2021-12-16 11:01:34 +01:00
Oliver Smith cc3e7efe1a jobs/registry-update-base-images: add d:bullseye
Related: OS#4969
Change-Id: I2f30c9ff3558e3fad60117d951c85c3548eddf1b
2021-12-16 10:44:39 +01:00
Oliver Smith f0d09c50af jobs/registry-update-base-images: one image per line
Make the list of images more git friendly, and sort the debian releases
by date.

Related: OS#4969
Change-Id: Ic724aa4b2c71aa398ad7f7049e8f3406a3883eaa
2021-12-16 10:44:39 +01:00
Oliver Smith 521bfea795 jobs/ttcn3: disable TTCN3-centos-remsim
It seems that TTCN3-centos-remsim-test was disabled manually via the web
UI and only got enabled recently after rolling out unrelated changes in
jobs/ttcn3-testsuites.yml. The tests do not run properly with the centos
version and it seems that nobody is using it, so disable them again for
now.

Change-Id: I4885333d63944af3510fdf0519233989808944ff
2021-12-15 17:18:37 +00:00
Oliver Smith 31edfd7116 jobs/octsim_osmo-ccid-firmware: new job
Import the existing (non jenkins-job-builder) job with
jenkins-job-wrecker. Change it to fetch the git repository, add missing
mkdir so it works with a fresh workspace too.

Fixes: SYS#5738
Change-Id: I19d18b24a6ae5948aeaf7c46083748c70cdb3b7b
2021-12-14 13:22:04 +00:00
Oliver Smith b5617e2f84 jobs/registry-update-base-images: add centos7
Related: SYS#5754
Change-Id: I64ce913b79dad063fd34848be538b088d6b3402d
2021-12-13 16:36:15 +01:00
Oliver Smith 3660dd99d9 jobs/ttcn3-testsuites: adjust cmd for centos7
Related: SYS#5754
Change-Id: Iaf6162682074f5f9de70d420e91a72f283e695bc
2021-12-13 16:32:25 +01:00
Oliver Smith 3e1019df80 jobs/ttcn3-testsuites: add centos7 pcap-client
Depends: docker-playground I775776ff7f358fee3d085f814c295c49225f5170
Closes: SYS#5754
Change-Id: I6cab8f919efd94b4d7c2664fd131f7210aac86a6
2021-12-10 12:44:52 +01:00
Pau Espin cccd0cdd08 jobs: Add jenkins jobs ttcn3-hnodeb-test(-latest)
Change-Id: I451741b77f925c7402de0342b8224e24e30e7b02
2021-11-25 17:19:34 +01:00
Oliver Smith a72c79c6ae jobs/repo-install-test: centos8: enable latest
Now that we made a new release including the new .spec.in files, from
which the rpms are built, we have the rpms in the repository and can
enable the repo install test for latest.

Change-Id: I5da2b895d636b348e5aa0539a23fe4d99e8644ae
2021-11-22 15:12:40 +01:00
Oliver Smith 1e6cae565a jobs: disable "next" repository
Related: OS#5322
Change-Id: I9efd020813540941f9afa2c03b9127c04465ce91
2021-11-22 14:52:42 +01:00
Pau Espin 2146640769 Add osmo-hnodeb to ansible/jenkins/coverity setup
Change-Id: Ie4b03aefeda13d216706bd648145689cf2ef93bb
2021-10-25 11:06:48 +02:00
Oliver Smith a18e6dfa40 jobs/ttcn3-testsuites.yml: add ns-test-sgsn-sns
Depends: docker-playground I1a9205885d381c04141dad752de0b39d9268ab69
Change-Id: Ifb08fafa408b8c622998080b4ec2932b0c3fd3bb
2021-09-08 08:14:49 +02:00
Oliver Smith 1658ff58aa jobs/gerrit-lint.yml: add lint jobs
Related: OS#5087
Change-Id: Ic473a5c535dfbdda55751e53fc751ede1adde7e2
2021-09-06 10:56:26 +00:00
Oliver Smith f404962d61 jobs: don't run any on admin2-deb9build
This node was disabled permanently, so don't try to run anything on it.

Change-Id: I0ea91658c74ea24fae551b917628fab5f7952c97
2021-06-04 14:11:05 +02:00
Neels Hofmeyr 499faad7a3 ttcn3: add ttcn3-bsc-test-vamos
Change-Id: I9c4918c4f1da28b97db6386485e115f7e091a842
2021-05-26 00:09:22 +02:00
Harald Welte 16f324618f master-builds: turn git_base_url actually in a URL, not just hostname.
Let's include the 'protocol' part itno the git_base_url variable, so it
actually becomes an URL, not just a hostname-with-path-prefix.

This way we can keep using git:// for osmocom and use https:// for
github and sysmocom.

Change-Id: I7befd1dd1445e0aa4d42434dbc8e001f904ae196
2021-05-18 11:55:53 +02:00
Harald Welte 51e5b234f4 master-builds: Use https when linking to git repos from description
Change-Id: I3a0a3d779ce456ce359e33bc1305f63271deb87e
2021-05-18 11:53:35 +02:00
Harald Welte d793650519 some more git.sysmocom.de https (+path) changes due to gitea migration
Change-Id: Ie1599b356932ffa83d70e08b96179b7ca4909b14
2021-05-17 08:16:34 +02:00
Oliver Smith 849495ff9b jobs/ttcn3: add TTCN3-centos-*-2021q1
Depends: docker-playground Icf1e3f1928658ff3d82190c4176252cf3590a1f5
Related: SYS#5370
Change-Id: I2ec731d7d6d31c06b8feccbc7620128ebb034299
2021-05-04 09:38:38 +02:00
Oliver Smith e660339f2e OBS: require PROJ environment variable to be set
Uploading to network:osmocom:* should only be done when these scripts
are running in the Osmocom jenkins. Remove the default and require users
of the script to explicitly set PROJ.

Related: SYS#5370
Change-Id: If49ce217e77716b63dfde9139e869672a54b66a2
2021-04-29 16:04:00 +02:00
Harald Welte 92948e6f41 add jenkins jobs for TTCN3 tests of osmo-pcap-client
Change-Id: I4283c3f578a9baccddc693d4b09043502212a8e5
2021-04-25 21:55:18 +02:00
Harald Welte f1b0acb231 release-tarballs: Don't rely on system-installed 'known_hosts'
We should do like the various contrib/jenkins.sh scripts and
bring our own known_hosts file to deploy to ftp.osmocom.org.

This fixes deploying after merging If0d57ef9edc4d6b3fdf435e44573a15d64245b6a
recently.

Change-Id: Ia598739f820c8b00c33382afbbe88bf2638241dc
2021-04-25 21:55:18 +02:00
Harald Welte 7cabaabd0e osmocom-release-tarballs: Switch from rita -> ftp.osmocom.org
We should use service-aliases and not the primary host name, as
that makes migration between machines hard.

Change-Id: If0d57ef9edc4d6b3fdf435e44573a15d64245b6a
2021-04-22 11:25:55 +02:00
Harald Welte 39632345e7 disable gbproxy-latest TTCN3 tests for the time being.
The latest tagged libosmocore misses several important features
and it is currently not economic to maintain a test suite for
the older NS dialect.

Change-Id: I3c87ec54c86ecbfe0c358178b4d8dafd613db584
2021-04-13 13:22:02 +02:00
Harald Welte 20925c1c2a jobs: Add TTCN3 test job for osmo-ns-dummy master "sns" and "fr"
Change-Id: I1e7bb5a00b91ca3cb33750c9f2035125b797b45c
Related: SYS#5396
2021-03-31 10:23:21 +02:00
Harald Welte 22aae4b8fa Add TTCN3 test job for osmo-ns-dummy master
Related: OS#5396
Change-Id: I3442c1fb826385a847f3965306bc48249474176a
2021-03-30 20:37:24 +02:00
Pau Espin 085f2bc1f5 jobs: Add OGT open5gs build jobs
Change-Id: Ib7786d077017b24825d575b6801cb7c7f08ea832
2021-03-15 19:13:07 +01:00
Oliver Smith 85bca774fc jobs/osmocom-release-tarballs: adjust containers
Build debian-stretch-obs-latest instead of debian-stretch-build, before
building debian-stretch-build-dist.

Depends: docker-playground I2cf6ed732e55b8f0e63bd8fc040749bd16676d0f
Change-Id: I4189ab1bf483f0a31ffdb35af0d42fe2e9a72a90
2021-03-12 08:38:40 +00:00
Oliver Smith ca8b26a18c jobs/ttcn3: add myself to e-mail recipients
Change-Id: I415816035fe959f91984c3496a8d1aecfc5c3885
2021-03-10 13:29:14 +01:00
Oliver Smith e00e3fb915 jobs/ttcn3-testsuites: kernel: keep workspace
Don't wipe the workspace of kernel tests. Cloning the kernel sources
takes a great amount of time and traffic, so we want to keep them
around.

Change-Id: Ifbf6ea127011d8c9fc5c08b584d99ea0220c3e1a
2021-03-10 13:29:08 +01:00
Oliver Smith 463a6cc012 jobs/master,gerrit: run osmo-{bts,trx} in docker
Build both of them in docker, like most other projects.

Depends: docker-playground Ieec31fd6a2034c4430be81afd1d370816cd577d5
Related: OS#5055
Change-Id: Ifc11730192b852d3760a31a561efc61a1a853674
2021-03-09 09:30:27 +01:00
Oliver Smith 8c48d2020a jobs/*: update references to rpi4 nodes
Use the new label that matches all three rpi4 nodes in master-builds and
gerrit-verifications (so the builds can run on any of them). Use the
names of the three nodes in update-osmo-*-on-slaves, so all of them get
updated.

Related: https://jenkins.osmocom.org/jenkins/label/rpi4-raspbian10/
Related: OS#5055
Change-Id: I5b2af801baeb510e7784d6bcd7cabfda4962af0c
2021-03-08 15:44:11 +01:00
Oliver Smith af9e8a9e64 jobs/ttcn3: add TTCN3-centos-*-latest
Depends: docker-playground I274b31d4903df07e99fd434af25bdb72991f6923
Related: OS#5049
Change-Id: I9a29fddc93789cd285d85445830cc26016af9768
2021-03-04 15:04:41 +01:00
Oliver Smith 57576f66e3 jobs/ttcn3-testsuites-kernel-git: remove wrong comment
Here, the job names are not the same as the directory names of
docker-playground.git

Related: OS#3208
Change-Id: Idbcb7267ce38cbdc2df5631df404f908487f827b
2021-03-04 14:20:14 +01:00
Oliver Smith 5916e1f003 jobs/ttcn3-testsuites-kernel-git: make userfriendly
Change the description of the job, to make it easier to use for somebody
not familiar with the Osmocom stack / the testsuites. Move the BRANCH
parameter to the bottom, as it is not relevant for kernel developers who
want to test their kernel, and adjust the description.

Related: OS#3208
Change-Id: I0968ae716c8e3f32db6f589b28d6066d95ad85ea
2021-03-04 14:20:09 +01:00
Oliver Smith 3b9325f0b6 jobs/ttcn3-testsuites-kernel-git: add OSMOCOM_VERSION
Let the user choose whether to run against osmo-ggsn latest or master.
I chose the name "OSMOCOM_VERSION" for the variable to make this easier
to use for people not familiar with the Osmocom stack / the test
infrastructure, as suggested in the related issue.

Related: OS#3208
Change-Id: Ifaf8ed6502b469ade670c3f436670480d27becd6
2021-03-04 10:56:24 +01:00
Oliver Smith 0cdf1db366 jobs/ttcn3-testsuites-kernel-git: trigger manually
Related: OS#3208
Change-Id: I3a141372b0648a03b35b2b274949a001851f6ca6
2021-03-04 10:56:24 +01:00
Oliver Smith 6f2f1cbd33 jobs/ttcn3: add new ggsn-test-kernel-latest jobs
Add new nightly jobs, as requested in OS#3208:
- ttcn3-ggsn-test-kernel-latest-torvalds
- ttcn3-ggsn-test-kernel-latest-net-next

Note that they are in ttcn3-testsuites.yml and not
testsuites-kernel-git.yml, because the KERNEL_URL etc. parameters are
not configurable. These new jobs are supposed to run every night with
the same hardcoded git repositories, the other job from
testsuites-kernel-git.yml is for manual runs with a freely configurable
kernel URL.

Depends: docker-playground Iaef87c3418b8e6f1e427b2abd9d40e9e28dc63e9
Related: OS#3208
Change-Id: I6918b953b64b0d81805fd02b1a8469a8db20f938
2021-03-04 10:56:13 +01:00
Oliver Smith f6d567885d jobs/ttcn3: split *-kernel-git to own file
Move ttcn3-ggsn-test-kernel-git into its own file, so the parameters
that are only relevant for cloning a kernel from git, do not show up in
all other TTCN-3 jenkins jobs.

Related: OS#3208
Change-Id: Iafbe6139db47c2918dc1fd7c3bacf38da326d9c8
2021-03-02 13:26:08 +00:00
Harald Welte 12386e706a ttcn3-testsuites: Enable TTCN3 for osmo-smlc-latest
now that osmo-smlc is part of network:osmocom:latest, test it both
on debian9 + centos8

Change-Id: I023e47531b24f540645186f3cbf89f5025b7b48b
2021-03-02 13:41:38 +01:00
Oliver Smith 9cda811f02 jobs/ttcn3: describe ttcn3-ggsn-test-kernel-*
Related: OS#1943
Change-Id: If9975e8df46d51ef66c7a9faaf11fc0449f32f34
2021-03-02 11:18:44 +00:00
Oliver Smith e007899ab5 jobs/ttcn3: disable failing jobs
As decided in the meeting, disable jobs in the config instead of
manually disabling them in the web UI.

Change-Id: I11e9504cace39d7377e993537c6746fe154b3f12
2021-03-02 11:18:10 +00:00
Oliver Smith 1cc397205d jobs/ttcn3: add KERNEL_* parameters
Make it possible to run the jenkins job with a different kernel
repository, by exposing KERNEL_URL, KERNEL_REMOTE_NAME and
KERNEL_BRANCH.

Related: OS#3208
Change-Id: I5d4202a67a24d9c15a5b211fa29ce9d5b5a9d9c1
2021-03-01 12:54:55 +00:00
Oliver Smith 718448606f jobs/ttcn3: rename ttcn3-ggsn-test-kernel-net-next
Change the name of the job to ttcn3-ggsn-test-kernel-git. A follow-up
patch will add parameters to the jenkins job to specify a different
repository than net-next, therefore the generic name makes more sense.

Related: OS#3208
Change-Id: I409f49f88f0a75c782dd3c90c5051e8287644138
2021-03-01 12:54:55 +00:00
Oliver Smith bce53ba7d0 jobs/ttcn3: add osmo-ggsn kernel tests
Run osmo-ggsn ttcn3 tests against the gtp kernel module from the debian
kernel and from HEAD of the linux netdev/net-next git repository.

Depends: docker-playground I1f337af1e2de6db05b22636bc31a535404235559
Related: OS#3208
Change-Id: I4c496af78820d95549da22c1271bafe911f7eefb
2021-02-26 16:49:07 +01:00
Oliver Smith 4521517d1f jobs/ttcn3: tweak shell cmd
Move 'cd' and './jenkins.sh' commands towards the end, so they are not
repeated in the case block of each pattern. This is in preparation for
the ggsn kernel mod test, which will need new patterns.

Related: OS#3208
Change-Id: I0fac24b961b1abb09317144ec2f65d4e21eb70c2
2021-02-26 16:14:12 +01:00
Oliver Smith 0001acdde8 jobs/ttcn3: add wipe_workspace to job template
Prepare for the ggsn kernel module test, where we don't want to wipe the
workspace with the cloned linux git tree.

Related: OS#3208
Change-Id: Ic5843513c376d2b78be8ab90b21a747d31a827f1
2021-02-26 12:57:23 +01:00
Harald Welte 89bf3592c2 ttcn3-testsuites: Enable testing of osmo-cbc "latest"
We do have "latest" packages, so we can start testing it

Change-Id: I9f8fb03d9a02da7174bc1aa2aef412e7dbc0724e
2021-02-23 20:26:45 +01:00
Harald Welte 17f23faf37 jobs: Fix names of commented-out SMLC test containers
This was a copy-+paste introduced in Ib1f374974444cdd5d829c4e57153137ecd9149f1

Change-Id: I8b315e2df34ccd9db78173ee6e83b4d8ec85e8bf
2021-02-22 14:13:13 +00:00
Harald Welte cf95a6f39c ttcn3-testsuites: Add osmo-cbc tests
Change-Id: I29eb72570d1f80c0f690878597c03afad5bb7b10
2021-02-22 14:12:49 +00:00
Oliver Smith e99cb64e2e jobs/registry-triggers: add for osmo-ttcn3-hacks
Trigger registry-rebuild-upload-titan on changes in
osmo-ttcn3-hacks.git. Write registry-triggers.yml with a job template,
so we could add more triggers from git repos -> registry easily if
needed in the future.

Related: OS#5017
Change-Id: Ib6a27be6351ce821c7023a1f75a82b1ade2ffa49
2021-02-11 18:03:38 +00:00
Oliver Smith 7433811c62 jobs/registry-rebuild-upload-titan: new job
Trigger for this job will be added in follow-up patch.

Related: OS#5017
Change-Id: I2c4b264abf760894edb0788054fd987f9346b6ec
2021-02-11 18:03:38 +00:00
Oliver Smith 9bfdbd13e8 jobs/registry-update-base-images: fix typos
Change-Id: Ifc6c85e638818113182802841c3e0e4a7e6cfda8
2021-02-11 15:50:32 +00:00
Oliver Smith 2b22fa2f5a jobs/master-builds: libosmocore: add triggers
Add missing triggers for osmo-gbproxy, osmo-trx.

Related: OS#4992
Change-Id: I1bc590cc9560b1780cccd99f7ca86700bd9a6ad9
2021-02-11 12:28:24 +01:00
Oliver Smith ae46ae9fc2 repo-install-test: add label for relevant nodes
Add the slave axis again, so the jobs aren't stuck forever. I had
assumed that without the axis, it would run on any node, but that's not
how it works. Add a label for this job, with several nodes attached,
like we do it for TTCN-3, master-builds, gerrit-verifications etc.

Related: https://jenkins.osmocom.org/jenkins/label/repo-install-test/
Related: OS#4567
Fixes: fcf669 ("repo-install-test: run on all build slaves again")
Change-Id: I276ab47f76a0f4db542ca99825ebb019236b4d27
2021-02-10 13:02:59 +01:00
Oliver Smith fcf6699f56 repo-install-test: run on all build slaves again
It was not possible to reproduce the weird rpm errors on
admin2-deb9build, which had lead to limiting the build slaves to
build2-deb9build-ansible. Enable building on all again.

Closes: OS#4567
Change-Id: I82ef1f0c581de8ee826adedd9ecde6b4adaa36ba
2021-02-08 11:42:28 +01:00
Harald Welte 2933da3810 master + gerrit jenkins jobs: Add osmo-gbproxy
osmo-gbproxy is moving to its own reporitory

Change-Id: Id29c83bdcd9b626bb7920738c8b1f945ef7f3671
2021-02-03 08:38:06 +00:00
Oliver Smith 00b7181760 repo-install-test: add 'debian10'
Related: OS#4969
Depends: docker-playground I7addb30aa3f8564dcbdc3f6cf2e2e0cfdf4dd02d
Change-Id: If0fc12464b571dc42b33f2a077c77ea6e5120b8d
2021-01-25 10:31:11 +01:00
Oliver Smith 137d39c764 repo-install-test: rename 'debian' to 'debian9'
Related: OS#4969
Depends: docker-playground I2ea18997019ebaa013c258996f5131386bcd6426
Change-Id: Iaa2202cca4072b4dc0309e011aba6cb33ed5b8aa
2021-01-25 10:28:16 +01:00
Oliver Smith 867b6de117 jobs/repo-install-test: run a few hours later
Give OBS more time to build the repository, before verifying that we can
install all packages from the repository. Apparently, OBS publishes the
repository in WIP state, before all packages for a distribution have
been built.

This leads to problems in the "nightly" and "next" repositories. In
contrary to "latest", we do not bump soname versions when doing ABI
changes, so we require the user to have all installed Osmocom packages
built from the same timestamp. With recent changes in the OBS scripts,
we enforce this by having all packages built from the same timestamp
depend on the exact version of a dummy package with that timestamp as
version.

The repo-install-test installs all packages from the binary repository,
and so it fails, as it should, if the repository is in an inconsistent
state with some packages built today and some packages built yesterday.

Related: OS#4733
Change-Id: I8df9b449d6213b5dca6fd9bf5c06b5c96d468f66
2021-01-21 10:44:59 +01:00
Oliver Smith 48c966a305 Cosmetic: jobs/obs: update repo-install-test name
Change-Id: Ic5712173ec79d286fb3591364636a38f6af74503
2021-01-21 10:30:05 +01:00
Oliver Smith 9dadec3209 jobs: remove duplicate docker_run
docker_run was duplicated for osmo-e1-hardware and no2bootloader, so the
'-e PATH' line could be removed from the global docker_run. It was
overriding the PATH, which then did not contain the path to the compiler
toolchain anymore.

This workaround is not needed anymore since de5aa17d6 ('jobs: don't
overwrite PATH in "docker run"').

Related: OS#4911
Change-Id: I97a4add17d9fa1bd28ab0ceb054b9a8d948b6f86
2021-01-13 12:40:18 +01:00
Oliver Smith 212e43fa1c jobs: update OSMO_GSM_MANUALS_DIR
Use new location inside / outside docker, where the repository was
cloned already. So it does not need to be cloned during the job.

Roll out: make sure that the docker images are already built! (or let me
merge it)

Related: OS#4912
Depends: docker-playground Id402e0ea372b5ca8a6c8f6f5beb190544c888207
Change-Id: Ibe91a613162687589e006cba99193606fb8a3eb9
2021-01-13 12:40:18 +01:00
Oliver Smith 5150f0ec62 jobs/osmo-gsm-manuals-trigger: new job
On change, roll out osmo-gsm-manuals to relevant build environments.

Related: OS#4912
Change-Id: I104525826068b016b5e06ea52567da4d7beaf7a4
2021-01-13 12:38:12 +01:00
Oliver Smith 24a5609f30 jobs: add missing OSMO_GSM_MANUALS_DIR
Add the variable to projects that don't use docker at all or overwrite
docker_run instead of using the global variable that has
OSMO_GSM_MANUALS_DIR defined.

Related: OS#4912
Change-Id: I65102655b4b3e907a0b0de8026f8f9af76281f90
2021-01-12 13:54:55 +01:00
Oliver Smith de5aa17d6d jobs: don't overwrite PATH in "docker run"
Don't mount $HOME/bin to /build_bin, and don't overwrite PATH to include
/build_bin anymore. This isn't needed because the scripts are installed
to /usr/local/bin inside the docker images now.

Depends: docker-playground I0820f13cd740f7d4a8999d279cef6ae293a67d81
Related: OS#4911
Change-Id: I45bd7ea56849dab839a98cfd52806f7cd288094e
2021-01-12 09:15:45 +01:00
Oliver Smith 4cbc445616 osmo-build-dep.sh: don't build osmo-gsm-manuals
Save time by only cloning the repository, and not running autoreconf
-fi, ./configure, make and make install. Especially the tests during
make took up significant time, that slowed every project depending on
osmo-gsm-manuals down while being built through master-builds or
gerrit-verifications jobs. Set OSMO_GSM_MANUALS_DIR to the clone
location.

This is an interim measure, I'll submit more patches soon that remove
the 'osmo-build-dep.sh osmo-gsm-manuals' calls from all projects.

Change-Id: I5238cf3f93ded97ed2b44d27868123a646e122dc
Related: OS#4912
2021-01-12 09:14:38 +01:00
Daniel Willmann e7b1594497 Add timeout to gerrit verifications
Gerrit verification jobs sometimes hang (usually during the VTY tests).
At some point we should just time out, default is 30 minutes

Change-Id: I6fc6ee976f2d88efdab1582a418d1adcd384c850
2021-01-04 18:40:18 +01:00
Pau Espin Pedrol d386689e57 jobs: ogt: Update default suite for osmo-gsm-tester_virtual job
Since osmo-nitb is deprecated, the test was moved to use the "new" split
stack.

Change-Id: I6cc47f7a748339de406c1216c718a0d0042955d4
2020-12-21 18:38:55 +01:00
Harald Welte 09891fbb95 Add master-no2firmware build job
This is the DFU bootloader we use in icE1usb and e1-tracer.

Change-Id: Iaedb4e8f487c11b0247c27cba403fe2dfcd6b708
2020-12-19 11:20:16 +01:00
Harald Welte cbce526b0f Add master + gerrit job for osmo-e1-hardware
Change-Id: I02295e157f909bca985c1919a7828da0554ee1ef
2020-12-17 18:48:28 +01:00
Harald Welte 660d7ba7c7 add registry-rebuild-upload-fpga-build.yml
This will rune once per week and make sure that registry.osmocom.org
has a fpga-build container that the buld slaves can use.

Change-Id: Ie700d7c6e3c5e794edd81c3acc4b689e05d6864d
2020-12-17 15:54:41 +01:00
Harald Welte b4e042736c update-osmo-ci-on-slaves: Add build slaves on gtplab0
Change-Id: I555cb26be138e2969d07ad561fe8eba8994f2429
2020-12-17 13:50:04 +01:00
Harald Welte bfccd70721 jobs: Add ttcn3-gbproxy-test-fr for Frame Relay testing
this job can only run on a specific type of buildslave: A system
with Linux kernel HDLC support.

Change-Id: Id440c70a8f21583bce109366f44cdc22e0ca1ae8
2020-12-17 12:32:10 +01:00
Pau Espin Pedrol e935398ae9 jobs: repo-install-test: Use centos8 as distro name
We use centos8 instead of centos in all docker-playground.git setups and
the infrastructure there expects that kind of naming.

Related: OS#4888
Change-Id: Idfbb2c4fc1ca10741406c8ab8930dabe8ce632ee
2020-12-07 12:54:17 +01:00
Harald Welte 1f5faf85bd remove all debian8 slaves
we cannot even create new slaves as lxc-create doesn't support debian
jessie anymore.  Let's focus on Debian 9 + Debian 10

Change-Id: I2fddd460f7d1db755cc9b732b2be80494d26e091
2020-11-15 10:01:03 +01:00
Harald Welte f8b9737728 jobs: master + gerrit: Mark them as running on debian9. not debian8
We actually do the verification inside a (debian 9) docker container anyway,
so there's no need to run those on the old debian8 slaves.

Change-Id: I2168bd2f0e6221518ece111e29dc604c33eaca6a
2020-11-14 23:24:36 +01:00
Vadim Yanitskiy 905a1e6fc8 jobs/master-builds.yml: enable manuals for all osmo-bts variants
Since Idba84164b90e3d183a20b5eb69cbfe15745e447c, we started to
generate separate PDFs for different osmo-bts-variants, so
let's enable them all.  Otherwise only osmo-bts-{virtual,sysmo}
PDFs are generated and uploaded to the server.

Change-Id: I517be2d475f57026dab7f001d2298cf1a1aa2c7c
Related: SYS#4937
2020-11-06 21:52:38 +07:00
Daniel Willmann 5806d0a63f jjb: Add ttcn3-gbproxy-test to ttcn3-testsuites.yml
Fixes: OS#4850
Change-Id: I05d1855a6daea6a67df01a1f9fa65955cfd72661
2020-11-05 18:54:37 +01:00
Harald Welte 262f164fb2 Add jenkins job to update docker base images on registry.osmocom.org
Change-Id: Iec2d2e3a43b074cb60f75cbe852351ffa8e0009e
Related: OS#4839
2020-11-04 19:30:57 +00:00
Harald Welte 7685f9c349 ttcn3-testsuites: Set REGISTRY_HOST="registry.osmocom.org"
This will make the Dockerfiles from docker-playground.git
use registry.osmocom.org rather than the public docker.io for base
distribution images like debian:stretch or the like.

This will avoid any strange timeout/EOF problems while doing
docker build --pull in our test jobs.

Change-Id: If4275cf3c8a5b70a67d742950a35ae8ead59a52e
Closes: OS#4839
2020-11-02 16:57:06 +00:00
Pau Espin 57a38c7daf jjb: obs: Trigger jobs at sme point during 00H instead of 01H
There's no real need to wait until 01:00, let's try to get packages
built before.

Change-Id: I9db7108ecaab418f9b657d30c02622c56dc04798
2020-10-22 06:11:42 +00:00
Pau Espin c5ebc06b74 jjb: ttcn3-testsuites: Spread all test grouped around the day
Before this patch, only the debian+master jobs were spread around
several hours, while debian+latest and centos+nightly were all triggered
at midnight.
Let's instead run all flavours of teh same test (debian+nightly/latest,
centos) around same time but not concurrently by marking blocking one
each other so that they are run one after the other. Then, each group is
separated by a given time spreading the load over the night + morning.

This also means we no longer start tests at 00:00, which means docker
images will use software from the day after, since the nightly
repositories are built around 01:00.

Related: SYS#5121
Change-Id: Ib1f374974444cdd5d829c4e57153137ecd9149f1
2020-10-22 06:11:42 +00:00
Neels Hofmeyr 2dc35de85b jenkins: add osmo-smlc to coverity and ttcn3 jobs
Change-Id: I690962cd8352e255a2bf0ae16aa8ddda68edf10a
2020-10-21 00:55:59 +02:00
Pau Espin cf17475839 jobs: Enable --without-sse build variant for osmo-trx
Change-Id: I47a2067dc25335557dfa93f291f6ca9cd4959735
2020-09-18 21:15:10 +02:00
Harald Welte 53e344d574 jenkins: add master + gerrit for osmo-smlc
Change-Id: Iaeb064ed8e7d08db305f1928dc26d16dc6c889dd
2020-08-21 20:17:49 +02:00
Pau Espin 2fa9daba67 jobs: osmo-gsm-tester: Run mass LU and ttcn3 BTS tests nightly
Before they were executed almost in a loop, so let's simply run them
once per day.

Change-Id: Ie42fc1e686d29740e14aaacd69659fe09e66801a
2020-06-09 14:26:38 +02:00
Pau Espin d30d252bf4 jobs: osmo-gsm-tester_ttcn3: Fix path to jenkins script
There was a directry refactoring a few weeks ago in osmo-gsm-tester and
this path was not updated correctly.

Change-Id: I580cd9d4a602b3ed1839fb0990ac3816c5e42cbe
2020-06-09 14:10:46 +02:00
Oliver Smith e49412c8a9 jobs/ttcn3-testsuites.yml: support centos8
Related: OS#4564
Change-Id: I195437ffe8a8b6cb54de867d6f809c71e8f47ef1
2020-05-30 09:33:17 +02:00
Oliver Smith 504f23d82f jobs/osmocom-obs.yml: create Osmocom_OBS_next job
Change-Id: I50dca459d19dca5894b71169ae70a6c6778b2e52
2020-05-28 10:01:23 +00:00
Oliver Smith 1d0b144ad4 repo-install-test: update jenkins job
Rename osmocom-debian-install.yml to repo-install-test.yml to get debian
out of the name. Extend it with a new distro parameter and update the
description. Adjust the shell section to run the script from its new
location (in osmo-ci.git, not docker-playground.git). Turn it into a
matrix job, so we can have two parameters (distro, feed) for each job.

Related: OS#4563
Change-Id: I777098f19d75f7efbd68b837ccdcd83309429c39
2020-05-28 09:53:22 +00:00
Pau Espin 71cc851e35 osmo-gsm-tester: Point config parameter to file instead of its dirname
Since osmo-gsm-tester.git Change-Id Ieca65b71b543c44cfcec8e83efd0fe053c432e55,
the -c parameter holds the config file and not the directory where it is contained.

Change-Id: I9aca57c4dd3180367eb17ec92177b90a9c411a6a
2020-05-11 18:50:11 +02:00
Pau Espin 03b6049534 jobs: osmo-gsm-tester: Drop use of OSMO_GSM_TESTER_CONF for default conf dir
As of osmo-gsm-tester.git Change-Id
I7eb69f870d0dcb5906d45ae067d6bed1aabf5862, jenkins-run.sh script uses
the sysmocom value by default, so let's avoid setting it to simplify
stuff.

Change-Id: I8edfb93d53376930f60e0bd8d36a82ec6c11ed85
2020-05-07 19:16:15 +02:00
Harald Welte 512e6bc46d jenkins: Add master+gerrit job for osmo-el2tpd
Change-Id: I220741236c85ab7e25593b7dfadafaeb786ee503
2020-05-03 21:32:09 +02:00
Harald Welte 933f866eff jenkins: add osmo-uecups to gerrit+master
Change-Id: I3ca141edcd61ae4126fa28f6560c99a1f568dec7
2020-04-17 15:18:40 +02:00
Pau Espin f6dec4217e jobs: osmo-gsm-tester: Update path to sysmocom's specific setup
Since osmo-gsm-tester.git I364e0859c0851b9167907a4d948b659a0f6a19fb the
example/ directory has been renamed to sysmocom/

Change-Id: I4c7516d2eb9636d37391a81dc9d484c0c04d7191
2020-04-10 18:38:05 +02:00
Pau Espin 94a0a917be job: Update master and gerrit osmo-pcu jobs to also build on ARM platform
Related: OS#4301
Change-Id: I8109cc9a71e6c14304ed6463f9b073ef3f4f3c2a
2020-03-16 10:30:26 +00:00
Pau Espin 3e0d3e36c0 ansible: Use osmo-gsm-tester docker image in jenkins job osmo-gsm-tester_virtual
Let's use the osmo-gsm-tester docker image based on the
debian-stretch-jenkins instead of the later directly, since the former
has all osmo-gsm-tester required dependencies.

Change-Id: I256eeed82eef0969d93dc015e043b0417f56f52c
2020-03-12 16:06:05 +01:00
Pau Espin 9184c87ad8 jobs: update-osmo-python-on-slaves: osmo-python not required in simtester node
Change-Id: Ia3728cf9296eab8db49274e4da64249e497726d1
2020-03-03 12:21:29 +01:00
Pau Espin 6464e7c4c3 jobs: jenkins simtest node is named simtester
simtest node doesn't exist, it's called simtester.

Fixes: 3935743127
Change-Id: Id703a85298b163e7e95bb89f6a69ab51e29effb4
2020-03-03 12:01:35 +01:00
Harald Welte bee8f383e1 add build2-deb10build-ansible build slave
This is our first Debian 10 build slave

Change-Id: Iae80c5f73781d14ffbf124a476894d4631c83dc7
2020-02-26 13:47:20 +00:00
Vadim Yanitskiy 3935743127 jobs: add 'simtest' to the list of to be updated slaves
Change-Id: I0cc6188aab10ecb8b862710d272c411e47a21f61
2020-02-26 18:05:50 +07:00
Pau Espin 5eabf8bcb1 jobs: Run update-osmo-{ci,python}-on-slaves on rpi4-deb9build-ansible
Change-Id: I96067ffc0061a85bcc46569b1bf38eade3b8d995
2020-02-26 10:50:50 +01:00
Pau Espin 3e0db88e34 job: master-buids.yml: Drop specific scm and poll branch for master-osmo-pcu
Change-Id: I12f0c5c83786feba0aef74143fab3a836e83cd9d
2020-02-26 08:39:58 +00:00
Pau Espin cf36253aea job: Update master and gerrit osmo-bts jobs to also build on ARM platform
Related: OS#4301
Change-Id: I72e228ff1a126f6c41c5fd6a530de85e177a0d21
2020-02-26 08:39:27 +00:00
Pau Espin 4f98ae06a3 job: Update master and gerrit osmo-trx jobs to also build on ARM platform
Related: OS#4301
Change-Id: I0049ab35b5106d5af8474903e203f66b044ff5ca
2020-02-26 08:39:27 +00:00
Pau Espin 5f4e887c5f jobs: Introduce osmo-gsm-tester_build-srslte
Change-Id: I08a59c6065ca4fb6fbbed5b12e73abf4024f1dcb
2020-01-29 19:38:19 +01:00
Pau Espin e0f4129b63 ttcn3-testsuites.yml: Add job for ttcn3-sccp-test
Only for nightly, not latest, since example/sccp_demo_user is not
installed by autotools and debian packages, so only in nightly where we
build from source we are able to copy it to docker image manually.

Related: OS#4343
Change-Id: Ia0a68d74215bdc1bc6319241d60f858312fa14e9
2020-01-17 18:13:47 +01:00
Oliver Smith fb3dc0b775 gerrit-verifications: fix erlang/osmo_ss7 name
Fixes: aadc60f403 ("jobs/gerrit-verifications.yml: add erlang repos")
Related: OS#4345
Change-Id: Id78f7e62e12c7595329ef8a265e522f27a087604
2020-01-17 16:21:44 +01:00
Oliver Smith 2c13d633ec gerrit-verification: fix erlang cmd
Jenkins job builder only does one pass of variable substitution. Replace
the cmd_erlang variable with its contents, so the jobs don't fail with:

[osmocom-gerrit-debian9] $ /bin/sh -xe /tmp/jenkins7189809471369692535.sh
+ {docker_run} {docker_img_erlang} /build/contrib/jenkins.sh
/tmp/jenkins7189809471369692535.sh: 2: /tmp/jenkins7189809471369692535.sh: {docker_run}: not found

Fixes: aadc60f403 ("jobs/gerrit-verifications.yml: add erlang repos")
Related: OS#4345
Change-Id: I6e121c79ecf872a7058de3a6dc0a940fa8091f68
2020-01-17 15:03:08 +00:00
Oliver Smith 5434eb477f osmocom-release-tarballs: publish with rsync
Related: OS#3870
Change-Id: I5f88ae0c483ed03c42c47d1cd207ac2722cfa083
2020-01-17 15:52:16 +01:00
Oliver Smith aadc60f403 jobs/gerrit-verifications.yml: add erlang repos
Run contrib/jenkins.sh in erlang repositories, that were recently
updated (osmo_gsup, osmo_dia2gsup, osmo_ss7).

Depends: docker-playground Ia3eaec6090c9652549b2850de74ee21730374bbd
Related: OS#4345
Change-Id: I05d152de6b7a04dee935d79b9987c511351eca95
2020-01-15 10:26:23 +01:00
Oliver Smith b79e06367b docker: move to docker-playground.git
Instead of building "osmocom:deb9_amd64" from this repository, build
"$USER/debian-stretch-jenkins" from docker-playground.git (same
Dockerfile). Adjust all jobs to use the new image name.

Add a new "update-osmo-ci-on-slaves-dp" jenkins job, which triggers
the existing "update-osmo-ci-on-slaves" job whenever
docker-playground.git changes.

Replace docker/rebuild_osmocom_jenkins_image.sh with
scripts/osmo-ci-docker-rebuild.sh, so we can get rid of the docker dir.
I thought about dropping the script completely, and directly writing the
two lines into contrib/jenkins.sh. But I kept the extra script for
convenience, when testing locally.

Related: OS#4345
Depends: docker-playground I125ae8a6bcabbd1f485028c79b0abacda0622c3a
Change-Id: I30a61aebcadef5536e74edd35e1c75ef77a2da9f
2020-01-15 10:24:38 +01:00
Oliver Smith 51e91cd9bb gerrit-verifications: introduce "gerrit_url" var
Prepare for erlang repositories, which will use this variable.

Related: OS#4345
Change-Id: Ia91764797745b48ae832cfbc16976e561b288a50
2020-01-14 14:47:53 +01:00
Oliver Smith c31ee44bd8 jobs/update-osmo-ci-on-slaves: origin/master only
Don't run, when different branches were pushed.

Change-Id: I2cf55391066b60cf6a594f528ed0eaf59a886391
2020-01-08 15:04:25 +01:00
Harald Welte 0bc2af048b master-builds: add osmo-{cbc,e1d,e1-recorder}
Change-Id: Idfede8e9e79019b67b9aff4881d5cea97514aeba
2019-12-04 12:32:15 +01:00
Harald Welte 71c642a0a5 add gerrit-verifications for osmo-e1-recorder and osmo-cbc
Change-Id: I1df28b4e7a7cbcf9151cd57a77001d88f1875415
2019-12-04 11:06:05 +00:00
Oliver Smith 02bb4049ba Cosmetic: gerrit/master jobs: link to wiki
Place a link to the wiki page, that now documents all available
environment variables.

Related: OS#4243
Change-Id: I770360b671c64369cf6cdb4fb4222921cc6af58e
2019-12-04 10:52:21 +01:00
Oliver Smith 13eaaa3644 jobs/master-builds.yml: fix osmo-fl2k
Don't use the old "osmocom:amd64" image. Remove the entire cmd line, so
it uses the default docker command with the default docker image
"osmocom:deb9_amd64". Also remove concurrent: true, because that default
nowadays too.

Related: OS#3203
Change-Id: I93db12d3652f26db059e0ede52d2b2fdd3e89d34
2019-12-02 09:54:56 +01:00
Oliver Smith f8d85c9f18 jobs/master-builds.yml: add osmo-fl2k
Related: OS#3203
Depends: https://lists.osmocom.org/pipermail/osmocom-sdr/2019-July/001951.html
Change-Id: Iac411a5d5e312b8db0b5388f58571141fb2f32df
2019-12-01 10:40:16 +00:00
Harald Welte 45ce0417d4 add '--publish' to osmo-asf4-dfu and osmo-ccid-firmware builds
Change-Id: Ie45b9fcabc35f6fd9aff33af0f0587c8ccd88ebd
2019-12-01 10:38:16 +00:00
Harald Welte 3038c19155 WIP: coverity: Make sure curl is installed, as our coverity upload job needs it
This is untested. I'm on the train and have very limited understanding
of Ansible

Change-Id: I9918b89971bf6c2e200f1d96d993d5fbd6741b71
2019-11-23 09:19:10 +01:00
Pau Espin 95d4544544 jobs: Introduce ttcn3-stp-test(-latest) jenkins job
Change-Id: I7a82e1fa82cd28433cdb7a9128c7ab3da6cabf47
2019-10-24 16:52:04 +02:00
Oliver Smith f58d2231a9 gerrit, master builds: default to concurrent: true
Now that almost everything runs in docker, we don't need to worry about
problems with running VTY/CTRL tests in parallel for these projects.

Related: OS#3726
Change-Id: I5fdf759faf47ec7e4f9cb2657bd004585a667add
2019-10-18 10:44:10 +02:00
Oliver Smith b082c969cb gerrit, master builds: build almost all in docker
Instead of building some projects in docker, and some directly on the
build slave, build almost all of them in docker with few exceptions, and
make building in docker the default.

This has several advantages:
* build environment of master builds and gerrit verifications is the
  same, therefore the same build won't pass in gerrit and then fail in
  master
* all build environments are volatile
* no more conflicts while running VTY/CTRL tests
* fix osmo-python-tests gerrit review versions being installed to
  /usr/local of build slave (see previous commit message)

Projects that still do not get built in docker:
* openggsn: depends on libgtpnl, but does not build it in jenkins.sh
* osmo-bts: l1headers, various SDKs not installed in the docker image
* osmo-trx: LimeSuite is not in the docker image (and just installing the
            debian package does not work)
* osmo-ttcn3-hacks: TTCN-3 not installed in docker image
* pysim: needs to access real sim cards attached to the host
* sysmo-usim-tool: needs to access real sim cards attached to the host

Related: OS#3726, OS#3598
Change-Id: If4b7d2f9ffbc7e92699732d97a8f5829a88c5b35
2019-10-18 08:38:58 +00:00
Pau Espin 4743f82b4c jobs/master-builds.yml: Set node for master axis job
Otherwise the master job managing the axis can be run on any node,
something which is not desirable. For instance, right now job
master-osmo-ggsn is run on osmo-gsm-tester-rnd which is currently unable
to fetch some git repositories.
Let's avoid running master tests on unintended nodes.

Change-Id: I62abb3c490588adc4c0e13c761de44d442f8cefe
2019-10-15 12:37:14 +02:00
Oliver Smith a8153577fe gerrit, master builds: use stretch, not jessie
Debian jessie (8) is EOL already, so switch to stretch (9). This is
required to build all Osmocom projects in docker, because at least
libosmocore fails to build with the old image (tests won't build with
GCC-4.9.x from jessie unless -Werror is disabled).

Do not build the jessie image anymore, and update the shared dockerfile.
Remove everything jessie specific, and make it work with stretch by
installing asciidoc-dblatex. Otherwise we get this error when building
manuals:

a2x: ERROR: missing configuration file: /etc/asciidoc/dblatex/asciidoc-dblatex.xsl

Add '--cap-add SYS_PTRACE' argument to the docker run command, because
otherwise the address sanitizer isn't working anymore with stretch
(which makes the OsmoPCU tests fail).

I've tried to split this patch up into multiple ones, but since there is
no asciidoc-dblatex package in jessie, we must add the dependency and
switch the image at the same time.

Related: OS#3726
Change-Id: I61fe93863d5367e3b9c01ab4726bb95bd16d891d
2019-09-24 08:04:53 +02:00
Oliver Smith a5fb5484ae gerrit, master builds: add docker_{run,img} vars
Move the common "docker run" invocation and image name into one place,
so it is not duplicated over and over. This prepares for changing the
image and building all Osmocom projects in docker (follow up patches).

Related: OS#3726
Change-Id: If529e6a93bb2227230981ee22f2c75bd0f1f4518
2019-09-23 14:08:59 +02:00
Oliver Smith 5ca12a8359 gerrit, master builds: concurrent OsmoPCU builds
Re-enable concurrent builds for OsmoPCU, and run all builds in
docker. This should prevent previous problems with VTY/CTRL test
collisions, which lead to the concurrent builds being disabled
in I23d5b75825a667e4f043d16a12b841cd8f01af5e.

Related: OS#4204
Change-Id: I4f90a601e41dca18a6fcbab56bdf5663167d2353
2019-09-19 10:48:18 +02:00
Harald Welte d3a5d51e47 jenkins-jobs: Add ttcn3-remsim-test for {master,latest]
Change-Id: Ib4e3f3f0153c38765868cfd2014cd56cd47c2c79
2019-09-13 14:02:17 +02:00
Oliver Smith 3d510e87a4 gerrit-verifications: fix osmo-bts cmd
Fixes: 932b003750 ("gerrit, master builds: use ASCIIDOC_WARNINGS_CHECK")
Change-Id: Ia17d6a14ede93bae715fb67826b074ab91f87749
2019-08-23 12:27:39 +02:00
Oliver Smith 932b003750 gerrit, master builds: use ASCIIDOC_WARNINGS_CHECK
The asciidoc warnings check fails the build if asciidoc prints a warning
while building the documentation. We had this enabled by default, but
since OBS uses various asciidoc versions, we could get unexpected build
failures (different asciidoc versions print different warnings).

Now that it is disabled by default, explicitly enable it for jenkins
again.

Related: OS#4140
Depends: Iac993a0d1b17205397a1f1ef1a7bd3f9df739e36 (osmo-gsm-manuals)
Change-Id: I8775d45b4dc1a5a46e2ba042fc7ee7d9f10f18cc
2019-08-21 11:46:24 +00:00
Daniel Willmann 84e2ce3d6e master-builds: Publish osmo-hnbgw documentation
Requires: Ic7437daeab0b07d16fd71ca3881cb31bab7b1925 (osmo-iuh)
Change-Id: Ia1be4ef79a1089d7af582acb63eb3afa5a60f4f3
2019-07-30 16:14:23 +02:00
Oliver Smith ef81fd660a jobs: upload to OBS before debian-install test
Make sure that we don't test yesterday's packages. Adjust timers to run
the OBS job around 1 o'clock, and the debian-install test around 4
o'clock. Use the H (hash) symbol for minute to spread the load.

Change-Id: I503058018172d50e9585d4804dfec1b4ece7644a
2019-07-26 08:55:21 +02:00
Oliver Smith b86cf865c1 osmocom-debian-install.yml: add BRANCH variable
Allow changing the branch in the jenkins UI when starting the build.
We already have this in other jobs, and it is very useful to test
changes.

Change-Id: Ice4662551625b3c96ca105629a934a0a081db2e4
2019-07-23 12:14:26 +00:00
Oliver Smith 6550682ee0 osmocom-debian-install.yml: update description
Replace "Generated by job-builder" with a proper description. The job
builder automatically adds "<!-- Managed by Jenkins Job Builder -->" to
the description (which is visible when editing the job), so we don't
need to mention it in the description at all.

Related: OS#3369
Change-Id: I17d2e9e0ac7fe77fb0306724a1f1e15641d76854
2019-07-23 12:14:26 +00:00
Oliver Smith 4e2b2bc8a5 gerrit-verifications: add libtelnet
Related: OS#3047
Change-Id: Iafffd9d938ee310bb729b3e2a0a4d80870d4b3b5
2019-07-11 11:06:05 +02:00
Oliver Smith cbc11dc112 jobs: add osmocom-release-tarballs.yml
Related: OS#3870
Depends: I991fe41a1f55ccd6a66815ec3d7f239850397d9a (docker-playground)
Change-Id: I994da5c27f9198e5bcf2d567dd473f9ed078d9c0
2019-07-02 13:27:44 +02:00
Oliver Smith 85163cd7f4 jobs/osmocom-obs.yml: set default git branch
I was quite surprised, that the job used "osmith/pdfs-in-doc-subpackage"
instead of "master" today [1]. Fix this randomness by adding a branch
parameter that defaults to "master".

Interestingly, we have to set the default branch to
"refs/remotes/origin/master". When using "*/master" (like we do in other
jobs), Jenkins would still chose my branch over "origin/master", even
though mine does not have "master" in the name. I have also tried
"chosing-strategy: 'default'", in case it was using the gerrit strategy
for some reason (like in [2]), and setting 'refspec:', but both did not
have any effect.

[1] https://jenkins.osmocom.org/jenkins/job/Osmocom_OBS_nightly/98/
[2] https://issues.jenkins-ci.org/browse/JENKINS-26981

Change-Id: I6d1f0e70d5c82ffd551d00ffdf2712cbfaec16cf
2019-05-23 13:08:19 +02:00
Harald Welte a72c87cba2 Add osmo-e1d to gerrit-verifications.yml
Change-Id: I78cfd6052aebbe8cfa215928906f18f8afe3c06a
2019-05-11 21:08:47 +02:00
Oliver Smith 3f9776c9eb OBS: add links to job description
Add the links that the obsolete Osmocom_nightly_packages job has, before
we remove it. Also link to the binary packages wiki page.

Change-Id: Idbc7ccd0156d9c3eb6d30059384686849a36f49f
2019-04-30 08:19:01 +00:00
Oliver Smith 61b9e76cb1 jobs: use "cmd: |", not "# keep first line ..."
Adjust README.adoc to mention "cmd: |" instead of the workaround and
replace this:
  cmd: >
   # keep first line with less indent to preserve newlines
    docker run ...

With that:
  cmd: |
    docker run ...

Change-Id: I65a06acb76e5d693aa187f9ac38970b73e7fead6
2019-04-17 15:35:27 +00:00
Daniel Willmann aaa472a7a4 Add bscnat tests to jenkins
This requires Change-ID I800ebe0f33cf7c86eea65d2e186c6af12fee6db7 from
osmo-ttcn3-hacks.

Fixes: OS#3179
Change-Id: Idee5a986e4cda8db601982ac3f2662bc20fe3f5f
2019-03-28 17:31:30 +01:00
Daniel Willmann d0229770d8 ttcn3: Order tests by time triggered
We had some load issues with many things running at once on jenkins.
This will at least make it easier from having colliding ttcn3 jobs.

I also changed ttcn3-sip-test to run at 7:30 instead of 7:00 where
ttcn3-bts-test runs.

Change-Id: I65f346a3fae2811c8314c26d4a5b3a528b8101f9
2019-03-28 13:38:48 +01:00
Daniel Willmann 627bf3dd2f Avoid '/' in jenkins matrix labels
The script already deals with this for osmo-bts by using the
version_prefix variable

Change-Id: I3102fc607718ca42634273e24e6ff303dc28483f
2019-03-27 18:36:22 +01:00
Daniel Willmann 53fabad926 Also build oc2g support for osmo-pcu
Needs gerrit change I7cd89a549c9463e81893ca7dd925299f728e4453 in
osmo-pcu

Fixes: SYS#4524
Change-Id: Iebddf8d41538fe1e69435cda7f77bd49c4c14477
2019-03-27 18:36:20 +01:00
Oliver Smith d3d3eb0fb1 jobs: add osmocom-build-tags-against-master.yml
Run osmocom-build-old-tags-against-master.sh every night in jenkins.

Related: OS#3765
Change-Id: I9868a6008f61fb3962279f72d34f67f900425be5
2019-03-26 15:54:46 +01:00
Oliver Smith 60a4fb2062 jobs: add osmocom-list-commits.yml
Related: OS#3840
Change-Id: I9a65cb750bbe6c278b9f67eb70bdb36759cb775b
2019-03-20 11:41:28 +01:00
Harald Welte cb944d35f3 ttcn3-testsuites: Split ttcn3-pcu-test-sns from ttcn3-pcu-test
The SNS variant of the tests require the PCU to be started with
different config file.

Change-Id: I42785b68f136198152ad79072346faccfe4a9424
2019-03-14 21:56:21 +01:00
Harald Welte b1ec95f3c7 jenkins: Send build failures to jenkins-notifications mailing list
Change-Id: I5609a0f4b8f176ffa692db732abb4694acaaf927
2019-03-03 16:04:41 +01:00
Pau Espin d7a11ab977 jobs: osmo-gsm-tester: Add oc2g jobs
Change-Id: I5ea9b783a2a2017cb134e72087e217a4184184b2
2019-02-21 18:50:40 +01:00
Holger Hans Peter Freyther e197c12f81 jobs: Introduce a tester using "virtual" tests
With mobile, virtphy, osmo-bts-virtual we can run e2e tests without
the need of any hardware. Create a dedicated job for it. This avoids
having to share resources (e.g. lock state/ip allocations) with other
builds.

Change-Id: I19993b287cc948dbdfba9d375f80a7904f96ff4a
2019-02-21 16:04:55 +00:00
Harald Welte 38ce864f63 ttcn3-testsuites: Add PCU tests
Change-Id: Ifd8113c8db2b6e84d6e01539a6df031dc6f4ee80
Closes: OS#2890
2019-02-20 22:41:44 +01:00
Holger Hans Peter Freyther 28e7e9c44a Fix copy and paste in the script.
Change-Id: I51d01a8799f09ce7d813a0ef8353a4233d5c8bb5
2019-02-15 15:34:52 +00:00
Daniel Willmann 74eade85ae jobs/osmo-bts: Build osmo-bts-oc2g as well
Build osmo-bts with support for oc2g as well. Uses origin/nrw/oc2g as
firmware.

Fixes: OS#3745
Change-Id: Iaaeb44b949cf6403601f069800c381fe5eae2f6e
2019-02-05 16:56:04 +01:00
Harald Welte 7963507fdd gerrit-verifications: Add osmo-ccid-firmware
The repository currently doesn't yet have a contrib/jenkins.sh
script, so all verifications will fail.  This is intentional,
as it will force the addition of a related script in the first merged
commit.

Change-Id: I713d345240dec319ee07d99e9381fc1af6a2d86d
2019-02-04 14:43:39 +01:00
Oliver Smith 4ae4c5403d ttcn3: block latest jobs while master is running
Jenkins job builder does not support string replacing in variables,
so the only way to make each ttcn3-foo-test-latest job get blocked by
their ttcn3-foo-test counterpart was specifying them each time.

Related: OS#3767
Change-Id: I124286d4b996e79a7b77603c7b59473b016c3bd5
2019-01-28 15:03:47 +01:00
Oliver Smith 0c11075541 ttcn3-bsc-test-sccplite-latest: enable job
This job does not get stuck anymore since the latest Osmocom release.

Change-Id: Ie87aeb52832b4ce0fbec96d2cff9dd04da0c11fc
2019-01-28 14:48:25 +01:00
Harald Welte 292aa1c872 add osmo-asf4-dfu master and gerrit jobs
Change-Id: I5bc5ca30809af8d8b472a75a9e02c4964761de38
2019-01-13 13:43:09 +01:00
Kevin Redon a6db661afb add maintainer email to simtrace project
Change-Id: Id0a6740749ea1e3d1c06396485744426b0a74f79
2019-01-12 10:25:19 +00:00
Oliver Smith fd9ae9737d master-builds: openbsc: make SSH keys available
Mount ~/.ssh in openbsc's docker container, just like it is done with
all other Osmocom projects that build in docker (see Change-Id
Icfff3b6a620de79d1bab7ff6a35309f828581c09 ("master-builds: make SSH keys
available in Docker")).

Related: OS#3385
Change-Id: Ib31ab4033c1cc71c10a96445e8bcc3b9f02e2a1f
2018-12-12 17:03:33 +01:00
Oliver Smith 6d6938fa60 Build verification: manuals for the rest
Build manuals for osmocom-bb and openbsc in gerrit-verifications.yml.
Build and publish manuals for osmocom-bb, openbsc and osmo-gsm-tester
in master-builds.yml.

Following recommendations on the ML, building manuals for
osmo-gsm-tester was not done with a new job in gerrit-verifications.yml.
It will be done with the existing osmo-gsm-tester_gerrit job (which is
generated by osmo-gsm-tester-runner.yml). No changes are necessary for
that in osmo-ci.git, see I4ebfe12a164f807b63bc897aff44db83fc0705bd
("contrib/jenkins*: build and publish manuals") in osmo-gsm-tester.git.

Related: OS#3385
Change-Id: I2845d14b656f11e3a07107b4f16e8d7a0e3c7bbf
2018-12-12 14:02:33 +01:00
Oliver Smith 298747c735 jobs/ttcn3-testsuites.yml: add build-discarder
Add the same build discarder as we have in master-builds.yml. This
should help with the disk space problems.

Change-Id: Ib7f01751ca5f6fb3e29a436982e2891d9cab0488
2018-12-05 16:50:58 +01:00
Oliver Smith d77968c3d6 gerrit-verifications/master-builds: fix errors
Fix three errors that prevented Jenkins from accepting the new
configs from Ie0643b17a6be6e86e281b50d78dd7a6858cf99ee
("gerrit-verifications/master-builds: WITH_MANUALS"):

* master-builds: fourth axis needs to be in the template or else the
  server will throw a 500 error. gerrit-verifications already has four
  template axes.
* gerrit-verifications/osmo-pcu: || at the end of combination_filter
* gerrit-verifications/osmo-sip-connector: missing ":"

Change-Id: I4ad63a3167e59b0837ffd1576fb7c7cf2958ff32
2018-12-05 14:49:18 +01:00
Oliver Smith e5e3773d52 gerrit-verifications/master-builds: WITH_MANUALS
Add WITH_MANUALS=1 to generate (and publish in case of master-builds)
PDF manuals. Jobs with multiple axes generate the manuals only in the
fastest axis.

Related: OS#3385
Change-Id: Ie0643b17a6be6e86e281b50d78dd7a6858cf99ee
2018-12-05 13:41:52 +01:00
Oliver Smith 6599da6d31 master-builds: use PUBLISH=1 instead of --publish
Pass all inputs to contrib/jenkins.sh as environment variables instead
of mixing with commandline arguments. We decided on this method instead
of I3cc01dbc57213b6d6cdc9b394a516510d045f1ae ("use jenkins.sh
--publish"), to make the contrib/jenkins.sh scripts less confusing.

Related: OS#3385
Change-Id: Ifc88af086368ce8eea1ea3a375ba7d5603a5d7e5
2018-12-04 10:39:33 +01:00
Oliver Smith bef4e9cb5d master-builds/gerrit: remove redundant GTP="$GTP"
Variables for axes are already exported as environment variables.
Change 'GTP="$GTP" ./contrib/jenkins.sh' to './contrib/jenkins.sh' to
avoid confusion when introducing other variables.

Change-Id: I9238da3dd3c4461f82dc7c792f886177399be3dc
2018-12-04 09:21:50 +00:00
Oliver Smith ce105c6aa1 osmo-mgw: don't try to build with transcoding
Do not build osmo-mgw twice anymore (once with "--enable-mgcp-transcoding" and
once with "--disable-mgcp-transcoding"). configure.ac does not know
these options.

Change-Id: I080cd331caec31c53a43090e6c19d23e31abdec6
2018-12-03 16:45:41 +01:00
Oliver Smith 6f8339b5d0 master-builds: make SSH keys available in Docker
At runtime, mount the Jenkins host's ~/.ssh folder inside the Docker
containers, from which manual PDFs will be published.

To my surprise, local testing showed that ssh is looking for the keys
in /home/build/.ssh, although the HOME variable inside the image is set
to /build, not /home/build.

Related: OS#3385
Change-Id: Icfff3b6a620de79d1bab7ff6a35309f828581c09
2018-12-03 13:39:02 +00:00
Oliver Smith 03d5f4c71c cosmetic: gerrit-verifications: format docker cmd
Format the docker command lines just like they are formatted in
master-builds.yml. Most notably, this puts every environment variable on
its own line. This makes it much easier to compare both files side by
side.

Change-Id: I0adcb028be24c2e05189c15b85811777d6287387
2018-11-30 15:15:16 +01:00
Oliver Smith ffb3fa6286 master-builds: use jenkins.sh --publish
Add --publish to the contrib/jenkins.sh calls for each Osmocom project,
where PDF manuals should be published. As this parameter is only passed
to jenkins.sh from the master-builds job, not from the
gerrit-verification job, we can add logic to upload the generated PDFs
when getting triggered because of changes in master.

Related: OS#3385
Change-Id: I3cc01dbc57213b6d6cdc9b394a516510d045f1ae
2018-11-29 16:55:59 +01:00
Pau Espin 3d69abadb8 jobs: master-builds: Disable deprecated cellmgr-ng failing to build
cellmgr-ng is out of maintenance for a long time now (13 months) and some
of its features are going to be served by osmo-stp in the future.
cellmgr-ng is unable to build against recent libosmo-sccp.

Change-Id: I0869ec932ba3b3a9d3d8521b25f677e011334315
2018-11-27 12:45:52 +01:00
Oliver Smith a31f20fbd8 jobs/master-builds.yml: don't publish manuals
Do not publish PDFs for all projects anymore, as we are moving the
manuals to each project's git repository. They will be published from
there instead (see INSTALL.txt in osmo-gsm-manuals.git).

No automatism for building and publishing the documentation of all
projects will be implemented right now, as discussed here:
https://osmocom.org/issues/3385#note-7

Related: OS#3385
Change-Id: I705e20a4f94b308c250580aa1289ee9b2967beef
2018-11-21 16:22:21 +01:00
Oliver Smith b348a83b2f ttcn3-testsuites: collect artifacts again
Collect build artifacts just like the manually created jobs did it.

Related: OS#3681
Change-Id: I5b0f5de87125374c9a48d0a47e6a4e655d7ed3bb
2018-11-06 19:23:32 +00:00
Oliver Smith 73240db74d ttcn3-testsuites: replace manually generated jobs
Let all TTCN3 related Jenkins jobs get generated by
ttcn3-testsuites.yml, overwriting the old manually generated jobs.

Related: OS#3268
Change-Id: Ib4c0949d21fcbc16c61c6ffe9d3eedea198aaf1d
2018-11-05 10:42:12 +01:00
Oliver Smith 44a3961231 jobs: ttcn3-testsuites.yml for ttcn3/nplab jobs
New JJB config, that is able to generate all jobs in the TTCN3 tab at
Jenkins: <https://jenkins.osmocom.org/jenkins/view/TTCN3/>

The new *-latest jobs test against the latest stable releases. Existing
jobs are not overwritten (this is commented out).
ttcn3-bsc-test-sccplite-latest is disabled for now, because it hangs
forever.

Related: OS#3268
Change-Id: Ie433925ee81a61c5788b4a6f2bc5b89c2689d251
2018-11-05 09:28:28 +00:00
Pau Espin 6af154e942 jobs: osmo-gsm-teser: Run only once nightly
Current entire default testsuite takes almost 7 hours to run, so let's
run it once nightly and be done with it.
This way, during office time if we want to test something on the prod
setup (due to hw only avaialble there) we can do it without having to
wait, disable the job hours in advance or having to kill all processes
and clean osmo-gsm-tester state.

Change-Id: I138bf50d6d066d2da4cd97f25880628b93ddc237
2018-10-30 16:06:11 +01:00
Harald Welte 64d1d6c3b7 gerrot-osmo-bts: Don't use unsupported '/' in labels of axis/matrix jobs
It seems jenkins cannot deal with this, so we cannot specify something
like 'origin/nrw/oc2g-next' in a label.  Let's work around by using only
oc2g-next here and expanding that to 'origin/nrw/oc2g-next' only in the
osmo-l1yer1-headers.sh script of osmo-ci.git

Change-Id: I9130a2f349f06a0b46b50665cef7188ddb08f666
2018-10-27 13:38:21 +02:00
Harald Welte c466dcfde5 gerrit-verifications.yml: Add OC2G build matrix to gerrit-osmo-bts
The gerrit-osmo-bts job is used for build verification of osmo-bts
patches.  This adds (untested) support for OC2G

Change-Id: I62a9a5ec357b7246b2d7915681c646c79eda4b76
2018-10-27 10:22:54 +00:00
Harald Welte 24f2ef00b2 Add osmo-remsim to gerrit + master build verification
... which introduces a requirement for libcsv-dev in ansible.

Change-Id: I2ac65947ce9ecc071f774dc4df0f08c99c16c632
2018-10-15 02:06:22 +02:00
Oliver Smith 6a38a191be README.adoc: use 'my_api_token' as example pass
This makes it easier to recognize that users should paste an API token
there, not their password.

Change-Id: I203c25b6638e36d3f050223dd40e56b7c4a92a12
2018-10-10 15:38:13 +02:00
Oliver Smith 6cced05c01 osmo-depcheck: don't use /tmp, better git code
* replace --gitdir with --workdir and give it a new folder structure:
  * git/$repo: downloaded source code
  * build/$repo: files created during the build process
  * install/: installation prefix
* adjust the jenkins job to use --workdir
* fetch --tags when source exists already
* readable error message for failed git checkout

Change-Id: I06589277b9d54a2af177451cfab2ca1a658b4058
Relates: OS#2642
2018-09-25 09:59:05 +00:00
Pau Espin 8768ad510a jobs: osmo-gsm-tester_run-gerrit: Update suites selected for verification
Recently in osmo-gsm-tester some suite names were changed to have better
unified naming. As a result, some of the suites used here need to
updated.

Change-Id: Iafe865ab5f607fc8acfcb3f72ebe4b0ef0f1322a
2018-09-25 08:04:18 +00:00
Pau Espin 050e29a3b0 jobs: osmo-gsm-tester: Copy osmocom-bb build artifact
This artifact is not needed nowadays to run current tests in those jobs,
since it is only used in osmo-gsm-tester_ttcn3, but it will eventually
be used once we support virtphy and/or motorola phones in usual tests,
and also because it's easier for developers to download full .tar.gz
with all at once instead of having to download osmocom-bb one separately
whn whilling to run ttcn3 testsuite locally.

Change-Id: I9fe41e2c7d9c38796ce16f2f279792bc5151b498
2018-09-25 08:04:18 +00:00
Pau Espin 4b5ab29bd1 jobs: osmo-gsm-tester: Add osmo-iuh builds
Change-Id: I7b8f51597287e7673f79c65eae2508b074151781
2018-09-25 08:04:18 +00:00
Oliver Smith 85c2effd89 osmo-depcheck: script to verify PKG_CHECK_MODULES
This script verifies that Osomcom programs really build with the
dependency versions they claim to support in configure.ac. In order to
do that, it clones the dependency repositories if they don't exist
already, and checks out the minimum version tag. This happens
recursively for their dependencies as well. See 'osmo-depcheck.py -h'
for the full usage instructions.

There's also a new jenkins job in jobs/osmocom-depcheck.yml.

Change-Id: I8f495dbe030775f66ac125e60ded95c5d7660b65
Relates: OS#2642
2018-09-20 16:28:00 +02:00
Oliver Smith 999e449501 osmocom-debian-install.yml: new jenkins jobs
Installs most packages from the Osmocom Debian repository into a plain
debian:stretch container and call the osmo-* binaries with --version
(or -h).

Two jobs, one for nightly and one for latest.

Change-Id: Idbb43ed737e164f8cf3a0e085ed54e4c6a2d14bc
Related: OS#3176
2018-09-20 08:10:49 +00:00
Alexander Couzens 69d4aef8d7 jobs/coverity: only build the master branch
Otherwise the last modified branch will be build.

Change-Id: I0b68ebae025e0dc9dbfd22b97731b59be30e7823
2018-09-18 14:29:20 +02:00
Alexander Couzens 7dd082959a jobs/master-builds: introduce variable git_base_url to allow other domains than git.osmocom.org
Change-Id: Ia37b5f761c47411ac7eab092f3437acecc492f22
2018-08-14 13:25:07 +00:00
Alexander Couzens 6742a83b96 jobs/master-builds: add repo sysmo-usim-tool
Change-Id: I0e4fec571c3c373000c755cfdb5e56dc09d17413
2018-08-14 13:23:51 +00:00
Harald Welte 2812b99810 osmo-gsm-tester: Add OSMO_GSM_TESTER_BUILD_osmo_hlr parameter
For some reason almost all projects allow to permit building a
specific non-master branch, only osmo-hlr was missing that parameter.
Untested.

Change-Id: Ia4199aa5cfd1f39d34ed7c6104881c68d00dcffa
2018-08-08 08:29:13 +02:00
Alexander Couzens 92de527e47 jobs: add gerrit verification for pysim
pysim will be tested on the simtester which has real hardware.

Change-Id: I180cc4a83a41f3ef2e4b1e316ea0371cc83be654
2018-07-25 18:52:26 +00:00
Pau Espin 4aa523ae87 jobs: osmo-gsm-tester-builder: Fix typo in job parameter name
osmo-mgw is duplicated and osmo-bsc is not there.

Change-Id: Ib0ab7f8796b8b78d5f21b7a4f541fd3ddffc95a4
2018-07-25 08:52:01 +00:00
Neels Hofmeyr 1bfa6c7b62 jobs: master-builds: simtrace2: pass '--publish'
Kevin would like to upload simtrace firmware to ftp.osmocom.org from master
builds. To facilitate, add '--publish' arg, like in master-osmo-gsm-manuals (to
distinguish and not upload from gerrit verification jobs).

Change-Id: I93435aa6f39e9a072754011ae7696b10315f6092
2018-07-10 16:56:40 +02:00
Neels Hofmeyr 34b5767e5a jobs: gerrit: use debian-9
This is the same as done for the master builds in
I6f025c642d5ae57cdda9d7b34bbaeb82ca119354,
seems I forgot to follow up with this one.

Change-Id: I9204ca2f083c8a6a04c6c0fc7d51752a4f1a4830
2018-07-05 06:56:49 +00:00
Harald Welte 6866852c37 jobs: add master+gerrit verification job for gapk
Change-Id: Iedf3b43c164ae7e3e653820284c4d4ddaa545784
2018-07-03 15:24:25 +00:00
Daniel Willmann 68a838c435 Restrict where the parent build runs for osmo-gsm-manuals
This seems to resolve the issue where the jenkins job fails due to
missing ssh credentials.

Other jobs can also use this by setting the node property

Change-Id: I23cf2c98f02278a5deb9c4ae8d13438b76538287
Ticket: OS#3338
2018-07-03 05:59:30 +00:00
Harald Welte 63c316738c Add simtrace2 gerrit + master jobs
Change-Id: Ib4da0011337d5a591944821411479f1c6bcc64ee
2018-06-29 21:45:55 +02:00
Harald Welte 227b9ec40d gerrit/gerrit: Add osmo-sysmon build verification
Change-Id: I41411123836d2713f833f78c5920cbbee695ed14
2018-06-10 15:27:08 +02:00
Harald Welte a6a42a06c9 master-builds.yml: More fine-grained e-mail notifications
Some projects should alert certain inidividuals/maintainers

Change-Id: I8aca77d557b2471aa23aa3418d72e7a62734524d
2018-06-03 13:53:31 +02:00
Pau Espin 2f1d4deb71 jobs: osmo-gsm-tester-runner: Add ttcn3 job
Change-Id: I8ca1c9a3a18138a27232efba7d65d6806e044a6b
2018-05-18 13:42:01 +02:00
Pau Espin de4816f77a jobs: osmo-gsm-tester-builder: Add new job to build osmocom-bb
Change-Id: I4b390e34719503a5d0a50e6392b1ceeb3a9cb730
2018-05-17 18:16:37 +02:00
Pau Espin a4a89c79fe osmo-gsm-tester-builder: notify unstable builds
Change-Id: I5a1d7b5e1af5b4fbd12effa870542df2d6be7647
2018-05-07 01:03:31 +02:00
Alexander Couzens 6da3fe8e8b jobs: remove old job Osmocom_nightly_nitb_split
It's not any more used, neither does the job even work, because
the split file got already removed.

Change-Id: I6e85d6384f2a377f1ebe0e06c9ca92a594050eec
2018-05-02 16:56:38 +02:00
Alexander Couzens 6ea2ec3a76 jobs: osmocom-obs: add support for the nightly build
Change-Id: I59929b4025210e1143e4d09bcfc59f91c81f0d20
2018-05-02 16:56:09 +02:00
Alexander Couzens 0fd4e7d429 jobs: osmocom-obs: introduce template var type
In preparation for the nightly jobs

Change-Id: I315215eb1d5ade257262d0717711c11f3787319f
2018-05-02 16:56:09 +02:00
Alexander Couzens efbe93e789 jobs: rename osmocom-obs-latest.yml -> osmocom-obs.yml
Prepare to template nightly and latest in one file

Change-Id: If080cca2ab51a7aab9c85da9f07c51179134f8c6
2018-05-02 16:50:49 +02:00