Commit Graph

257 Commits

Author SHA1 Message Date
Oliver Smith 88521fbc14 scripts/docker-cleanup.sh: conditional img clean
Only run the simple image clean code if docuum is not running. It works
well enough in most cases, but has the drawbacks that it never deletes
"latest" images or images not matching "^osmocom-build", and may delete
images that are still being used (OS#5447). With the other tool, all
images are considered for removal, and the ones that have not been used
the longest time are removed first.

Related: OS#5477, OS#5066, SYS#5827
Change-Id: I1cef0833c096de0fa5acf77156bb5dd362e2ef9c
2022-02-11 15:44:44 +01:00
Oliver Smith b5ebf6ea6b scripts/docker-cleanup.sh: use "docker system prune"
Do not only clean up dangling images, but also containers, volumes and
networks.

Related: SYS#5827
Change-Id: If441b251de50063f0229d36fb1bc260a4cb1dd87
2022-02-11 15:44:16 +01:00
Oliver Smith 2b77e64c48 scripts/docker-cleanup.sh: delete containers too
Related: SYS#5827
Change-Id: I73b2f13875286c1aaa5424809edab2202f41768b
2022-02-11 15:44:16 +01:00
Oliver Smith e94b29e837 scripts/docker-cleanup.sh: use set -x
Change-Id: Iba170128e55a9778467c3d3bcf33a91321a8c29f
2022-02-11 15:44:16 +01:00
Oliver Smith 2e88fa2663 scripts/osmocom-packages-docker: docker run --rm
Change-Id: I357ae8071d27088a2c0a74f962ac1589bff43a70
2022-02-11 15:44:16 +01:00
Pau Espin 2362892acb Add new repo osmo-hnbgw (latest) to build jobs and scripts
Change-Id: I634ebbfa7f471342ffcf253fdb8a316f5e71089f
2022-01-05 12:29:40 +01:00
Pau Espin 702fd8ff94 Add new repo osmo-hnbgw (nightly) to build jobs and scripts
Change-Id: I2fdbd651e4b50191e1a67e183590de99d6366ca5
2022-01-05 11:39:41 +01:00
Oliver Smith 37fe0ed2f4 OBS, ttcn3-testsuites: add 2021q4
Related: SYS#5726
Change-Id: I4913218b192cf0cb1fb74b239ced9a0501c2eb48
2021-12-23 09:15:48 +00:00
Pau Espin 82f21fa6fc repo-install-test: Validate osmo-hnodeb --version
Change-Id: I87c9c375fa810223daadd5768d6a54e9935c34eb
2021-12-21 10:57:11 +01:00
Oliver Smith 444e048693 osmocom-release-tarballs: fix missing st2 clone
Clone simtrace2.git before trying to create the tarball with git.
Fix for:
  simtrace2
    simtrace2-0.1.tar.bz2 (creating)
  + cd /osmo-ci/_temp/repos/simtrace2
  /osmo-ci/scripts/osmocom-release-tarballs.sh: 195: cd: can't cd to /osmo-ci/_temp/repos/simtrace2

Related: OS#5347
Fixes: 0221a0 ("OSMO_RELEASE_REPOS: add simtrace2, osmo-remsim")
Change-Id: I0a845549ba1fe9f0d9ab55a5c5c7bf5b8f57caae
2021-12-14 08:53:18 +00:00
Oliver Smith 0221a0b7f3 OSMO_RELEASE_REPOS: add simtrace2, osmo-remsim
Adjust to simtrace2's directory structure, which does not have a
configure.ac in the main directory like all other repositories. The main
directory has a regular Makefile without autotools, only the host dir
has a configure.ac file (and only in newer versions). Deal with this by
creating two tarballs, one with "git archive" for the whole directory,
and one for the host dir only with the usual "autoreconf -fi;
./configure; make dist-bzip2". The latter one has the files created by
autoreconf ("configure" script and others).

simtrace2
├── simtrace2-0.1.tar.bz2
├── simtrace2-0.2.tar.bz2
├── simtrace2-0.3.tar.bz2
├── simtrace2-0.4.tar.bz2
├── simtrace2-0.5.1.tar.bz2
├── simtrace2-0.5.tar.bz2
├── simtrace2-0.6.1.tar.bz2
├── simtrace2-0.6.tar.bz2
├── simtrace2-0.7.0.tar.bz2
├── simtrace2-0.7.1.tar.bz2
├── simtrace2-0.8.0.tar.bz2
├── simtrace2-0.8.1.tar.bz2
├── simtrace2-host-0.6.1.tar.bz2
├── simtrace2-host-0.6.tar.bz2
├── simtrace2-host-0.7.0.tar.bz2
├── simtrace2-host-0.7.1.tar.bz2
├── simtrace2-host-0.8.0.tar.bz2
└── simtrace2-host-0.8.1.tar.bz2

Closes: OS#5347
Change-Id: Ib52a23a2a7d6ea64bfa539b1d026f035fdb3af57
2021-12-13 11:56:21 +00:00
Oliver Smith 8a32ca538a OSMO_RELEASE_REPOS: sync with Nov 2021 releases
Depends: docker-playground I19b6b0363aeeb89ab6aac2b125359589e6b9b5a7
Related: OS#5347
Related: https://osmocom.org/news/152
Change-Id: Ib2022ca670b322d81ff83bbca3bb262f8d7287a6
2021-12-13 11:56:21 +00:00
Oliver Smith 1e7b1586e4 OSMO_RELEASE_REPOS: sort
Make it easier to figure out which projects are missing.

Related: OS#5347
Change-Id: I3660032d020154b7a175483691842b576552ffd1
2021-12-13 11:56:21 +00:00
Oliver Smith 2100dc42f4 OBS: latest: enable osmo-hnodeb
Enable osmo-hnodeb for latest, now that we have a tagged version.

Change-Id: I3037a43280dbb56ecaf4f2e067f0a1533d19d10a
2021-11-17 11:35:46 +01:00
Vadim Yanitskiy f6974d89c8 scripts: add a script for checking presence of <endian.h>
Change-Id: I6a1e7fc2e96f42fc596f47b4d7f1ac6c61d834b6
2021-10-30 01:09:58 +03:00
Oliver Smith 3dad8b5e7f OBS: nightly: fix missing checkout osmo-hnodeb
Fixes: 2ab3f7 ("Build and test osmo-hnodeb nightly packages")
Related: https://jenkins.osmocom.org/jenkins/job/Osmocom_OBS_nightly/1044
Change-Id: I327adaa8f60c1f90aa150e9d4fba5a10f271c96b
2021-10-26 08:17:55 +02:00
Pau Espin 2ab3f7d4dc Build and test osmo-hnodeb nightly packages
Change-Id: I53c2b357b0669f5101ceec7896c4ba30e69605c2
2021-10-25 11:06:50 +02:00
Oliver Smith c1bdb5b9ce build-old-tags: mark osmo-msc 1.7.0 as known error
Old osmo-msc releases failed to build because logging output of
libosmo-mgcp-client has changed. I'm backporting the fix as 1.7.1 and
1.6.4. The script builds the last 3 releases (1.6.4, 1.7.0, 1.7.1), so
mark 1.7.0 as known error.

Related: osmo-msc Id197e4ab9ba12e284299ef520edee9c362513bf1
Change-Id: I86f8252d450165f4be3d7c97fa70235638f7dd96
2021-09-16 11:02:57 +02:00
Oliver Smith d314ae8280 OBS: remove {osmo-gsm-manuals,osmo-trx}-debian8
Drop these workarounds, as we are not building binary packages for
debian 8 anymore.

Related: OS#5223
Change-Id: Ibe7ba124557969df62798ba49c4489e9606c2341
2021-09-01 16:49:53 +02:00
Oliver Smith 20901e849e repo-install-test: osmo-pcap-server: !latest
Disable osmo-pcap-server for latest again, as the port is still
conflicting there with osmo-bts.

Fixes: 7ca9c4 ("repo-install-test: clear SERVICES_NIGHTLY list")
Related: OS#5203
Change-Id: I711e0e13c3e3af30407b85fd10aca9446f2b94ba
2021-08-09 16:11:08 +02:00
Oliver Smith 7ca9c4f33d repo-install-test: clear SERVICES_NIGHTLY list
All services that start up in nightly should also start in the latest
release now, as new versions have been released of related programs.

Change-Id: Idc94270978ec5ca67d6f7e20e009f905e972f984
2021-08-05 19:06:55 +02:00
Oliver Smith 1bc1947974 osmo-ci-docker-rebuild: don't build ogt for arm
Don't attempt to build the osmo-gsm-tester docker container on arm. It's
currently causing the update-osmo-ci-on-slaves job to fail on
rpi4-raspbian10build-ansible-*.

Related: https://jenkins.osmocom.org/jenkins/job/update-osmo-ci-on-slaves/label=rpi4-raspbian10build-ansible-1/876/console
Change-Id: Ic30de69d318927d5c142f8212eefa3a53037ef25
2021-06-16 15:37:13 +02:00
Oliver Smith 60cef18539 OBS: use nightly script to build 2021q1 feed
Use the nightly script instead of latest, so all packages get
upgraded when upgrading osmocom-2021q1.

Related: SYS#5370
Change-Id: If8de585652997aae1edb586c948c181f564f6994
2021-05-19 06:35:56 +00:00
Oliver Smith 33be93bcc9 OBS: refactor osmo_obs_prepare_conflict
Determine the package name of the conflict package itself and all
conflicting packages automatically, so we don't need to have it
duplicated in the OBS latest and OBS nightly scripts.

This is in preparation to move osmocom-2021q1 from latest to nightly.
With the current logic in nightly for the conflict package, it would not
be possible.

Related: SYS#5370
Change-Id: I183b9040250e66e0d7d17ef4b95af9e7d4a26f04
2021-05-19 06:35:56 +00:00
Oliver Smith 58d02c5483 OBS: move verify_feed to common
Prepare to move the 2021q1 feed from latest to nightly.

Related: SYS#5370
Change-Id: I91e4c36d4a04d465fc9ccb933e8060511b7cd145
2021-05-19 06:35:56 +00:00
Oliver Smith 00188531c2 OBS: conflict: allow overriding pkgver
Allow overriding OSMO_OBS_CONFLICT_PKGVER, so we can increase the
version of the osmocom-2021q1 package whenever something changes on one
of the 2021q1 branches.

Related: SYS#5370
Change-Id: Iae45d7462aab8227ed3756e6cccfa3e64cb04211
2021-05-17 08:27:17 +00:00
Harald Welte 1a8bdf4674 layer1-headers: change git.sysmocom.de to https
after migrating to gitea, we don't offer classic git:// anymore

Change-Id: I61b3b5508031b5b1f1dd521833096a84ab7c9c0f
2021-05-17 08:09:29 +02:00
Oliver Smith f8099e5504 OBS: add osmocom-packages-docker.sh
Add a simple helper script to run osmocom-*-packages.sh in docker to
avoid installing dependencies on the host system.

Related: SYS#5370
Depends: docker-playground Ibb55ad18d2ccf4313f52fa3e3c10d4420c84dced
Change-Id: Icc89e20950c2aaa67b209340d1d797b76fce32d2
2021-04-29 16:05:14 +02:00
Oliver Smith 730d011de5 OBS: common: don't require wget anymore
Not needed anymore since Iaf2527043e9acdb6acff3e481d4516ac4b75b7e7.

Change-Id: I2e03487058e4c2c9426872975953fa1814b24ccd
2021-04-29 16:05:14 +02:00
Oliver Smith a323d1a41c OBS: latest: add commit to version for 2021q1 feed
Move get_commit_version to common-obs.sh and call it in
osmocom-latest-packages.sh, if the feed is not "latest". This way, the
packages don't have the latest tag as version anymore, and the version
changes if commits get pushed to the feed's branch.

Related: SYS#5370
Change-Id: I4a4fa3b8f66652ef36a7fe62047a88a69c473f19
2021-04-29 16:05:14 +02:00
Oliver Smith 4e82ff70cd OBS: refactor git_version_gen related logic
Move git_version_gen calls into an own function and add some of the
description from I76e3713f0b01a6110091ff90e8e53aa79533c374 where this
code was added.

Don't call it inside get_commit_version anymore, but call it before.
Don't try to cat the resulting .tarball-version there if it doesn't
exist.

Related: SYS#5370
Change-Id: I9a1b6ae4b4311abb77dc6390733c5e330e3d489e
2021-04-29 16:05:14 +02:00
Oliver Smith 5ef41781aa OBS: add PACKAGES env var
Skip checking out and building source packages of all other packages, if
the environment variable is set.

Related: SYS#5370
Change-Id: I83c3744713fd6abda4b832460f30eb2e79ebeed8
2021-04-29 16:05:14 +02:00
Oliver Smith 797e4aa386 OBS: latest: support new 2021q1 feed
Related: SYS#5370
Change-Id: I7a59a6ad94b21ba397349813b56b9bd5ea01c7c3
2021-04-29 16:05:10 +02:00
Oliver Smith c925604247 Cosmetic: OBS: explain difference latest/nightly
Related: SYS#5370
Change-Id: I4de2a9e9d096f8f77bfd72b8cabb0a69af2d51df
2021-04-29 16:04:34 +02:00
Oliver Smith e660339f2e OBS: require PROJ environment variable to be set
Uploading to network:osmocom:* should only be done when these scripts
are running in the Osmocom jenkins. Remove the default and require users
of the script to explicitly set PROJ.

Related: SYS#5370
Change-Id: If49ce217e77716b63dfde9139e869672a54b66a2
2021-04-29 16:04:00 +02:00
Oliver Smith 3c31513bcc OBS: nightly: build: simplify changelog parameter
Change-Id: I4a7f63f71d248b3796493adf6dc1be9c1b737c2e
2021-04-29 11:03:07 +02:00
Oliver Smith 57a07962f6 Cosmetic: OBS: describe build() parameters
Change-Id: Ib50499d6d3bd862879eaff58c9bf2260afc97ff8
2021-04-29 11:03:00 +02:00
Oliver Smith e8f56403fc OBS: nightly: append date to all packages
Instead of only appending the date to non-Osmocom packages in
get_commit_version, append it to all packages in build(). This ensures
we increase the version of Osmocom packages even if the commit did not
change.

Fixes: OS#5135
Change-Id: I04d84f39f4093c8edfe21a94c10ecb8d3c7b5b64
2021-04-29 10:38:10 +02:00
Oliver Smith 0bb0238465 OBS: nightly: no change to osmocom-$FEED changelog
Skip the logic to generate a new debian/changelog version for
osmocom-nightly and osmocom-next packages in build(). Use
$OSMO_OBS_CONFLICT_PKGVER instead, as it gets written to
debian/changelog in common-obs-conflict.sh already, and append the date
to the variable.

Related: OS#5135
Change-Id: I85f0bcb633c16c7b5a81104f198d9561f53c0c01
2021-04-29 10:32:08 +02:00
Oliver Smith ccc67c7d44 repo-install-test: get journal of failed services
Depending on the service, error messages are not shown with the
systemctl command. Run journalctl for failed services so we get the
reason for the failure in the jenkins log.

Related: OS#5130
Change-Id: Ib454424d7867137246fadd73255d4dbff63731a6
2021-04-26 10:05:09 +02:00
Pau Espin fd18e126ac scripts: build debian-buster-jenkins image in docker regsitry
Change-Id: Ia08537e0ec67fd5fe102e418648a4f71aaedfd19
2021-03-22 12:46:16 +01:00
Oliver Smith 0949776344 OBS: latest: fix code path to add new package
Fix osmo_obs_add_rpm_spec() to not assume to be in the $oscdir.
This caused the following error when being called from
osmocom-latest-packages.sh in the code path for adding a new package:
  ls: cannot access 'osmo-gbproxy_*.tar.*': No such file or directory

Related: OS#5051
Change-Id: I467e332b69accfabba53332fdb9cd785991855fc
2021-03-02 12:23:01 +00:00
Harald Welte 0eade12c25 osmocom-latest-packages: Package osmo-smlc
osmo-smlc now has a tag that builds against a tagged libosmocore

Change-Id: I0e6756f94027ad1ffd88109b2977cb33ee891a21
2021-03-02 11:17:21 +00:00
Oliver Smith ac802f941f OBS: latest: add osmo-gbproxy
Related: OS#5051
Change-Id: I66bb4e7aeedbb6f40aa9401f4adaf077e22dd9fe
2021-03-01 12:53:01 +00:00
Oliver Smith bb880678c1 OBS: latest: run osmo_obs_add_rpm_spec every time
Replace the current logic, that would only run osmo_obs_add_rpm_spec
when adding a new package, or when the version of a package has changed,
with running it every time.

Running the command when it is not needed does not hurt, as it does not
take significant time, and osc does not attempt to upload the file when
it did not change.

The advantage is, that we can update/upload the spec file without
tagging a new version, if a bug prevented it from getting uploaded
before (as it just was the case for all Osmocom packages).

Related: OS#5054
Change-Id: Ie067c97b5f54ec5b3309ddbd2bfb7f846cd0ccd3
2021-03-01 12:52:40 +00:00
Oliver Smith 08a554c7d1 OBS: latest: fix osmo_obs_add_rpm_spec call
Pass the path to the project's git repository to osmo_obs_add_rpm_spec,
instead of $output (has the output of "gbp buildpackage").

Related: OS#5054
Change-Id: I799398120ab0cbdb74b2d74a3fb139395d66d449
2021-03-01 12:52:40 +00:00
Oliver Smith 571c52207a OBS: don't amend distro specific patch
Make a separate commit for the distro specific patch, instead of using
"git commit --amend". Otherwise, if HEAD was pointing to the latest tag
before the amend, git-version-gen will use the previous tag instead of
the latest one after the amend.

Fixes: OS#5053
Change-Id: I67770a19ee60101df989f98673a22705ad50beed
2021-03-01 11:03:16 +01:00
Harald Welte 1a7e2730e2 ignore osmo-trx 1.3.0 as it doesn't do "make dist"
Change-Id: I47fcd280de158a318f85149eb93b8201ac326e17
Closes: OS#5052
2021-02-28 12:37:54 +01:00
Oliver Smith 52578dde20 repo-install-test: install repo after repo key
In previous patch 27ee885a68, I made sure
that "apt-get update" runs before trying to install wget to download the
repository key. But of course the OBS repository should not be present
before installing the repo key, or else it will fail:

E: The repository 'http://download.opensuse.org/.../Debian_10 ./ InRelease' is not signed.

Fixes: 27ee885 ("repo-install-test: apt update before install wget")
Change-Id: If79484f9ffe2a14ce6481b53867f5aee111aa11b
2021-02-26 17:34:20 +01:00
Oliver Smith 27ee885a68 repo-install-test: apt update before install wget
Fix errors caused by outdated package index:
  + apt install -y wget
  ...
  Err:2 http://security.debian.org/debian-security stretch/updates/main amd64 libssl1.1 amd64 1.1.0l-1~deb9u2
    404  Not Found [IP: 151.101.130.132 80]

Change-Id: I9d28967dc556e95eec2e3e3d7ff88533154acf3c
2021-02-25 14:43:59 +00:00