Commit Graph

19 Commits

Author SHA1 Message Date
Harald Welte 5455b42405 update git URLs (git -> https; gitea/gerrit)
Unencrypted git:// protocol offers no integrity or authentication,
making it subject to tampering.  Use https:// instead.

https://github.blog/2021-09-01-improving-git-protocol-security-github/#no-more-unauthenticated-git
https://blog.readthedocs.com/github-git-protocol-deprecation/

Change-Id: Ia44e4127ff87a3d4d747225d3258188a0a891f1b
2022-08-13 04:02:51 +07:00
Oliver Smith 8b6447a1be obs-mirror: use obs.osmocom.org packages as source
Change the rsync command to use the packages from
/downloads/home/packages/web-files/osmocom: on the same server as
source, which is where obs.osmocom.org is pushing the packages.

Remove xUbuntu_19.04 from the directories to sync, as we don't build for
it anymore. It's not an LTS release (unlike 18.04, 20.04) and it's EOL.

Related: OS#5557
Change-Id: Id6be69530a7aa65b0cf3866fc7e65af79c9d9d45
2022-08-05 08:16:11 +00:00
Oliver Smith 7340fa7561 obs-mirror.sh: exclude dotfiles
There's a .~tmp~ file on the remote that currently causes the rsync
command to fail. Ignore all files starting with a dot.

Fix for:
  rsync: [sender] opendir "/opensuse/repositories/network:/osmocom:/nightly/Raspbian_11/.~tmp~" (in opensuse-full-really-everything-including-repositories) failed: Permission denied (13)

It's time to update the script to sync the obs.osmocom.org packages
instead of the ones from build.opensuse.org, I'll do that in the next
patch. Nevertheless, I think it makes sense to add this exclude argument
in case OBS (our instance) also creates temporary files like this.

Change-Id: Iacee2ea4acada60d8de960592fb828911a55781e
2022-08-04 13:41:10 +00:00
Oliver Smith 871ff5c685 obs-mirror-include.txt: drop latest/Debian_9.0
Don't attempt to sync Debian_9.0, as we are not building for it anymore
and it doesn't exist anymore.

https://download.opensuse.org/repositories/network:/osmocom:/latest/

This should fix the verify-obs-mirror job.

Change-Id: I25ba2790a8ae6a54068b8ad4035a669f48795509
2022-08-01 11:50:12 +02:00
Harald Welte 4bf60895e9 obs-mirror: Keep more 'latest' distributions
'latest' doesn't change very often, so we can keep history for more
distros.

Change-Id: I3c8ac31bdf394f8b94ed643413ee2a1379eb76a2
2021-12-30 16:32:04 +01:00
Harald Welte fe8c4552d8 obs-mirror-archive: keep raspbian + debian 11 (instead of 10)
Debian / Raspbian 10 are getting a bit old, and our test suites also
all have shifted to 11 by now, so let's rather keep a nightly archive of
11 as opposed to 10

Change-Id: Id08acf82d9c959553684d0d95b31a8c0379115a6
2021-12-30 16:32:04 +01:00
Harald Welte cce962cdc0 obs-mirror.sh: Keep log files of rsync job
Before this commit, the obs-mirror.log was overwritten every night,
meaning we have no history of rsync log files.

Change-Id: I26392ed8615b9f4a6aa23e92b82ad9aff01eac4b
2021-12-29 17:07:22 +01:00
Oliver Smith 958224ea62 contrib/obs-mirror: log DRY var in rm script
Related: SYS#5764
Change-Id: I705e52030d538e6d86c72f2bccb0eb97e6dab1de
2021-12-20 13:35:19 +00:00
Oliver Smith 9b694744ea contrib/obs-mirror: redirect all output to a log file
Related: SYS#5764
Change-Id: Ie56c901877a3b0a1ad566cb243ab698f292407d5
2021-12-20 13:35:19 +00:00
Oliver Smith e3aaae199f contrib/obs-mirror: stop script on rsync error
Sync files into a temporary directory first, and only rename the temp
dir to the final dir name if rsync succeeds. Otherwise, exit with error.

Related: SYS#5764
Change-Id: Icfefd8e4bae1fd6c73445c7427aaa842c0391b2d
2021-12-20 13:35:19 +00:00
Oliver Smith 68896ff0ae contrib/obs-mirror: adjust includelist path
Point at obs-mirror-include.txt from this git repository.

Related: OS#4862
Change-Id: I4c6a6e424fd727de4e8058c916aa7eb43e7eb4b2
2021-12-20 13:35:19 +00:00
Oliver Smith 05902bd35e contrib/obs-mirror: import
Import scripts from OS#4862 to have them properly versioned. We use this
to replicate Osmocom related packages from OBS to:
https://download.osmocom.org/obs-mirror

Put it in contrib/, because it doesn't need to get installed to the
jenkins nodes (as it would happen with everything in scripts/).

Related: OS#4862
Change-Id: I3f47cddbcee6c9b85fde77a039dcd5b54dd89f2d
2021-12-20 13:35:19 +00:00
Oliver Smith c32a0f60e0 contrib/jenkins: add missing cd ~/osmo-ci
Fixes: 829f8b94 ("ansible: tasks/osmo-ci: clone osmo-gsm-manuals")
Change-Id: I3ca101f73cecfc5cda447ffce53a104ecc39e1fd
2021-01-13 16:25:20 +01:00
Oliver Smith d02c86663e contrib/jenkins.sh: clone osmo-gsm-manuals too
Make osmo-gsm-manuals.git available as ~/osmo-gsm-manuals, so it can be
used by osmo-trx and osmo-bts (the only two projects building manuals,
which are not running in docker as of writing) instead of cloning the
repository in their contrib/jenkins.sh.

A similar change to clone osmo-gsm-manuals in the debian-stretch-jenkins
image used by all other jobs that build manuals, is done in
docker-playground 7e4c8c6f1f798b9b8e57af97131ce3759528e0de.

osmo-ci's contrib/jenkins.sh is called by the update-osmo-ci-on-slaves
job.

Related: OS#4912
Change-Id: I742fd929e39ca32d6034a30af75b6c8e5b47b233
2021-01-13 11:33:16 +01:00
Pau Espin b3819d2c6a contrib/jenkins: Avoid docker setup if OSMO_CI_NO_DOCKER=1
Some jenkins slaves may not need docker (or even have it installed).

Change-Id: Ibfc4a81d3d621503b40204b7452ead56c726af97
2020-03-03 12:34:56 +01:00
Oliver Smith b79e06367b docker: move to docker-playground.git
Instead of building "osmocom:deb9_amd64" from this repository, build
"$USER/debian-stretch-jenkins" from docker-playground.git (same
Dockerfile). Adjust all jobs to use the new image name.

Add a new "update-osmo-ci-on-slaves-dp" jenkins job, which triggers
the existing "update-osmo-ci-on-slaves" job whenever
docker-playground.git changes.

Replace docker/rebuild_osmocom_jenkins_image.sh with
scripts/osmo-ci-docker-rebuild.sh, so we can get rid of the docker dir.
I thought about dropping the script completely, and directly writing the
two lines into contrib/jenkins.sh. But I kept the extra script for
convenience, when testing locally.

Related: OS#4345
Depends: docker-playground I125ae8a6bcabbd1f485028c79b0abacda0622c3a
Change-Id: I30a61aebcadef5536e74edd35e1c75ef77a2da9f
2020-01-15 10:24:38 +01:00
Neels Hofmeyr f074019027 contrib/jenkins.sh: rather git checkout -f instead of pull
Change-Id: Idc672879dcb3d38978e27b90c173f0aa950c4eb1
2017-11-28 05:43:26 +01:00
Neels Hofmeyr 4b5d368932 contrib/jenkins.sh: update from current jenkins job update-osmo-ci-on-slaves
We're not calling this script on the update-osmo-ci-on-slaves job yet. To move
over to calling this script, apply some edits we made on the jenkins UI in the
meantime.

Change-Id: I54d3f56a89934c1c7b0e445b5c447c91bf94d579
2017-11-28 05:16:37 +01:00
Holger Hans Peter Freyther 9e6db799d5 jenkins: Follow the convention and create a jenkins.sh as well
Instead of modifying the job on Jenkins, let's do it like in our
other projects. Create the diretcory if it doesn't exist and use
git pull origin for the Debian9 system.

Change-Id: I0ecdc02e3271fe09980f370167277370c599fcfa
2017-11-10 16:43:06 +00:00