Commit Graph

42 Commits

Author SHA1 Message Date
Oliver Smith 92b50a5a6b jobs/update-osmo-ci: remove build3
Related: OS#6186
Change-Id: I63bbac0a767c30f8d3e4552024172bd689122d61
2024-01-24 10:31:05 +01:00
Oliver Smith 6d4b0effa6 jobs/update-osmo-*: add build4-deb12build-ansible
Related: OS#6186
Change-Id: I1f732718df87ed3b850332dbf1a7f6b2f854f280
2023-10-19 07:30:20 +00:00
Oliver Smith 8ec747db10 jobs/update-osmo-ci: add ansicolor wrapper
Change-Id: Ic94f2cc14b2af3a3711ac3eadec8c92b62006587
2023-07-13 14:57:16 +02:00
Oliver Smith 127e79f171 jobs/update-osmo-ci: add branch parameters
Add parameters to set the osmo-ci and docker-playground branch. I'm
using this to test the debian 12 based containers before merging the
changes to master.

Related: OS#6057
Change-Id: I62265300048031cbb65e997b921373894500233f
2023-07-13 14:57:16 +02:00
Harald Welte a052c13c12 Revert "jobs: tweak build-discarder values"
This reverts commit 719ff97608.

The disk consumption of jenkins has grown by almost 500GB
since we merged this patch.  Clearly this is not expected, and we'd
have ran out of disk space in a few weeks.

I personally think the current allocation of 1.5TB of disk space to
jenkins should be more than sufficient; we just need to manage it
better.

Closes: OS#5980
Change-Id: I6b744a8b84a3e1255a8d51f73d1721ccfd028ac1
2023-03-28 13:35:33 +02:00
Oliver Smith 719ff97608 jobs: tweak build-discarder values
Remove num-to-keep from most jobs, as this leads to keeping the build
logs for a much shorter timeline than desired. For example the
gerrit-binpkgs-deb job that runs for most projects when pushing patches
to jenkins reaches the 120 limit in less than 24h - and so when clicking
the link on a failed build from yesterday it is already deleted.

Instead just keep the logs for the last 30 days, no matter how many were
submitted on one day. Storing logs doesn't take up much space.

Remove the artifact-days-to-keep and artifact-num-to-keep lines, as they
don't have an effect. For jobs that do have artifacts, the actual value
is min(days-to-keep,artifact-days-to-keep) and same with num-to-keep.

While at it, increase the ttcn3-testsuites build-discarder to 120 days
as this means more data will show up in the test result analyzer at
which we look frequently.

Change-Id: Iec5c22c7fcf6c1fd2db71611045f15dc6580ed86
2023-03-07 12:05:29 +01:00
Oliver Smith b6d36134a7 jobs/update-osmo-ci-on-slaves-dp: fix node
This trigger job can run on any node, don't have it require a debian9
label that doesn't exist anymore.

Change-Id: I1a23a4c99fe007387f13e330b0b08f6941392829
2022-12-23 11:01:32 +00:00
Oliver Smith 50a54c923b jobs/update-osmo-ci-on-slaves: don't run on ogt
Don't run this job on the osmo-gsm-tester machines. Right now this job
takes quite some time to build various docker images which we don't even
need on osmo-gsm-tester. It also uploads osmo-ci.git and
osmo-gsm-manuals.git, which don't need to be updated on these if we
don't run the osmo-gsm-tester jenkins jobs on them (see previous
commit). According to Pau they would be needed for
osmo-gsm-tester_ttcn3.

Related: OS#5811
Change-Id: I39d72740d896981f069ad339013c1e1e3d4f3bba
2022-12-14 17:29:08 +01:00
Oliver Smith fd7c88e992 jobs/update-osmo-ci: remove deb9 nodes
Related: OS#5793
Change-Id: Id2bf3c273848c1de12a3dce3bc007dd205bf4af7
2022-12-06 11:17:16 +01:00
Oliver Smith 989fb2ca58 jobs/update-osmo-ci: add build2-deb11build-ansible
Change-Id: Ief90b38d0a92f27c7ec37ffeb09dd3595b9d0baf
2022-11-29 11:42:11 +01:00
Oliver Smith e7c3edc144 jobs/update-osmo-ci: order nodes alphabetically
Make it easier to compare the list with:
https://jenkins.osmocom.org/jenkins/computer/

Change-Id: I6e132c5768bf09271ffcfe8eec8311ff5d7e28df
2022-11-29 11:40:41 +01:00
Oliver Smith 5d184fe869 jobs/update-osmo-ci: update list of nodes
* remove host2-deb9build
* add {host2,build3}-deb11build-ansible

Change-Id: I79bbb84cd19df7838a30a954ffa47a2a62517f77
2022-11-28 14:32:08 +01:00
Oliver Smith b3fa89154b jobs/update-osmo-ci: remove gtp0-deb11build32
The node doesn't have a purpose, remove it (as discussed in related
issue).

Related: OS#5453
Change-Id: I241b6dc91af18be38edaff1bd17dfc9633ca1cec
2022-11-17 11:53:11 +01:00
Oliver Smith 8a66dcd1f8 jobs/update-osmo-ci-on-slaves: set wipe-workspace
Wipe the workspace before running the job, so the _docker_playground
clone gets recreated (and e.g. doesn't have the old clone url).

Change-Id: I5626c4728ebd7f6b693484c7801963985832398d
2022-10-20 09:19:09 +00:00
Oliver Smith a1027bd25c jobs/update-osmo-ci-on-slaves: run every day
Make sure scripts/osmo-ci-docker-rebuild.sh runs at least once a day on
the jenkins nodes, so the docker images are less likely to expire due to
being unused. This was the reason for master-osmo-opencm3-projects and
gerrit-osmo_dia2gsup failing.

Related: https://osmocom.org/projects/osmocom-servers/wiki/Docker_cache_clean_up
Change-Id: If5c4b3cb87100ab6c44d717a17986a4f0c6570fe
2022-08-30 14:41:24 +02:00
Harald Welte 5455b42405 update git URLs (git -> https; gitea/gerrit)
Unencrypted git:// protocol offers no integrity or authentication,
making it subject to tampering.  Use https:// instead.

https://github.blog/2021-09-01-improving-git-protocol-security-github/#no-more-unauthenticated-git
https://blog.readthedocs.com/github-git-protocol-deprecation/

Change-Id: Ia44e4127ff87a3d4d747225d3258188a0a891f1b
2022-08-13 04:02:51 +07:00
Oliver Smith 2b7b90e555 jobs/update-osmo-*: change mail recipients
Use jenkins-notifications@lists.osmocom.org like in most other jobs to
not clutter the other ML.

Change-Id: I95c22215dbe09d06d9458a980d15370440f67fd6
2022-06-29 09:33:30 +00:00
Oliver Smith f6e305928a jobs/update-osmo-ci: gtp0-deb{10 => 11}build32
Related: OS#5453
Change-Id: I4b10550f4274995e70bf32f013bffecc1039d8a0
2022-05-18 16:43:01 +02:00
Oliver Smith 382aebd040 treewide: rename rpi4-raspbian10 to rpi4-raspbian11
The raspberries have been upgraded to the debian 11 based raspberry pi
OS. Adjust the name to avoid confusion.

Related: OS#5453
Change-Id: I0b2e08b11d83243e81b2bb4412ffcc9bc59821ff
2022-05-02 13:29:50 +00:00
Pau Espin 1982f52f8e Deploy osmo-ci to ogt nodes and update it periodically
We need osmo-ci in those nodes in order for the docker old images to be
cleaned through cron entry installed by ansible docker role, which uses
/home/jenkins/osmo-ci/scripts/docker-cleanup.sh.

Related: OS#5441
Change-Id: Ieb6db0b24dce6099cfa24871a957471ca2c8bcee
2022-02-07 11:29:26 +01:00
Oliver Smith f404962d61 jobs: don't run any on admin2-deb9build
This node was disabled permanently, so don't try to run anything on it.

Change-Id: I0ea91658c74ea24fae551b917628fab5f7952c97
2021-06-04 14:11:05 +02:00
Oliver Smith 8c48d2020a jobs/*: update references to rpi4 nodes
Use the new label that matches all three rpi4 nodes in master-builds and
gerrit-verifications (so the builds can run on any of them). Use the
names of the three nodes in update-osmo-*-on-slaves, so all of them get
updated.

Related: https://jenkins.osmocom.org/jenkins/label/rpi4-raspbian10/
Related: OS#5055
Change-Id: I5b2af801baeb510e7784d6bcd7cabfda4962af0c
2021-03-08 15:44:11 +01:00
Harald Welte b4e042736c update-osmo-ci-on-slaves: Add build slaves on gtplab0
Change-Id: I555cb26be138e2969d07ad561fe8eba8994f2429
2020-12-17 13:50:04 +01:00
Harald Welte 1f5faf85bd remove all debian8 slaves
we cannot even create new slaves as lxc-create doesn't support debian
jessie anymore.  Let's focus on Debian 9 + Debian 10

Change-Id: I2fddd460f7d1db755cc9b732b2be80494d26e091
2020-11-15 10:01:03 +01:00
Pau Espin 6464e7c4c3 jobs: jenkins simtest node is named simtester
simtest node doesn't exist, it's called simtester.

Fixes: 3935743127
Change-Id: Id703a85298b163e7e95bb89f6a69ab51e29effb4
2020-03-03 12:01:35 +01:00
Harald Welte bee8f383e1 add build2-deb10build-ansible build slave
This is our first Debian 10 build slave

Change-Id: Iae80c5f73781d14ffbf124a476894d4631c83dc7
2020-02-26 13:47:20 +00:00
Vadim Yanitskiy 3935743127 jobs: add 'simtest' to the list of to be updated slaves
Change-Id: I0cc6188aab10ecb8b862710d272c411e47a21f61
2020-02-26 18:05:50 +07:00
Pau Espin 5eabf8bcb1 jobs: Run update-osmo-{ci,python}-on-slaves on rpi4-deb9build-ansible
Change-Id: I96067ffc0061a85bcc46569b1bf38eade3b8d995
2020-02-26 10:50:50 +01:00
Oliver Smith b79e06367b docker: move to docker-playground.git
Instead of building "osmocom:deb9_amd64" from this repository, build
"$USER/debian-stretch-jenkins" from docker-playground.git (same
Dockerfile). Adjust all jobs to use the new image name.

Add a new "update-osmo-ci-on-slaves-dp" jenkins job, which triggers
the existing "update-osmo-ci-on-slaves" job whenever
docker-playground.git changes.

Replace docker/rebuild_osmocom_jenkins_image.sh with
scripts/osmo-ci-docker-rebuild.sh, so we can get rid of the docker dir.
I thought about dropping the script completely, and directly writing the
two lines into contrib/jenkins.sh. But I kept the extra script for
convenience, when testing locally.

Related: OS#4345
Depends: docker-playground I125ae8a6bcabbd1f485028c79b0abacda0622c3a
Change-Id: I30a61aebcadef5536e74edd35e1c75ef77a2da9f
2020-01-15 10:24:38 +01:00
Oliver Smith c31ee44bd8 jobs/update-osmo-ci-on-slaves: origin/master only
Don't run, when different branches were pushed.

Change-Id: I2cf55391066b60cf6a594f528ed0eaf59a886391
2020-01-08 15:04:25 +01:00
Alexander Couzens 9e0367a2e8 jobs: update-osmo-* remove old build nodes
Change-Id: Ia7f98e55895b150da473a38a3e68b188acd0e76a
2018-04-24 11:26:24 +02:00
Alexander Couzens 5c5cca5266 jobs: update-osmo*: remove non-existent node build2-deb8build
The jobs will stall when trying to handle a non-existent node

Change-Id: Id9f25d8a5f6d0521e2b70884f46de5dee14d8092
2018-04-24 09:22:47 +00:00
Alexander Couzens 3e9d6ad7fd jobs: update-osmo-* reformat a list to be human readable
Change-Id: Ic64463d3974fdbf3967e67a77c75490d7ca80fb7
2018-04-11 06:01:24 +00:00
Alexander Couzens 7a148bff15 jobs/update-osmo*: add new nodes to the update jobs
Change-Id: Ib103b3343d582f7a78f0c4cec00c94078a078584
2018-04-05 19:58:51 +00:00
Alexander Couzens 45bb81c8c0 jenkins: add node admin2-deb8build to the update jobs
Change-Id: I6b703b9f27865b146f20bea953fe3d6500a88166
2018-02-25 17:15:40 +01:00
Alexander Couzens 71cb57cc88 jenkins: add node admin2-deb9build to the update jobs
Change-Id: Ie3803a46ee192dc72823291004ee20f4bdbe0126
2018-02-25 14:07:10 +01:00
Max 3527fd63ad Send email on update-* job failures
Notify intern@ if either update-osmo-ci or update-osmo-python jobs
failed. Those are essential for our CI and test infrastructure so we
should look into related failures right away.

Change-Id: I0d51e35424a26eab7d38152e13f3ac6fd3f3997c
Related: OS#2821
2018-01-08 12:36:50 +01:00
Neels Hofmeyr 7fd10510d2 jobs: fix poll-scm on update-osmo-ci-on-slaves
poll-scm was missing by accident

Change-Id: I027c5fa12c8be9434e3efec11976004c7924c472
2017-12-15 19:31:26 +01:00
Neels Hofmeyr 520c8a58d4 jobs: add build2-deb8build to update-osmo-ci-on-slaves job
Change-Id: I48246067f05227efc18b46cb1b29d1c50f4eab84
2017-12-15 19:31:26 +01:00
Neels Hofmeyr 28564a6977 jobs: gerrit, master, update-osmo-ci: fix build-discarder section
The build-discarder section was silently not working. It needs to be nested
below a 'properties' node.

Also the names need to be dashed and not camelCased.

Change-Id: I9503200a8873e616f9195d4bb1d6163c464b305e
2017-12-09 01:13:18 +01:00
Neels Hofmeyr bb459a2d0b jobs: update-osmo-ci-on-slaves: remove build2-deb8build
The node is offline and has been for a long time. The last osmo-ci-on-slaves
job ran for a week waiting for it to come back online.

Change-Id: I5a315d1ce3d7d5763ba07bf29f9cdd5d6f7c6491
2017-11-28 05:16:37 +01:00
Neels Hofmeyr 716413c5be jobs: add update-osmo-ci-on-slaves.yml
Change-Id: Ia933288f87f53f832732f650ba4be30d58faea7f
2017-11-28 05:16:37 +01:00