osmo-ci/jobs
Oliver Smith f560ce08ab jenkins-gerrit: fix ambiguous use of review api
Fix an error when the same Change-Id is used on multiple branches or in
theory projects. This is actually allowed by gerrit, and we use this
e.g. when backporting patches from master.

Use the project, change number (e.g. 30147) and patchset number (e.g. 2)
instead of the Change-Id.

Fix for:
  + ssh -p 29418 -l jenkins gerrit.osmocom.org gerrit review 4835a62cd88f0d69db76fb3bfd2df02176a91a6d --json
  fatal: "4835a62cd88f0d69db76fb3bfd2df02176a91a6d" matches multiple patch sets

Related: https://gerrit-review.googlesource.com/Documentation/cmd-review.html
Change-Id: I2d627f8f3b400fa57a50a228d47df2194f60fd08
2022-11-15 11:38:08 +00:00
..
README.adoc jobs: use "cmd: |", not "# keep first line ..." 2019-04-17 15:35:27 +00:00
coverity.yml update git URLs (git -> https; gitea/gerrit) 2022-08-13 04:02:51 +07:00
gerrit-binpkgs.yml jobs/gerrit-binpkgs: don't use multiple-scm plugin 2022-11-10 16:44:20 +01:00
gerrit-lint.yml jenkins-gerrit: fix ambiguous use of review api 2022-11-15 11:38:08 +00:00
gerrit-pipeline-result.yml jenkins-gerrit: fix ambiguous use of review api 2022-11-15 11:38:08 +00:00
gerrit-verifications-dahdi.yml jobs/gerrit…-dahdi: don't use multiple scms plugin 2022-11-10 16:45:09 +01:00
gerrit-verifications.yml jenkins-gerrit: fix ambiguous use of review api 2022-11-15 11:38:08 +00:00
master-builds-dahdi.yml jobs/master…-dahdi: don't use multiple scms plugin 2022-11-10 16:45:09 +01:00
master-builds.yml master-pysim: use specific node for docs upload 2022-11-14 13:13:34 +01:00
octsim_osmo-ccid-firmware.yml update git URLs (git -> https; gitea/gerrit) 2022-08-13 04:02:51 +07:00
osmo-gsm-manuals-trigger.yml update git URLs (git -> https; gitea/gerrit) 2022-08-13 04:02:51 +07:00
osmo-gsm-tester-builder.yml update git URLs (git -> https; gitea/gerrit) 2022-08-13 04:02:51 +07:00
osmo-gsm-tester-runner.yml update git URLs (git -> https; gitea/gerrit) 2022-08-13 04:02:51 +07:00
osmo-gsm-tester-trigger.yml jobs: Add OGT open5gs build jobs 2021-03-15 19:13:07 +01:00
osmo-gsm-tester_run-gerrit.sh jobs: osmo-gsm-tester: Drop use of OSMO_GSM_TESTER_CONF for default conf dir 2020-05-07 19:16:15 +02:00
osmo-gsm-tester_run-prod.sh jobs: osmo-gsm-tester: Drop use of OSMO_GSM_TESTER_CONF for default conf dir 2020-05-07 19:16:15 +02:00
osmo-gsm-tester_run-rnd.sh jobs: osmo-gsm-tester: Drop use of OSMO_GSM_TESTER_CONF for default conf dir 2020-05-07 19:16:15 +02:00
osmo-gsm-tester_ttcn3.sh jobs: osmo-gsm-tester_ttcn3: Fix path to jenkins script 2020-06-09 14:10:46 +02:00
osmocom-build-tags-against-master.yml Replace most remaining git.osmocom.org urls 2022-09-26 15:07:59 +02:00
osmocom-depcheck.yml Replace most remaining git.osmocom.org urls 2022-09-26 15:07:59 +02:00
osmocom-list-commits.yml Replace most remaining git.osmocom.org urls 2022-09-26 15:07:59 +02:00
osmocom-obs-check-builders.yml jobs: add osmocom-obs-check-builders 2022-10-26 08:35:05 +00:00
osmocom-obs.yml jobs/obs: don't upload to build.opensuse.org 2022-11-04 08:03:07 +00:00
osmocom-release-tarballs.yml update git URLs (git -> https; gitea/gerrit) 2022-08-13 04:02:51 +07:00
registry-rebuild-upload-fpga-build.yml update git URLs (git -> https; gitea/gerrit) 2022-08-13 04:02:51 +07:00
registry-rebuild-upload-titan.yml update git URLs (git -> https; gitea/gerrit) 2022-08-13 04:02:51 +07:00
registry-triggers.yml update git URLs (git -> https; gitea/gerrit) 2022-08-13 04:02:51 +07:00
registry-update-base-images.yml jobs/registry-update-base-images: drop old images 2022-07-06 15:20:22 +00:00
repo-install-test.yml update git URLs (git -> https; gitea/gerrit) 2022-08-13 04:02:51 +07:00
ttcn3-testsuites-kernel-git.yml Replace most remaining git.osmocom.org urls 2022-09-26 15:07:59 +02:00
ttcn3-testsuites.yml Replace most remaining git.osmocom.org urls 2022-09-26 15:07:59 +02:00
update-osmo-ci-on-slaves.yml jobs/update-osmo-ci-on-slaves: set wipe-workspace 2022-10-20 09:19:09 +00:00
update-osmo-python-on-slaves.yml jobs/update-osmo-*: change mail recipients 2022-06-29 09:33:30 +00:00

README.adoc

These jenkins.osmocom.org job definitions, managed by
https://docs.openstack.org/infra/jenkins-job-builder/index.html[Jenkins Job Builder]

*Prepare:*

Install jenkins-job-builder:

For debian 9, see troubleshooting below. Otherwise:

  apt-get install jenkins-job-builder

Have a jenkins-job-builder.ini file. One of

    ~/.config/jenkins_jobs/jenkins_jobs.ini
    /etc/jenkins_jobs/jenkins_jobs.ini

or place one in here and pass it to jenkins-jobs using the --conf file.

Make sure the file not world readable to minimally safeguard your jenkins password.
Instead of using your jenkins password, use an *API Token*. To retrieve your token go
to Jenkins via a Webbrowser, click on your Username in the right corner, click on configure,
click on *Show API Toke...*.

jenkins_jobs.ini:

    [jenkins]
    user=my_user_name
    password=my_api_token
    url=https://jenkins.osmocom.org/jenkins

and

    chmod go-rwx jenkins_jobs.ini

*Update a single job on jenkins.osmocom.org:*

    jenkins-jobs --conf jenkins_jobs.ini update gerrit-verifications.yml gerrit-osmo-msc

NOTE: when you supply a name not defined in that yml file, you will not get an
error message, just nothing will happen.

*Update all jobs of one file:*

    jenkins-jobs --conf jenkins_jobs.ini update gerrit-verifications.yml

*Update all jobs in all files:*

    jenkins-jobs --conf jenkins_jobs.ini update ./

*Troubleshooting:*

- 'jenkins.JenkinsException: create[gerrit-osmo-msc] failed'

jenkins.osmocom.org is not reachable, or URL in the config file is erratic.
Make sure it is exactly

    url=https://jenkins.osmocom.org/jenkins

- newlines:

Use 'key: |' to keep new lines in multiline values, e.g.:
  - shell: |
      echo hello
      echo world

See also:
* https://yaml-multiline.info/
* https://stackoverflow.com/a/21699210

- jobs named on cmdline are not updated:

Make sure the job name is correct, or just issue an entire yml file without
individual job names.

Also be aware that jobs are only actually updated when anything changed.

- debian 9

For jenkins-job-builder to work on debian 9:

add 'testing' to /etc/apt/sources.list like

  deb http://ftp.de.debian.org/debian/ testing main

then

    sudo apt-get update
    sudo apt-get -t testing install python-jenkins
    sudo apt-get install jenkins-job-builder

and make sure to *not* pick the python3 versions
(or you'll need to add catching of HTTPError to jenkins/__init__.py in
'def maybe_add_crumb')

*Jenkins labels*

The build jobs are using labels to specify on which nodes the job should be run.
Please use the following labels

- osmocom-master-debian8: are nodes which can build osmocom-master and is a debian 8
- osmocom-master-debian9: are nodes which can build osmocom-master and is a debian 9
- osmocom-gerrit-debian8: are nodes which can build osmocom-gerrit and is a debian 8
- osmocom-gerrit-debian9: are nodes which can build osmocom-gerrit and is a debian 9