Commit Graph

121 Commits

Author SHA1 Message Date
Oliver Smith a7fcf3218d build-old-tags: remove LD_LIBRARY_PATH
Do not set LD_LIBRARY_PATH during builds, as this causes testsuites to
use the wrong libraries.

This bug appeared with libosmocore, it gets built for master first, and
then an old version like 1.2.0. When using LD_LIBRARY_PATH, the tests
during the 1.2.0 build are executed against the libosmo*.so from
master, which causes a few tests to fail.

Change-Id: I0bfb57e418b91c298337b9426448fbcfd7bf32e6
2019-10-11 11:03:39 +00:00
Oliver Smith df967f76f6 OBS: print date/time before git clone and on error
The OBS job clones a lot of repositories from git.osmocom.org every
night, so it is a good candidate to reproduce the "garbage at end of
loose object" error we are getting sporadically.

Print exact timestamps, so we can check if there is anything related in
the server logs, when this error happens again.

Related: OS#4083
Change-Id: Ic9a6d3f0c2b8dad2661ede793c21307f1680a52e
2019-07-22 13:22:33 +02:00
Harald Welte dcb9edafd4 latest-packages: Enable osmo-remsim as new libosmo-abis is tagged
Change-Id: Id1902f8b79357ac280767edba3698450f67b7c37
2019-07-21 21:35:00 +02:00
Oliver Smith e6aff494a6 common.sh: add docker_images_require
Clone docker-playground.git, source its jenkins-common.sh and run
docker_images_require from there. This will make it possible to run
osmocom-release-tarballs.sh in a docker container, for which the
Dockerfile is stored in docker-playground.git.

Related: OS#3870
Change-Id: Ic4519ccb6978793054869862f8ca0e21d9cf5be4
2019-07-02 13:14:59 +02:00
Oliver Smith 0a389c4083 scripts: add osmocom-release-tarballs.sh
Generate tarball releases for all tags in all repositories.

Related: OS#3870
Change-Id: I0a904c26e1c45aa46ddc59a01b776f2c7c5f947d
2019-07-02 12:59:52 +02:00
Oliver Smith 0aa0ba0c55 osmocom-list-commits: move repo list to common.sh
Prepare for new script, which will use the same list of repositories.

Related: OS#3870
Change-Id: I954b1d5229c44ebcec7e7228f2565a5c6755d16c
2019-07-02 10:24:57 +02:00
Oliver Smith a5d5bedd55 common.sh: osmo_git_last_commits_tags: add "all"
Allow printing all tags instead of only the N most recent ones.

Related: OS#3870
Change-Id: I684c6881915831b33b679e8ae873213beb034ab7
2019-07-01 13:41:40 +02:00
Oliver Smith e26866af0d OBS: make nightly packages conflict with latest
Add conflicting dummy packages osmocom-nightly and osmocom-latest, and
make all packages from each repository depend on the right one.

As usually, the latest packages will only get changed when a new release
appears. So the dependency will get introduced after tagging a new
release. I have tested in an own OBS namespace, that everything works as
expected.

Related: OS#2640
Change-Id: I79c45e798c10a65443b9fb9ecb54393d1918608a
2019-06-17 12:21:32 +02:00
Oliver Smith 83f4f25d7c OBS: build osmo-gsm-manuals-dev in latest
Enable in osmocom-latest-packages.sh. Check it out and create the source
package for the latest release as usually, but also create a second
version for debian 8 with adjusted dependencies (like in nightly [1]).

[1] Change-Id: I3570599ede51b974d350064f44f77e360fafd8b0

Related: OS#3899
Change-Id: Ib7251cca9116151e473798879375cd5eb48ff3ad
2019-05-29 12:41:11 +02:00
Oliver Smith 9dc7e2ad4b OBS: latest: remove redundant checkout in build()
Don't checkout a specific version in build(), this is already done in
checkout().

Change-Id: I74290968fe25a6311da0de26ff675bbd687ba156
2019-05-29 12:37:39 +02:00
Pau Espin 777a2f8060 nightly-packages: Update LimeSuite to latest tag (v19.0.4)
Change-Id: Id6c27a924e3005ffadc7720190b261f089beada1
2019-05-24 09:35:12 +02:00
Harald Welte acb2fb6078 osmocom-latest-packages: Enable osmo-sysmon
Since libosmocore 1.1.0 and libosmo-netif 0.5.0 are released, we can
address the TODO and build osmo-sysmon also in our latest feed.

Change-Id: I48bd5aff2ae315b6f462facea70222eb2cdd2d58
2019-05-11 06:15:24 +00:00
Oliver Smith 72a84b551e nightly-packages: add osmo-gsm-manuals-debian8-jessie
Create a compatible package for debian 8 with adjusted dependencies.
While at it, refactor create_osmo_trx_debian8_jessie() into a generic
checkout_copy_debian8_jessie() function.

Related: OS#3899
Depends: I5b9575ceb1141961e570643a5755a2bd6b6a4254 (osmo-gsm-manuals)
Change-Id: I3570599ede51b974d350064f44f77e360fafd8b0
2019-05-08 11:52:22 +00:00
Pau Espin fb69674156 nightly-packages: Update limesuite hash to support LimeNet-Micro
Newer LimeSuite (at least 7557e291209fc66a78ffa74dd8314e75841f7c96) is
required to have LimeNet-Micro working properly with osmo-trx.
We update to current newest master since other fixes related to sample
rate are applied after the commit mentioned above.

Related: OS#3861
Change-Id: I62779f3bdbc4a459363a1d660d96d5f02f7763c1
2019-04-18 13:01:00 +02:00
Oliver Smith dc5fc51c1f OBS: build osmo-gsm-manuals-dev in nightly
Enable in osmo-nightly-packages.sh, and add as coment in
osmocom-nightly-packages.sh for now (needs a tagged release first).

Related: OS#3899
Depends: I7edb5093e5b58eb3b0f7af2376476db4026db735 (osmo-gsm-manuals.git)
Change-Id: Ideeae4f7846fa5626fe2c1f5a77e07a3c6e626fe
2019-04-15 08:53:47 +02:00
Pau Espin 53f2e1585f nightly-packages: Build latest tag of limesuite
Like we actually do already on latest-packages.

Change-Id: I5a9e97a7a93c1d2a9983926cd0f5d7255e9666bd
2019-04-12 17:53:15 +02:00
Pau Espin bfea6499a3 nightly-packages: Move some code and rename some vars to look similar to latest-packages
Change-Id: I177bb7fb75e293ef665e95363a38c6b4f8e49c13
2019-04-12 17:53:15 +02:00
Pau Espin a5a4c5a867 nightly-packages: Remove unused variable
Change-Id: Ic120dbc134cba9bd77098ab14a5dba3d5c4d71b9
2019-04-11 15:32:59 +02:00
Pau Espin 5f9f7ca8b4 nightly-packages: Remove duplicated check
Change-Id: I9659e71d87b03971673da3bfb2101de9d5fe3c6a
2019-04-11 15:32:50 +02:00
Harald Welte 15ae47aa99 osmocom-nightly-packages: build osmo-remsim
As of Change-Id Id5044b1835190edc948952d207a5196a18669eb1, osmo-remsim
contains Debian packaging information and hence we can build it as part
of our nightly feeds.

We're not yet enabling 'latest' builds as we need to wait for the next
libosmo-abis release for that (requires the IPA keepalive FSM).

Change-Id: Ic367dc95f46cece4bd769061af860fd82b4bd2e9
2019-04-03 12:23:34 +02:00
Oliver Smith ebb42f8bde build-old-tags: build libosmo-legacy-mgcp
Build osmo-mgw 1.4.0 (which provides libosmo-legacy-mgcp) and install
it into a different temp dir. Allows properly building osmo-bsc 1.2.x,
as soon as a new release is tagged, which makes it use
LIBOSMOLEGACYMGCP_CFLAGS and therefore pick up the include path
properly [1].

osmo-mgw 1.4.0's "make check" doesn't pass right now, so add a check
parameter to build_repo() and disable them when building
libosmo-legacy-mgcp. The checks will get executed later, when the
depends are installed and we are building various tags of Osmocom repos,
including osmo-mgw 1.4.0.

While at it, slightly refactor build_repo() to put all arguments into
descriptive variable names (as it is getting a bit longer now).

[1]: Change-Id: Ibd7948f12da710f8ca2b8fde8870f134308eb908

Related: OS#3867
Change-Id: I63d16f8e44c14dee46e2ef3fd050a421017c56b0
2019-04-02 08:03:24 +00:00
Oliver Smith e73ac2aea4 Cosmetic: build-old-tags: osmo-msc: note fixed in
Change-Id: If4d84e3c8c2b8d75136f7440a737956d654f2297
2019-03-30 09:30:47 +00:00
Oliver Smith e9fbc29e5a build-old-tags: known error: osmo-bts-1.0.0
Change-Id: Ifa9953161ad4dbead09675f367baeffe19c788b7
2019-03-28 09:32:14 +00:00
Oliver Smith 15c1f80dcc Add osmocom-build-old-tags-against-master.sh
Build old releases of Osmocom programs and libraries against
"master of the day" to detect breakage.

Redirect each build's output to its own log file, so it is easy to see
what is currently getting build, and what failed. On error, print the
end of the new failing build logs, along with a note to find the full
logs in the jenkins artifacts.

This initial configuration builds the last three release tags of the
Osmocom repositories against master. The configuration can be changed
easily.

Indicate known failures with "err" instead of "ERR" in the output, do
not cause them to fail the build and do not print the beginning of the
error log (it is still in the artifacts). This way, new errors stand out
and don't get overlooked among the known errors.

Related: OS#3765
Change-Id: I7cb45cc40c9930840a3d4e6a86f39e1400478ed3
2019-03-26 15:54:38 +01:00
Oliver Smith e81f90f7e1 osmo-build-dep.sh: run 'make check' when CHECK=1
Prepare for osmocom-build-old-tags-against-master.sh.

Related: OS#3765
Change-Id: I248b53d7a6fe1b64f2a994c568c0466dc93858de
2019-03-26 10:39:13 +01:00
Oliver Smith f8653decf5 osmo-build-dep.sh: cd into subdir before building
Support building the legacy openbsc source with osmo-build.dep.sh. This
will be used by the upcoming osmocom-build-old-tags-against-master.sh
script.

Related: OS#3765
Change-Id: I852e103e80bf295f692cf13c4cb38e80fbc19eca
2019-03-26 10:39:13 +01:00
Oliver Smith 3b3a250f6b osmocom-list-commits.sh: move functions to common.sh
Prepare for the upcoming osmocom-build-old-tags-against-master.sh
script, which will benefit from querying the last n git tags in advance.

Related: OS#3765
Change-Id: I61be4cffb9275cabc1b253f0b298503ad0d3aea4
2019-03-26 10:38:58 +01:00
Oliver Smith bb714ca042 osmocom-list-commits.sh: fix sorting release tags
Properly sort "git ls-remote" output, which looks like:
352f32c9cffef2e5df99cd2f03368dc56c99ee23	refs/tags/0.4.0

Use / as field separator and field no 3, instead of assuming that the
string gets split automatically after the tab character (which it does
not).

Use -V (version sort) instead of numeric sort.

Change-Id: I334e684ac5109fc289b68af78165862148074ea7
2019-03-22 15:57:38 +00:00
Pau Espin b3b2e37246 scripts: Enable osmo-sysmon debian package OBS build
Change-Id: I638c58be1ddf5e7fcf5a51de532ae8c4c06dcdbb
2019-03-22 12:51:14 +00:00
Oliver Smith 391bdf542f Add scripts/osmocom-list-commits.sh
Generate a table of Osmocom CNI repositories and their latest tag,
related commit, and last commit on master.

Related: OS#3840
Change-Id: I91cab0139229e6c1c67e889d33b3d984025bc9da
2019-03-20 11:11:32 +01:00
Harald Welte 2dfb2c6fa1 osmocom-*-packages: clone via https:// not via unencrypted git://
Change-Id: Ibfb52cbac93451ba402edb6b59350620954b0d81
2019-01-26 18:29:01 +01:00
Harald Welte 65353904bc latest-packages: Add libosmo-dsp
Now that libosmo-dsp has a 0.4.0 tag that includes debian packaging
information, we can add it to the latest feed.

Change-Id: Ic082a4ad6b8582dfe44df5bdaafa525e52da7246
2019-01-26 18:29:01 +01:00
Harald Welte 789c5a9c3f nightly packages: Build libosmo-dsp
Change-Id: I989c7961336b4dacbc83e97d1c098f93f56ef6ab
2019-01-17 17:55:10 +01:00
Max 4778fc0323 Add osmo-sysmon to default depcheck config
Change-Id: Ie57d0d55459d492e18b56496c9018a5f8619813a
2018-11-22 14:24:24 +01:00
Harald Welte 499aea7836 osmo-layer1-headers.sh: Check-out NuRAN branches without slashes
this is an ugly workaround for Jenkins not being able to deal with slash
('/') in label names that comprise the axis of a matrix buildjob, while
nuran not using tags but only branch names in their firmware
repositories :(

Change-Id: I1bbfc61f66c5fc490ceca96a8eb21210dd89b629
2018-10-27 13:32:58 +02:00
Harald Welte 6fdb3ef090 osmo-layer1-headers.sh: Add support for OC-2G
Change-Id: Iceb62df4511ed50f0286e5762d9ffc4b068f70a6
2018-10-26 16:07:58 +02:00
Pau Espin 2958d13e2b osmocom-latest-packages.sh: Refactor to support building limesuite
This way the latest script is a lot more similar to the nightly one, and
easier to maintain and expand with new features.

checkout and build steps are split because once we have a new
osmo-trx release, we'll need the create_osmo_trx_debian8_jessie trick to
build it.

In the future we can do further steps to have a common function lib
between latest and nightly scripts.

Change-Id: I786c6f4ad4b4e43d1692c1588d2ad2194d0b25a4
2018-10-05 12:05:10 +02:00
Pau Espin 59f131cc44 osmocom-nightly-packages.sh: Build against newest limesuite release v18.10.0
Change-Id: I4e3a3d3ac4422cbf9c4e8c8bda3d3f7b27be1a14
2018-10-04 17:59:37 +02:00
Oliver Smith 6cced05c01 osmo-depcheck: don't use /tmp, better git code
* replace --gitdir with --workdir and give it a new folder structure:
  * git/$repo: downloaded source code
  * build/$repo: files created during the build process
  * install/: installation prefix
* adjust the jenkins job to use --workdir
* fetch --tags when source exists already
* readable error message for failed git checkout

Change-Id: I06589277b9d54a2af177451cfab2ca1a658b4058
Relates: OS#2642
2018-09-25 09:59:05 +00:00
Oliver Smith 85c2effd89 osmo-depcheck: script to verify PKG_CHECK_MODULES
This script verifies that Osomcom programs really build with the
dependency versions they claim to support in configure.ac. In order to
do that, it clones the dependency repositories if they don't exist
already, and checks out the minimum version tag. This happens
recursively for their dependencies as well. See 'osmo-depcheck.py -h'
for the full usage instructions.

There's also a new jenkins job in jobs/osmocom-depcheck.yml.

Change-Id: I8f495dbe030775f66ac125e60ded95c5d7660b65
Relates: OS#2642
2018-09-20 16:28:00 +02:00
Pau Espin 08b81bf085 osmo-build-dep.sh: Let autotools install systemd services to correct path
Change-Id: I9eba05995fc53b72b04a4a9d63ebd5a236304f7c
2018-09-10 16:06:33 +02:00
Harald Welte 4f30778d08 osmocom-latest-packages: Add simtrace2
Change-Id: I9e6b01f465470f77c58268979d3608afe2005b1c
2018-08-26 10:46:05 +02:00
Harald Welte 4c7321bba3 nightly packages: add simtrace2
Change-Id: Idab162dd11c631d5e72f09b08ed04610e16f05a9
2018-08-26 10:36:04 +02:00
Alexander Couzens c74c64d726 obs-nightly: introduce osmo-trx-debian8-jessie
A compatible package for debian8 as it does not support limesdr.
This patch depend on: I261302d2ed16e76540073589504e7426e23d00a1

Change-Id: I8477b580976b376ee5abdde98a651d47199ef6d9
2018-08-10 00:43:58 +00:00
Harald Welte b67c04b3ec osmocom-latest-packages: Fix libusrp and other non-osmocom builds
We're using the build() function not only to build osmocom projects
requiring a .tarball-version file, but also other projects such as
libusrp.  Let's make the related git-buildpackage arguments conditional
to whether or not a .tarball-version file exists at all.

Change-Id: I0683cff036a240b1b819f91fbd230d5f9211074c
2018-08-08 08:29:13 +02:00
Harald Welte 447521ba8b osmocom-nightly-packages: Fix libusrp and other non-osmocom builds
We're using the build() function not only to build osmocom projects
requiring a .tarball-version file, but also other projects such as
libusrp.  Let's make the related git-buildpackage arguments conditional
to whether or not a .tarball-version file exists at all.

Change-Id: I0312a6671e739b803beb583769e4dfc6f44fa091
2018-08-06 17:47:21 +02:00
Harald Welte 4e3c888398 osmocom-nightly-packages: Fix build of limesuite
We add a bogus .tarball-version file to make limesuite look like
osmocom projects.

Change-Id: Idbe34df54743d346cf4194d6ea377e886132042d
2018-08-06 14:17:56 +02:00
Harald Welte d8084ff514 osmocom-latest-packages: Add .tar.xz for new packages
If a new package is uploaded to OBS, prior to this change,
only the .dsc file is uploaded, not the actual .tar.xz containing
the source code.  Let's fix that.

Change-Id: Id1c9e6d112781004238a516b24dd446af0beb95a
2018-08-06 13:31:06 +02:00
Harald Welte aef62b0c77 osmocom packages: Ensure PACKAGE_VERSION is set correctly
At the "autorecon -fi" stage, Osmocom programs either need the .git
directory peresent, or a .tarball-version file in order to determine
the exact source code version.

Normally, "make dist" exists exactly for this purpose: It runs
git-version-gen and saves the result to .tarball-version, and we then
include this file in the .tar.gz we generate.

However, as the nightly paackaging scripts use git-buildpackage, it
bypasses the "make dist" logic and hence we need to

1) manually generate the .tarball-version file
2) copy it over to the directory specified as --git-export-dir

This way, the .tarball-version is inside the tar.xz generated by gbp,
and autoreconf then has something to use as PACKAGE_VERSION.

This commit fixes "UNKNOWN-dirty" in .pc files of libraries, as well
as in "show version" commands on the vty.

Closes: OS#3449
Change-Id: I76e3713f0b01a6110091ff90e8e53aa79533c374
2018-08-06 12:02:00 +02:00
Neels Hofmeyr e83f8a4737 scripts/verify_log_statements.py: on parse error, print file
If string eval encounters an uncovered parse error, it's useful to know which
file it happened in.

Change-Id: I5fe9a3bbdbfb8a995f24596bf09e70ca5bb3fe8a
2018-07-19 20:13:09 +02:00