aurora-packaging.git
2 months agoRemoving md5 hash from release script. 0.21.x master
Renan DelValle [Wed, 12 Sep 2018 19:47:22 +0000 (12:47 -0700)] 
Removing md5 hash from release script.

2 months agoMoving README link from git-wip-us to gitbox.
Renan DelValle [Wed, 12 Sep 2018 19:46:59 +0000 (12:46 -0700)] 
Moving README link from git-wip-us to gitbox.

4 months agoDeleting message on PR that would discourage making a PR as we could not accept them...
Renan DelValle [Tue, 31 Jul 2018 01:05:11 +0000 (18:05 -0700)] 
Deleting message on PR that would discourage making a PR as we could not accept them in the past. (#6)

Now that we can take PRs it doesn't make sense to discourage folks from making them.

4 months agoUpdating aurora-packaging for compatibility with Pants 1.6.0 and to reflect Mesos...
Renan DelValle [Fri, 27 Jul 2018 14:58:54 +0000 (07:58 -0700)] 
Updating aurora-packaging for compatibility with Pants 1.6.0 and to reflect Mesos 1.5.0 change

* Upgrading Trusty Box with python2.7 version that is has hmac.compare_digest support.
* Upgradinb Virtualenv to 16.0.0
* Upgrading to Mesos 1.5.0 on all test boxes.
* Upgrading Centos 7 box from 7.4 to 7.5
* Migrating from deprecated Pants --config-override to --config-files as per https://github.com/pantsbuild/pants/commit/e0d5108ff75a41421a11321c73c817332f0a1c86

Reviewed at https://reviews.apache.org/r/68078/

7 months agoMissing dependencies for aurora rpm (0.20.0) - Centos7
Peter Froehlich [Fri, 13 Apr 2018 17:56:06 +0000 (10:56 -0700)] 
Missing dependencies for aurora rpm (0.20.0) - Centos7

Added dependencies openssl-devel and libffi-devel for Centos7

Reviewed at https://reviews.apache.org/r/66603/

8 months agoAdding warning to potential contributors that we're not set up to take PRs through...
Renan DelValle [Tue, 10 Apr 2018 17:46:55 +0000 (10:46 -0700)] 
Adding warning to potential contributors that we're not set up to take PRs through github.

8 months agoFixing issue where OpenJDK PPA would not install in Ubuntu Trusty in packaging tests. 0.20.x
Renan DelValle [Fri, 6 Apr 2018 19:39:52 +0000 (12:39 -0700)] 
Fixing issue where OpenJDK PPA would not install in Ubuntu Trusty in packaging tests.

* Reinstalled certificates in Ubuntu trusty upon provisioning in order to fix an issue where the OpenJDK PPA could not be installed.
* Updated RBT to lastest version 0.7.11

Reviewed at https://reviews.apache.org/r/66482/

10 months agoUpdate packaging to latest Thrift, Mesos, and virtualenv
Stephan Erb [Wed, 10 Jan 2018 19:59:54 +0000 (20:59 +0100)] 
Update packaging to latest Thrift, Mesos, and virtualenv

* Remove the hardwired Thrift build dependency from the RPM and DEB packages.
  With the update to Thrift 0.10 and pants 1.4.0.dev23, the pants build script
  will download an appropriate Thrift compiler automatically.
* Add missing system dependencies missing by the latest pants version.
* Use latest virtualenv script from the main Aurora repo

Reviewed at https://reviews.apache.org/r/64825/

14 months agoSwitch packaging release checksum to sha512 0.19.x
Stephan Erb [Sun, 8 Oct 2017 16:59:24 +0000 (18:59 +0200)] 
Switch packaging release checksum to sha512

For our releases we will now be using .sha512 files rather than .sha files
containing sha1 checksums. This change is triggered by a recent update of
the Apache Release Distribution Policy.

Please see this mail for details:

```
Hi PMC,

    The Release Distribution Policy[1] changed regarding .sha files.
    See under "Cryptographic Signatures and Checksums Requirements" [2].

   Old policy :

     -- use extension .sha for any SHA checksum (SHA-1, SHA-256, SHA-512)

   New policy :

      -- use .sha1 for a SHA-1 checksum
      -- use .sha256 for a SHA-256 checksum
      -- use .sha512 for a SHA-512 checksum
      -- [*] .sha should contain a SHA-1

   Why this change ?

      -- Verifying a checksum under the old policy is/was not handy.
         You have to inspect the .sha to find out which algorithm
         should be used ; or try them all (SHA-1, SHA256, etc).
         The new scheme avoids this ambiguity.
      -- The last point[*] was only added for clarity. Most of the
         old, stale .sha's contain a SHA-1. The relatively new .sha's
         contain a SHA-512. The expectation is that the last catagory will
         disappear, when active projects adapt to the 'new' convention.

   Impact :

      -- Should be none ; many projects already use the 'new' convention.
      -- Please ask your release managers to use .sha1, .sha256, .sha512
         instead of the .sha extension.
      -- Please fix your build-tools if you have any.

   Piggyback :

      -- The policy requires a .md5 for every package ;
         providing a .sha512 is recommended.
         Since MD5 is essentially broken, it is to be expected that
         in the future a .sha512 will be required.
         Perhaps it is wize to start providing .sha512's
         with your releases if you do not already do so.

      -- Visit http://mirror-vm.apache.org/checker/
         to check the health of your /dist/-area ;
         my stuff ; any feedback is most welcome.

   Thanks ; regards,

   Henk Penning

    [1] http://www.apache.org/dev/release-distribution
    [2] http://www.apache.org/dev/release-distribution#sigs-and-sums
```

Reviewed at https://reviews.apache.org/r/62831/

14 months agoBuild with gradle 4.2
Bill Farner [Sun, 24 Sep 2017 16:49:40 +0000 (09:49 -0700)] 
Build with gradle 4.2

Reviewed at https://reviews.apache.org/r/62524/

14 months agoAdd ca-certificates-java to ubuntu-trusty Dockerfile
Nicolás Donatucci [Tue, 19 Sep 2017 21:32:59 +0000 (23:32 +0200)] 
Add ca-certificates-java to ubuntu-trusty Dockerfile

When building Aurora 0.17 and 0.18 debs I had an error because there were no
ca-certificates. Adding the ca-certificates-java to the apt-get step in the
Dockerfile fixes this for both 0.17 and 0.18

Reviewed at https://reviews.apache.org/r/62220/

15 months agoAttempted workaround for flaky nightly build
Stephan Erb [Sun, 3 Sep 2017 21:54:26 +0000 (23:54 +0200)] 
Attempted workaround for flaky nightly build

16 months agoFix observer themos extra arguments usage
Mikhail Lesyk [Thu, 3 Aug 2017 13:42:39 +0000 (15:42 +0200)] 
Fix observer themos extra arguments usage

Arguments variable is specified in /etc/default/thermos file
but is not used in any init script.

Reviewed at https://reviews.apache.org/r/61402/

16 months agoUpgrade Mesos version to 1.2.
Santhosh Kumar Shanmugham [Tue, 18 Jul 2017 18:27:28 +0000 (11:27 -0700)] 
Upgrade Mesos version to 1.2.

Reviewed at https://reviews.apache.org/r/60947/

21 months agoAdd basic test scripts for RPM and DEB packages
Stephan Erb [Tue, 14 Feb 2017 22:33:41 +0000 (23:33 +0100)] 
Add basic test scripts for RPM and DEB packages

This reduces some of the manual effort for verifying the binary packages.

Testing Done:
See the distribution specific README.md.

Reviewed at https://reviews.apache.org/r/56577/

22 months agoAdding support for Ubuntu Xenial packages
Renan DelValle [Wed, 8 Feb 2017 07:56:28 +0000 (08:56 +0100)] 
Adding support for Ubuntu Xenial packages

Added builder and test environment for Xenial as well as updated instructions
on how to test it. Added distribution to release-candidate script.

Bugs closed: AURORA-1872

Reviewed at https://reviews.apache.org/r/52437/

22 months agoUpdate packaging scripts for Mesos 1.1.0
Stephan Erb [Sat, 14 Jan 2017 13:23:11 +0000 (14:23 +0100)] 
Update packaging scripts for Mesos 1.1.0

Reviewed at https://reviews.apache.org/r/55507/

22 months agoOnly include basenames in package checksums
Stephan Erb [Sat, 14 Jan 2017 13:21:30 +0000 (14:21 +0100)] 
Only include basenames in package checksums

Before:
713c53c6ace65683bbb6f6e72881442cc4f7a243  /home/xxx/zzz/yyy/aurora-packaging/artifacts/aurora-debian-jessie/dist/aurora-tools_0.16.0-snapshot_amd64.deb

After:
713c53c6ace65683bbb6f6e72881442cc4f7a243  aurora-tools_0.16.0-snapshot_amd64.deb

Bugs closed: AURORA-1815

Reviewed at https://reviews.apache.org/r/55510/

2 years agoUpdate provisioning scripts for testing aurora packages.
Joshua Cohen [Tue, 25 Oct 2016 18:26:20 +0000 (13:26 -0500)] 
Update provisioning scripts for testing aurora packages.

Reviewed at https://reviews.apache.org/r/53064/

2 years agoClean up README for packaging repo, update release-candidate script to generate the...
Joshua Cohen [Tue, 25 Oct 2016 17:59:58 +0000 (12:59 -0500)] 
Clean up README for packaging repo, update release-candidate script to generate the vote email.

Reviewed at https://reviews.apache.org/r/53102/

2 years agoUse Gradle installDist task rather than installApp.
Stephan Erb [Wed, 12 Oct 2016 14:49:26 +0000 (16:49 +0200)] 
Use Gradle installDist task rather than installApp.

The latter was deprecated and finally removed in Gradle 3.0:

"The installApp task is no longer created by the application plugin
(use installDist instead)." https://docs.gradle.org/3.0/release-notes

Reviewed at https://reviews.apache.org/r/52777/

2 years agoUpdate to Gradle 3.1.
Stephan Erb [Thu, 6 Oct 2016 07:24:40 +0000 (09:24 +0200)] 
Update to Gradle 3.1.

Reviewed at https://reviews.apache.org/r/52579/

2 years agoAdd missing libffi build dep to support pants.
John Sirois [Fri, 30 Sep 2016 19:11:23 +0000 (13:11 -0600)] 
Add missing libffi build dep to support pants.

Reviewed at https://reviews.apache.org/r/52428/

2 years agoUse a fixed Debian mirror rather than relying on httpredir
Stephan Erb [Tue, 23 Aug 2016 16:23:23 +0000 (18:23 +0200)] 
Use a fixed Debian mirror rather than relying on httpredir

This is another attempt at a stable nightly package build. The currently most common error is:

```
E: Failed to fetch http://httpredir.debian.org/debian/pool/main/p/patch/patch_2.7.5-1_amd64.deb  Error reading from server. Remote end closed connection [IP: 5.153.231.35 80]

E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?
The command '/bin/sh -c apt-get update && apt-get -y install   bison   debhelper   devscripts   dpkg-dev   curl   git   libapr1-dev   libcurl4-openssl-dev   libkrb5-dev   libsvn-dev   python-all-dev   software-properties-common   thrift-compiler' returned a non-zero code: 100
```

Reviewed at https://reviews.apache.org/r/51301/

2 years agoUse Docker host network rather than bridging.
Stephan Erb [Tue, 2 Aug 2016 21:47:59 +0000 (23:47 +0200)] 
Use Docker host network rather than bridging.

The default bridge network is known to be slow (1) and potentially
flaky (2). Switching to host networking is a desperate attempt to reduce
flaps in our nightly package builds.

(1) https://github.com/docker/docker/issues/7857
(2) https://github.com/docker/docker/issues/11407

Reviewed at https://reviews.apache.org/r/50716/

2 years agoUpgrade aurora-packaging for Mesos 1.0.0.
Joshua Cohen [Mon, 1 Aug 2016 21:03:56 +0000 (16:03 -0500)] 
Upgrade aurora-packaging for Mesos 1.0.0.

Reviewed at https://reviews.apache.org/r/50669/

2 years agoUpdate package scripts to 0.15.0.
Maxim Khutornenko [Sat, 23 Jul 2016 16:40:56 +0000 (18:40 +0200)] 
Update package scripts to 0.15.0.

Reviewed at https://reviews.apache.org/r/49732/

2 years agoUpgrade to gradle 2.14.
John Sirois [Tue, 12 Jul 2016 01:13:00 +0000 (19:13 -0600)] 
Upgrade to gradle 2.14.

This complements the corresponding change in the aurora repo:
  https://reviews.apache.org/r/49899/

Reviewed at https://reviews.apache.org/r/49900/

2 years agoUpdate packaging for Aurora 0.14
Stephan Erb [Tue, 28 Jun 2016 22:01:33 +0000 (00:01 +0200)] 
Update packaging for Aurora 0.14

Reviewed at https://reviews.apache.org/r/49338/

2 years agoUpdate changelog 0.13.x
Stephan Erb [Mon, 20 Jun 2016 22:22:26 +0000 (00:22 +0200)] 
Update changelog

2 years agoUpdate test instructions for 0.13.0
Stephan Erb [Mon, 20 Jun 2016 22:08:19 +0000 (00:08 +0200)] 
Update test instructions for 0.13.0

2 years agoImprove consistency of the RPM and DEB default configuration
Stephan Erb [Mon, 20 Jun 2016 17:52:36 +0000 (19:52 +0200)] 
Improve consistency of the RPM and DEB default configuration

* Use identical scheduler default arguments
* Log to stderr rather than disk in all packages
* Use vagrant as the example role. It is available for all distributions
* Use the same clusters.json for all distributions
* Rename the clutername from main to example

Bugs closed: AURORA-1394

Reviewed at https://reviews.apache.org/r/48606/

2 years agoMake copy & paste of example jobs easier.
Stephan Erb [Sun, 12 Jun 2016 11:40:21 +0000 (13:40 +0200)] 
Make copy & paste of example jobs easier.

Otherwise, the leading whitespace will lead to invalid Python code that
needs to be fixed manually within the Vagrant box.

2 years agoUpdate centos test README.md according to package changes in a665227
Stephan Erb [Sun, 12 Jun 2016 11:32:09 +0000 (13:32 +0200)] 
Update centos test README.md according to package changes in a665227

2 years agoAdd changelog of previous package releases
Stephan Erb [Sun, 12 Jun 2016 11:23:33 +0000 (13:23 +0200)] 
Add changelog of previous package releases

2 years agoUpdate outdated references to the Apache Aurora incubator
Stephan Erb [Sun, 12 Jun 2016 11:22:42 +0000 (13:22 +0200)] 
Update outdated references to the Apache Aurora incubator

2 years agoUpdate RPM services and startup scripts to match our Debian packages.
Kasisnu Singh [Sun, 12 Jun 2016 10:54:55 +0000 (12:54 +0200)] 
Update RPM services and startup scripts to match our Debian packages.

Bugs closed: AURORA-1394

Reviewed at https://reviews.apache.org/r/48513/

2 years agoUpdate packaging to work with Aurora 0.13.
Stephan Erb [Sat, 28 May 2016 20:43:32 +0000 (22:43 +0200)] 
Update packaging to work with Aurora 0.13.

In addition to the minimal necessary packaging changes, I have tried
to align the tests of the different distributions.

A few differences remain. Those are mainly due to different defaults
in our DEBs and RPMs. I will leave this to another commit.

Reviewed at https://reviews.apache.org/r/47647/

2 years agoUse `gdebi` for auto dep resolution.
John Sirois [Mon, 2 May 2016 19:09:59 +0000 (13:09 -0600)] 
Use `gdebi` for auto dep resolution.

This makes us more robust to upstream packaging changes.  The `gdebi`
tool gives us `apt-get install` dependency calculation, fetching and
install for a local deb package.

Bugs closed: AURORA-1687

Reviewed at https://reviews.apache.org/r/46897/

2 years agoRemove some dependencies linked to docker usage
Pierre Cheynier [Wed, 20 Apr 2016 21:39:21 +0000 (15:39 -0600)] 
Remove some dependencies linked to docker usage

An operator should be able to build Aurora on his platform without
relying on Docker.

Even if this is an interesting way of doing it, it sometimes introduce missed
(build-)dependencies (in this case openssl) and context-specific behaviour
(here, the way pants.ini was added to the build context)

Testing Done:
Able to build on CentOS 6 using mock.
Able to build on Debian. Limitation = need the patched version of Gradle.
Still able to build using the current Docker build system

Bugs closed: AURORA-1568

Reviewed at https://reviews.apache.org/r/45298/

2 years agoRemove hard dependency on a specific mesos-version
Pierre Cheynier [Wed, 13 Apr 2016 13:34:01 +0000 (07:34 -0600)] 
Remove hard dependency on a specific mesos-version

We should consider MESOS_VERSION as the minimal requirement to install
the current Aurora version instead of enforce a specific Mesos version.

Reviewed at https://reviews.apache.org/r/45212/

2 years agoUpgrade build tools.
John Sirois [Mon, 4 Apr 2016 18:02:45 +0000 (12:02 -0600)] 
Upgrade build tools.

This complements the corresponding change in the aurora repo:
  https://reviews.apache.org/r/45661/

Reviewed at https://reviews.apache.org/r/45662/

2 years agoSupport for overriding --mesos-root under upstart.
John Sirois [Tue, 22 Mar 2016 23:24:04 +0000 (17:24 -0600)] 
Support for overriding --mesos-root under upstart.

Previously only the sysv init script supported overriding `--mesos-root`
via an env var, and thus via `/etc/default/thermos`.

Bugs closed: AURORA-1647

Reviewed at https://reviews.apache.org/r/45179/

2 years agoFixup rpm builder and test docs.
John Sirois [Mon, 14 Mar 2016 19:05:36 +0000 (13:05 -0600)] 
Fixup rpm builder and test docs.

This adjusts to fallout from https://reviews.apache.org/r/43936/ to get
the centos-7 builder working again and improves the test docs to include
both locally built rpm and released (or release candidate) rpm testing.

This change also imporves the `release-candidate` script to be
idempotent and handle missing binaries (ie: when only using a subset of
builders).

Reviewed at https://reviews.apache.org/r/44799/

2 years agoRemove cyrus-sasl and docker RPM dpendencies.
Bill Farner [Mon, 14 Mar 2016 17:39:27 +0000 (11:39 -0600)] 
Remove cyrus-sasl and docker RPM dpendencies.

I don't believe either of these dependencies are valid for the executor.

Reviewed at https://reviews.apache.org/r/44763/

2 years agoFixup rpm builder and tester.
John Sirois [Wed, 9 Mar 2016 17:43:14 +0000 (10:43 -0700)] 
Fixup rpm builder and tester.

This updates the mesos version from 0.23.0 to 0.25.0 and fixes
up the vagrant test environment and instructions.

NB: This change does attempt to address https://issues.apache.org/jira/browse/AURORA-1394

Bugs closed: AURORA-1568

Reviewed at https://reviews.apache.org/r/44527/

2 years agoIntroduce a helper script for preparing RCs.
John Sirois [Tue, 8 Mar 2016 21:47:13 +0000 (14:47 -0700)] 
Introduce a helper script for preparing RCs.

This is a bit piecemeal at the moment, but automates preparation of RC
artifacts created with `./build-artifact` for upload to bintray.

Basic docs are provided for preparing an RC, but more glue scripting is
still needed to make the process as smooth and automated as the main
aurora release.

Reviewed at https://reviews.apache.org/r/44530/

2 years agoCorrect url for source0
David Keijser [Wed, 9 Mar 2016 16:51:01 +0000 (09:51 -0700)] 
Correct url for source0

Trying to build aurora by running spectool and then rpmbuild fails because the url used does not match the release tags on github.

Reviewed at https://reviews.apache.org/r/43936/

2 years agoUpdate Thrift binary to point at new repository location for builds. rel/0.12.x
Martin Hrabovcin [Thu, 3 Mar 2016 00:47:40 +0000 (16:47 -0800)] 
Update Thrift binary to point at new repository location for builds.

Remove documentation pointing to non-existing YUM repo and use local builds in instructions.

Bugs closed: AURORA-1626

Reviewed at https://reviews.apache.org/r/44277/

2 years agoChange the way arguments are passed to scheduler in debian.
Kunal Thakar [Fri, 29 Jan 2016 21:09:52 +0000 (13:09 -0800)] 
Change the way arguments are passed to scheduler in debian.

Reviewed at https://reviews.apache.org/r/42975/

2 years agoWorking version of jessie builds.
Dmitriy Shirchenko [Thu, 21 Jan 2016 22:29:13 +0000 (14:29 -0800)] 
Working version of jessie builds.

Reviewed at https://reviews.apache.org/r/42387/

2 years agoAdapt to gradle upgrade in aurora repo.
John Sirois [Tue, 29 Dec 2015 00:54:04 +0000 (16:54 -0800)] 
Adapt to gradle upgrade in aurora repo.

Bugs closed: AURORA-1566

Reviewed at https://reviews.apache.org/r/41756/

2 years agoUpdate debian changelog. 0.11.x
Bill Farner [Wed, 23 Dec 2015 17:08:08 +0000 (09:08 -0800)] 
Update debian changelog.

2 years agoLower aurora-scheduler jdk req. to headless.
John Sirois [Mon, 21 Dec 2015 18:42:52 +0000 (10:42 -0800)] 
Lower aurora-scheduler jdk req. to headless.

Reviewed at https://reviews.apache.org/r/41610/

2 years agoAdd yum install of which for centos build, gradle uses that to find the jdk install.
Bill Farner [Sun, 20 Dec 2015 01:34:31 +0000 (17:34 -0800)] 
Add yum install of which for centos build, gradle uses that to find the jdk install.

2 years agoFix the ZK URI in the rpm.
Bill Farner [Fri, 18 Dec 2015 19:13:44 +0000 (11:13 -0800)] 
Fix the ZK URI in the rpm.

Reviewed at https://reviews.apache.org/r/41559/

2 years agoUpdate the scheduler DB paths in the RPM spec to match debs.
Bill Farner [Fri, 18 Dec 2015 18:10:04 +0000 (10:10 -0800)] 
Update the scheduler DB paths in the RPM spec to match debs.

Reviewed at https://reviews.apache.org/r/41558/

2 years agoUpdate mesos package versions.
Bill Farner [Fri, 18 Dec 2015 17:58:09 +0000 (09:58 -0800)] 
Update mesos package versions.

2 years agoShow how to build from source in README.md
Bill Farner [Fri, 18 Dec 2015 16:52:36 +0000 (08:52 -0800)] 
Show how to build from source in README.md

3 years agoFix ordering of RPM changelog entries.
Bill Farner [Wed, 2 Dec 2015 18:46:26 +0000 (10:46 -0800)] 
Fix ordering of RPM changelog entries.

3 years agoUpdate RPM changelog.
Bill Farner [Wed, 2 Dec 2015 18:34:15 +0000 (10:34 -0800)] 
Update RPM changelog.

3 years agoAURORA-1512: Aurora rpm missing std output switch
Jake Farrell [Mon, 30 Nov 2015 17:41:41 +0000 (09:41 -0800)] 
AURORA-1512: Aurora rpm missing std output switch

Bugs closed: AURORA-1512

Reviewed at https://reviews.apache.org/r/38975/

3 years agoRemove `--root` flag in observer start scripts.
John Sirois [Thu, 26 Nov 2015 18:23:25 +0000 (10:23 -0800)] 
Remove `--root` flag in observer start scripts.

The flag was removed in 1b1c70c79a0b4a96263508c5918d6d9d0646f8ec in the
aurora repo and start scripts were updated there but not here.

Bugs closed: AURORA-1338

Reviewed at https://reviews.apache.org/r/40757/

3 years agoAdd changelog entry for 0.10.0.
Bill Farner [Thu, 26 Nov 2015 16:19:51 +0000 (08:19 -0800)] 
Add changelog entry for 0.10.0.

3 years agoAdd deps to centos 7 image to handle thrift patch.
John Sirois [Wed, 25 Nov 2015 16:25:21 +0000 (08:25 -0800)] 
Add deps to centos 7 image to handle thrift patch.

The thrift Makefile now applies a patch that invalidates the grammar
requiring a flex pass.  The openssl package is needed as well to support
the new fingerprint checks in the Makefile.

Additionally, simplify the `pants.ini` used by both rpm and deb builds
and turn on exception printing to help debug build failures more easily
when packaging.

Reviewed at https://reviews.apache.org/r/40680/

3 years agoRemove unnecessary volume mount argument.
Bill Farner [Tue, 24 Nov 2015 19:42:14 +0000 (11:42 -0800)] 
Remove unnecessary volume mount argument.

Reviewed at https://reviews.apache.org/r/40666/

3 years agoAdjust pants env values for latest pants version.
Bill Farner [Tue, 24 Nov 2015 19:25:52 +0000 (11:25 -0800)] 
Adjust pants env values for latest pants version.

Bugs closed: AURORA-1544

Reviewed at https://reviews.apache.org/r/40629/

3 years agoCopy artifacts from containers rather than using volume mounts.
Bill Farner [Tue, 24 Nov 2015 19:24:19 +0000 (11:24 -0800)] 
Copy artifacts from containers rather than using volume mounts.

Bugs closed: AURORA-1539

Reviewed at https://reviews.apache.org/r/40658/

3 years agoAURORA-1477: Unify RPM and DEB package names
jfarrell [Wed, 18 Nov 2015 14:16:52 +0000 (09:16 -0500)] 
AURORA-1477: Unify RPM and DEB package names

Patch to unify RPM and DEB package names as: aurora-scheduler, aurora-executor, aurora-tools

3 years agoUse gradle 2.7 in builds.
Bill Farner [Thu, 8 Oct 2015 04:08:47 +0000 (21:08 -0700)] 
Use gradle 2.7 in builds.

Reviewed at https://reviews.apache.org/r/39113/

3 years agoAdd test environments for RPMs and debs.
Bill Farner [Wed, 9 Sep 2015 22:19:36 +0000 (15:19 -0700)] 
Add test environments for RPMs and debs.

Reviewed at https://reviews.apache.org/r/38086/

3 years agoBuilder should run createrepo
Kevin Sweeney [Thu, 3 Sep 2015 01:26:18 +0000 (18:26 -0700)] 
Builder should run createrepo

Testing Done:
Tested on 0.9.x branch

Reviewed at https://reviews.apache.org/r/38084/

3 years agoRemove openjdk runtime requirement.
Kevin Sweeney [Thu, 3 Sep 2015 00:45:46 +0000 (17:45 -0700)] 
Remove openjdk runtime requirement.

This addresses one of my +0s.

Testing Done:
Using a clean vagrant environment installed aurora, then installed the
oracle jdk, then uninstalled java-1.8.0-openjdk-headless (that aurora
brought in transitively). RPM didn't complain and when I restarted
the scheduler it was running under the new JVM.

```
[vagrant@localhost ~]$ curl -s http://localhost:8081/vars | grep 'jvm_prop_java_vendor '
jvm_prop_java_vendor Oracle Corporation
[vagrant@localhost ~]$
```

Reviewed at https://reviews.apache.org/r/38080/

3 years agoReset RPM changelog.
Bill Farner [Mon, 31 Aug 2015 17:14:36 +0000 (10:14 -0700)] 
Reset RPM changelog.

Reviewed at https://reviews.apache.org/r/37959/

3 years agoDeb: move clusters.json from aurora-executor to aurora-tools package.
Bill Farner [Sat, 29 Aug 2015 16:39:21 +0000 (09:39 -0700)] 
Deb: move clusters.json from aurora-executor to aurora-tools package.

Reviewed at https://reviews.apache.org/r/37924/

3 years agoRpm: remove daemonize dep for rhel >=7.
Bill Farner [Thu, 27 Aug 2015 23:09:57 +0000 (16:09 -0700)] 
Rpm: remove daemonize dep for rhel >=7.

Reviewed at https://reviews.apache.org/r/37862/

3 years agoAdd a convenience to build all artifacts.
Bill Farner [Thu, 27 Aug 2015 23:09:21 +0000 (16:09 -0700)] 
Add a convenience to build all artifacts.

Reviewed at https://reviews.apache.org/r/37861/

3 years agoRpm: replace hyphens from version.
Bill Farner [Wed, 26 Aug 2015 19:03:06 +0000 (12:03 -0700)] 
Rpm: replace hyphens from version.

Reviewed at https://reviews.apache.org/r/37806/

3 years agoFix RPM building.
Bill Farner [Wed, 26 Aug 2015 17:46:29 +0000 (10:46 -0700)] 
Fix RPM building.

Bugs closed: AURORA-851

Reviewed at https://reviews.apache.org/r/37772/

3 years agoDeb: Clean up changelog generation.
Bill Farner [Wed, 26 Aug 2015 17:04:55 +0000 (10:04 -0700)] 
Deb: Clean up changelog generation.

Reviewed at https://reviews.apache.org/r/37788/

3 years agoReset deb changelog.
Bill Farner [Wed, 26 Aug 2015 17:03:11 +0000 (10:03 -0700)] 
Reset deb changelog.

Reviewed at https://reviews.apache.org/r/37800/

3 years agoUpdate packages for post 0.9.0 changes.
Bill Farner [Tue, 25 Aug 2015 17:43:45 +0000 (10:43 -0700)] 
Update packages for post 0.9.0 changes.

Bugs closed: AURORA-851

Reviewed at https://reviews.apache.org/r/37764/

3 years agoReplace realpath to get build working on jenkins.
Bill Farner [Tue, 25 Aug 2015 02:28:55 +0000 (19:28 -0700)] 
Replace realpath to get build working on jenkins.

Reviewed at https://reviews.apache.org/r/37743/

3 years agoParameterize artifact version in builders.
Bill Farner [Mon, 24 Aug 2015 22:19:10 +0000 (15:19 -0700)] 
Parameterize artifact version in builders.

Bugs closed: AURORA-1410

Reviewed at https://reviews.apache.org/r/37731/

3 years agoDeb: Remove defunct default argument.
Bill Farner [Mon, 24 Aug 2015 20:10:40 +0000 (13:10 -0700)] 
Deb: Remove defunct default argument.

Reviewed at https://reviews.apache.org/r/37727/

3 years agoAdd a tool and environment for building Aurora packages.
Bill Farner [Mon, 24 Aug 2015 17:11:18 +0000 (10:11 -0700)] 
Add a tool and environment for building Aurora packages.

Bugs closed: AURORA-1410

Reviewed at https://reviews.apache.org/r/37107/

3 years agoAdd reviewboard configuration.
Bill Farner [Tue, 4 Aug 2015 22:00:03 +0000 (15:00 -0700)] 
Add reviewboard configuration.

Bugs closed: AURORA-1427

Reviewed at https://reviews.apache.org/r/37100/

3 years agoReorganize repository layout.
Bill Farner [Tue, 4 Aug 2015 21:45:07 +0000 (14:45 -0700)] 
Reorganize repository layout.

3 years agoBuild Kerberos clients in RPM.
Kevin Sweeney [Mon, 3 Aug 2015 19:21:09 +0000 (12:21 -0700)] 
Build Kerberos clients in RPM.

Testing Done:
None - I don't have a test environment for RPMs.

Bugs closed: AURORA-1410

Reviewed at https://reviews.apache.org/r/37047/

3 years agoOne python_library per exported setup.py project
Kevin Sweeney [Mon, 3 Aug 2015 18:41:33 +0000 (11:41 -0700)] 
One python_library per exported setup.py project

This is a mostly red code diff and makes the pants build work similar to
how it already works in an IDE environment while minimizing duplicated
information. This change also removes the confusing versions of
`thermos` and `thermos_observer` in favor of new ones. Because of the
way "covering dependencies" were required it was easier to do this
refactor than more tactically create a working `setup_py` target for
`apache.aurora.tools` without cycles and without duplicated files.

* Remove the `apache.thermos` package.
* Rename the `apache.gen.aurora` package to `apache.aurora.thrift`.
* Rename the `apache.gen.thermos` package to `apache.thermos.thrift`.
* Introduce a new `apache.aurora.tools` package with the `thermos` and `thermos_observer` binaries.
* Create apache.thermos.runner package, rename `thermos/bin` to `thermos/runner`.
* Remove all `*-packaged` and virtual dependency trees, as well as the phrase "covering dependencies."
* Use `_`-prefix naming convention for private target names.
* Replace manual list of targets in `make-python-sdists` with automatically-generated one (using new convention).
* Introduce a new `apache.aurora.kerberos` package with the `kaurora` and `kaurora_admin` binaries.
* Remove all `BUILD` files in `src/main` that don't contain an exported `setup.py` library (except one mentioned in TODO).
* Use dictionary syntax in `with_binaries`.
* Remove unused/unreachable binaries (most `bin/` dirs under `thermos/`).
* Create blank `__init__.py` files in directories that pants warns aren't packages.
* Added `thermos` command to vagrant image.

Testing Done:
./pants test.pytest --no-fast src/test/python::
./build-support/python/make-python-sdists
./src/test/sh/org/apache/aurora/e2e/test_end_to_end.sh
./build-support/python/make-pycharm-virtualenv

Manually checked that `thermos status` works.

I don't have a test environment for the debian package or the spec file.

Documentation pushed to https://github.com/kevints/aurora/blob/36972/docs/build-system.md

Bugs closed: AURORA-1381

Reviewed at https://reviews.apache.org/r/36972/

3 years agoUse the correct (aurora-specific) python build targets in RPM and deb scripts.
Bill Farner [Thu, 30 Jul 2015 17:53:11 +0000 (10:53 -0700)] 
Use the correct (aurora-specific) python build targets in RPM and deb scripts.

Reviewed at https://reviews.apache.org/r/36945/

3 years agoUpdates debian rules to use different thermos_observer.
Andrew Jorgensen [Tue, 21 Jul 2015 20:26:29 +0000 (13:26 -0700)] 
Updates debian rules to use different thermos_observer.

The old thermos_observer is missing the --mesos-root flag thats needed
to tell the thermos_observer where it can find the mesos root directory.
It currently defaults to /var/lib/mesos in the old observer entry point.

Testing Done:
1. Built aurora with dpkg-buildpackage -us -uc -d
2. Installed executor deb: dpkg --install aurora-executor_0.9.0-SNAPSHOT_amd64.deb
3. thermos_observer --long-help
Options:
  -h, --help, --short-help
                        show this help message and exit.
  --long-help           show options from all registered modules, not just the
                        __main__ module.
  --root=ROOT           The thermos checkpoint root directory to search for
                        Thermos tasks [default: /var/run/thermos]
  --mesos-root=MESOS_ROOT
                        The mesos root directory to search for Thermos
                        executor sandboxes [default: /var/lib/mesos]
  --port=PORT           The port on which the observer should listen.
                        [default: 1338]
  --polling_interval_secs=POLLING_INTERVAL_SECS
                        The number of seconds between observer refresh
                        attempts. [default: 5]

I am in the process of building and deploying this change to production and can report
back when that is complete.

Bugs closed: AURORA-1403

Reviewed at https://reviews.apache.org/r/36644/

3 years agoRemoves version on virtual pacakge in debian control
Andrew Jorgensen [Wed, 15 Jul 2015 18:35:01 +0000 (11:35 -0700)] 
Removes version on virtual pacakge in debian control

java-runtime-headless is a virtual package and cannot have a version
specified. The consequence of this is that the built packages require openjdk-8
be installed which prevented the packages from working with oracle-java8.
java8-runtime-headless is a virtual package provided by both openjdk-8
and oracle-java8 so the resulting debian packages can be installed on a
machine with either versions of java8 installed.

Testing Done:
Started two docker containers, one with oracle-java8 and the other with
openjdk-8. I was able to install the aurora-scheduler package in both containers
with this change.

Bugs closed: AURORA-1400

Reviewed at https://reviews.apache.org/r/36511/

3 years agoTidying RPM packaging README and specfile
Steve Salevan [Tue, 14 Jul 2015 17:50:34 +0000 (10:50 -0700)] 
Tidying RPM packaging README and specfile

Bugs closed: AURORA-1391

Reviewed at https://reviews.apache.org/r/36370/

3 years agoUpgrade gradle version dependencies in rpm/deb specs.
Bill Farner [Thu, 9 Jul 2015 21:28:20 +0000 (14:28 -0700)] 
Upgrade gradle version dependencies in rpm/deb specs.

Reviewed at https://reviews.apache.org/r/36365/

3 years agoAdds RPM specfile and support scripting
Steve Salevan [Mon, 6 Jul 2015 21:57:34 +0000 (14:57 -0700)] 
Adds RPM specfile and support scripting

Bugs closed: AURORA-1116

Reviewed at https://reviews.apache.org/r/33778/

3 years agoRemoving GC executor code.
Maxim Khutornenko [Thu, 25 Jun 2015 20:49:15 +0000 (13:49 -0700)] 
Removing GC executor code.

Bugs closed: AURORA-1333

Reviewed at https://reviews.apache.org/r/35813/

3 years agoRemoving GcExecutorLauncher code.
Maxim Khutornenko [Tue, 23 Jun 2015 18:08:55 +0000 (11:08 -0700)] 
Removing GcExecutorLauncher code.

Bugs closed: AURORA-1334

Reviewed at https://reviews.apache.org/r/35760/

3 years agoNative Debian packaging for Aurora
Benjamin Staffin [Mon, 15 Jun 2015 14:31:22 +0000 (10:31 -0400)] 
Native Debian packaging for Aurora

This uses Debian package dependencies to install gradle and thrift-compiler.  Gradle 2.x isn't in Debian or Ubuntu yet, but you can build your own package easily enough using https://github.com/benley/gradle-packaging

Testing Done:
Built debs in a clean Ubuntu 14.04 environment using git-buildpackage and pbuilder. Have been using debs built from this branch on a testing cluster for a few months now.

Bugs closed: AURORA-951

Reviewed at https://reviews.apache.org/r/31101/