bigtop.git
2 years agoBump spark-core_2.10 from 2.1.0 to 2.2.2 dependabot/maven/org.apache.spark-spark-core_2.10-2.2.2 574/head
dependabot[bot] [Fri, 13 Dec 2019 01:27:58 +0000 (01:27 +0000)] 
Bump spark-core_2.10 from 2.1.0 to 2.2.2

Bumps spark-core_2.10 from 2.1.0 to 2.2.2.

Signed-off-by: dependabot[bot] <support@github.com>
2 years agoBIGTOP-3223: Add smoke tests for Elasticsearch
Jun He [Thu, 5 Dec 2019 07:32:00 +0000 (15:32 +0800)] 
BIGTOP-3223: Add smoke tests for Elasticsearch

Implement smoke tests for Elasticsearch

Change-Id: I3f448513688d2a789fba5d59d5e24f61e1811099
Signed-off-by: Jun He <jun.he@arm.com>
2 years agoBIGTOP-3222: Add puppet deployment for Elasticsearch
Jun He [Tue, 3 Dec 2019 06:08:03 +0000 (14:08 +0800)] 
BIGTOP-3222: Add puppet deployment for Elasticsearch

Implement puppet deployment recipes for Elasticsearch

Change-Id: I31a23ac5461c72b2f7bce3edad2d7104e760c354
Signed-off-by: Jun He <jun.he@arm.com>
2 years agoBIGTOP-3221: Add support for Elasticsearch rpm build
Jun He [Thu, 21 Nov 2019 05:46:47 +0000 (13:46 +0800)] 
BIGTOP-3221: Add support for Elasticsearch rpm build

Add rpm packaging script for Elasticsearch artifacts

Change-Id: Id6276a321d022a1276c11bf0e11a27ddabdc623f
Signed-off-by: Jun He <jun.he@linaro.org>
2 years agoBIGTOP-3220: Add deb build for Elasticsearch
Jun He [Wed, 30 Oct 2019 10:23:11 +0000 (18:23 +0800)] 
BIGTOP-3220: Add deb build for Elasticsearch

Change-Id: Ia08ae5d6f00799469c8ee44ad73d5440a00e329e
Signed-off-by: Jun He <jun.he@linaro.org>
2 years agoBIGTOP-3029: --parser is invalidated in puppet v4.x (addendum)
Kengo Seki [Tue, 26 Nov 2019 23:56:45 +0000 (08:56 +0900)] 
BIGTOP-3029: --parser is invalidated in puppet v4.x (addendum)

Signed-off-by: Kengo Seki <sekikn@apache.org>
2 years agoBIGTOP-3029: --parser is invalidated in puppet v4.x
Guodong Xu [Tue, 15 May 2018 12:08:28 +0000 (20:08 +0800)] 
BIGTOP-3029: --parser is invalidated in puppet v4.x

Starting from puppet 4.x, --parse is not a valid option for puppet any more.
This results in when running in pre-built image
bigtop/slaves:trunk-debian-9-aarch64 and :trunk-debian-9, we see this error:

$ sudo docker run -it --rm --workdir /ws  -v `pwd`:/ws bigtop/slaves:trunk-debian-9-aarch64 bash -l

root@b40443df7cce:/ws# ./gradlew toolchain
Error: Could not parse application options: invalid option: --parser

This patch adds puppet version check in task toolchain. "--parser future" is
added into command only in puppet version 3.x

Signed-off-by: Guodong Xu <guodong.xu@linaro.org>
Signed-off-by: Kengo Seki <sekikn@apache.org>
2 years agoBIGTOP-3266: Rat check failed for one file with unapproved/unknown licenses
Yuqi Gu [Thu, 31 Oct 2019 01:23:27 +0000 (01:23 +0000)] 
BIGTOP-3266: Rat check failed for one file with unapproved/unknown licenses

Add .dockerignore to Rat exclude-file list.

Change-Id: Ia4a052db2df7d1e8e87bcde3304ea401a706759b
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
2 years agoBIGTOP-3268: zookeeper charm: nagios config opts
John Losito [Tue, 29 Oct 2019 14:19:37 +0000 (10:19 -0400)] 
BIGTOP-3268: zookeeper charm: nagios config opts

Closes #556

Signed-off-by: John Losito <john.losito@canonical.com>
Signed-off-by: Kevin W Monroe <kevin.monroe@canonical.com>
2 years agoBIGTOP-3015: juju bundle: remove 'client' from hadoop-spark
jamesbeedy [Wed, 21 Mar 2018 17:43:29 +0000 (10:43 -0700)] 
BIGTOP-3015: juju bundle: remove 'client' from hadoop-spark

Closes #348

Signed-off-by: Kevin W Monroe <kevin.monroe@canonical.com>
2 years agoBIGTOP-3092: kafka charm: support juju storage
Casey Marshall [Sat, 22 Sep 2018 11:30:37 +0000 (13:30 +0200)] 
BIGTOP-3092: kafka charm: support juju storage

Closes #400

Signed-off-by: Kevin W Monroe <kevin.monroe@canonical.com>
2 years agoBIGTOP-3261 Fix broken BPS Dockerfile
Ben [Thu, 30 May 2019 00:09:23 +0000 (20:09 -0400)] 
BIGTOP-3261 Fix broken BPS Dockerfile

Update dockerfile to remove dependency on gradle and use only docker for the build.

Signed-off-by: Youngwoo Kim <ywkim@apache.org>
2 years agoBIGTOP-3259. Update the default stack version for docker-provisioner to 1.4.0
Kengo Seki [Sun, 20 Oct 2019 11:13:24 +0000 (20:13 +0900)] 
BIGTOP-3259. Update the default stack version for docker-provisioner to 1.4.0

Signed-off-by: Youngwoo Kim <ywkim@apache.org>
2 years agoBIGTOP-3168: Kafka smoke tests implementation (#537)
Yuqi [Fri, 9 Aug 2019 04:13:32 +0000 (12:13 +0800)] 
BIGTOP-3168: Kafka smoke tests implementation (#537)

* BIGTOP-3168: Kafka smoke tests implementation

Add Kafka smoke tests.

Change-Id: I19fe02fa74bab2c539e2e9aca62b8940927471da
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
* Remove 'ZK Server start' and 'Kafka server start'

Change-Id: I50a7ccae5249a816772e0dce7ff0c294582d1001

* Delete kafka topics

Change-Id: Icdf1e9590b8e38ff7a3ddca14dc20ecf5fd02341
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
* Keep broker unchanged.

Change-Id: I351592cf37af6b2b755f326b1d01a2c2a9a41b77

2 years agoBIGTOP-3217. Added smoke tests for Livy (#534)
Aki Tanaka [Wed, 24 Jul 2019 17:06:24 +0000 (10:06 -0700)] 
BIGTOP-3217. Added smoke tests for Livy (#534)

2 years agoBIGTOP-3208. Exception in master branch (and branch-1.4): kafka-server failed to...
Evans Ye [Sat, 13 Jul 2019 17:26:12 +0000 (01:26 +0800)] 
BIGTOP-3208. Exception in master branch (and branch-1.4): kafka-server failed to launch due to missing zookeeper AsyncCallback.MultiCallback (#536)

* Revert "BIGTOP-3185. Bump Kafka to 2.1.1 (#493)"

This reverts commit ca52568591010884687ac7616d09d97c63a89ebf.

* Revert "BIGTOP-3187. Bump Flume to 1.9.0"

This reverts commit 173d80e381cf8b527812e321f1908d90aeba9823.

* Revert "BIGTOP-3171. Update Kafka Puppet module for version 1.1.1 (#477)"

This reverts commit 6d5705e3e023caae39410888713f7bbf77578e09.

* Revert "BIGTOP-3164. Bump Kafka to 1.1.1 (#476)"

This reverts commit 12cb0ad24edb29e8cdac8d571a0472814629a40f.

3 years agoBigtop 1.4.0 website update
Evans Ye [Sun, 16 Jun 2019 04:29:37 +0000 (12:29 +0800)] 
Bigtop 1.4.0 website update

3 years agoBigtop 1.4.0 website update
Evans Ye [Sun, 16 Jun 2019 04:15:32 +0000 (12:15 +0800)] 
Bigtop 1.4.0 website update

3 years ago[BIGTOP-2961] Add Livy packages (#527)
Evans Ye [Sun, 26 May 2019 18:59:28 +0000 (02:59 +0800)] 
[BIGTOP-2961] Add Livy packages (#527)

3 years agoBIGTOP-3214. Install python libraries for Livy (#530)
Aki Tanaka [Sun, 26 May 2019 18:59:05 +0000 (11:59 -0700)] 
BIGTOP-3214. Install python libraries for Livy (#530)

3 years agoBIGTOP-3215. Failed to build bigtop/puppet image for OpenSuSE (#531)
Evans Ye [Fri, 24 May 2019 15:30:49 +0000 (23:30 +0800)] 
BIGTOP-3215. Failed to build bigtop/puppet image for OpenSuSE (#531)

3 years agoBIGTOP-3216: Flink smoke test failed on Debian-9 (#533)
Jun [Fri, 24 May 2019 15:09:37 +0000 (23:09 +0800)] 
BIGTOP-3216: Flink smoke test failed on Debian-9 (#533)

Flink cannot get hdfs's defaultFS info on debian. Fix this by explicitly use
defaultFS uri retrieved from command

Change-Id: I648e10da3fd39d6daa9ae0079a47b075260c67ea
Signed-off-by: Jun He <jun.he@linaro.org>
3 years agoBigtop 1.4.0 release
Evans Ye [Sun, 5 May 2019 06:39:53 +0000 (14:39 +0800)] 
Bigtop 1.4.0 release

3 years agoBIGTOP-3213. Bugs in pom.xml files when releasing Bigtop 1.4.0 (#528)
Evans Ye [Sun, 5 May 2019 06:10:52 +0000 (14:10 +0800)] 
BIGTOP-3213. Bugs in pom.xml files when releasing Bigtop 1.4.0 (#528)

3 years agoBIGTOP-3212. Deploy QFS client failed due to no such directory error (#525)
Evans Ye [Sun, 5 May 2019 06:09:30 +0000 (14:09 +0800)] 
BIGTOP-3212. Deploy QFS client failed due to no such directory error (#525)

3 years agoBIGTOP-3210. Missing /lib/lsb/init-functions when deploying Flink on Fedora 26 (...
Evans Ye [Sun, 5 May 2019 06:08:10 +0000 (14:08 +0800)] 
BIGTOP-3210. Missing /lib/lsb/init-functions when deploying Flink on Fedora 26 (#523)

3 years agoBIGTOP-3206. Missing /etc/init.d/functions when deploying Alluxio on Fedora 26 (...
Evans Ye [Sun, 5 May 2019 06:07:00 +0000 (14:07 +0800)] 
BIGTOP-3206. Missing /etc/init.d/functions when deploying Alluxio on Fedora 26 (#517)

3 years ago[BIGTOP-2961] Add Livy packages 527/head
Aki Tanaka [Sat, 9 Mar 2019 02:24:37 +0000 (02:24 +0000)] 
[BIGTOP-2961] Add Livy packages

3 years agoBIGTOP-3204. Bump Flink to 1.6.4 (#522)
Guodong Xu [Mon, 22 Apr 2019 04:51:27 +0000 (12:51 +0800)] 
BIGTOP-3204. Bump Flink to 1.6.4 (#522)

Bump Flink version from 1.4.2 to 1.6.4. There are three changes involved:
1. obviously, version number
2. in Flink 1.6.4, there is no 'resources' folder any more. Removed it.
3. set mode to 'legacy'

Starting from Flink v1.5, there is a rewrite of Flinkā€™s deployment and process
model (internally known as FLIP-6). A new option 'mode' was introduced to
indicate which executions to use. However, the way Bigtop puppet deploys
'flink-jobmanager' and 'flink-taskmanager', ie. calling 'flink-daemon.sh
jobmanager' and 'flink-daemon.sh taskmanager', is legacy. Without setting
mode to 'legacy', flink's built-in exmaples fail with error
"JobSubmissionException: Failed to submit JobGraph"

Signed-off-by: Guodong Xu <guodong.xu@linaro.org>
3 years agoBIGTOP-3207. [Provisioner] Do not exit when destroying got no cluster exists (#519)
Evans Ye [Sat, 20 Apr 2019 18:32:32 +0000 (02:32 +0800)] 
BIGTOP-3207. [Provisioner] Do not exit when destroying got no cluster exists (#519)

3 years agoBIGTOP-3203. [Sandbox] Architecture string is a mess for Distributions (#515)
Evans Ye [Sat, 30 Mar 2019 18:18:29 +0000 (02:18 +0800)] 
BIGTOP-3203. [Sandbox] Architecture string is a mess for Distributions (#515)

3 years agoBIGTOP-3198. [Sandbox] Support AARCH64/PPC64LE (#510)
Evans Ye [Fri, 29 Mar 2019 14:50:03 +0000 (22:50 +0800)] 
BIGTOP-3198. [Sandbox] Support AARCH64/PPC64LE (#510)

3 years agoBIGTOP-3199. Can not run smoke test inside docker-provisioner (#509)
Evans Ye [Fri, 29 Mar 2019 14:42:13 +0000 (22:42 +0800)] 
BIGTOP-3199. Can not run smoke test inside docker-provisioner (#509)

3 years agoBIGTOP-3200. Bugfix Integration test framework 2.0 and documentation (#513)
Evans Ye [Fri, 29 Mar 2019 03:44:54 +0000 (11:44 +0800)] 
BIGTOP-3200. Bugfix Integration test framework 2.0 and documentation (#513)

3 years agoBIGTOP-3197. [Docker] Treat both exit code 0 and 2 as success for Puppet execution...
Evans Ye [Tue, 26 Mar 2019 08:57:56 +0000 (16:57 +0800)] 
BIGTOP-3197. [Docker] Treat both exit code 0 and 2 as success for Puppet execution (#507)

3 years agoBIGTOP-3197. [Docker] Treat both exit code 0 and 2 as success for Puppet execution...
Evans Ye [Tue, 26 Mar 2019 08:57:21 +0000 (16:57 +0800)] 
BIGTOP-3197. [Docker] Treat both exit code 0 and 2 as success for Puppet execution (#506)

3 years agoBumping up the version to 1.5.0-SNAPSHOT
Evans Ye [Sun, 24 Mar 2019 15:19:15 +0000 (23:19 +0800)] 
Bumping up the version to 1.5.0-SNAPSHOT

3 years agoPreparing for release 1.4.0
Evans Ye [Sun, 24 Mar 2019 15:10:50 +0000 (23:10 +0800)] 
Preparing for release 1.4.0

3 years agoBIGTOP-3195. Add pkgs-ind to package all artifacts inside docker (#504)
Evans Ye [Sun, 24 Mar 2019 14:57:35 +0000 (22:57 +0800)] 
BIGTOP-3195. Add pkgs-ind to package all artifacts inside docker (#504)

3 years agoBIGTOP-3196. Drop Apache Crunch in Bigtop distribution (#505)
Evans Ye [Sun, 24 Mar 2019 14:57:21 +0000 (22:57 +0800)] 
BIGTOP-3196. Drop Apache Crunch in Bigtop distribution (#505)

3 years agoBIGTOP-3192. Remove Spark 1.6 from the stack
Konstantin Boudnik [Sun, 17 Mar 2019 23:49:04 +0000 (19:49 -0400)] 
BIGTOP-3192. Remove Spark 1.6 from the stack

Removing Spark 1.6 component from the stack

3 years agoBIGTOP-3195. Add pkgs-ind to package all artifacts inside docker 504/head
Evans Ye [Sat, 23 Mar 2019 10:38:03 +0000 (18:38 +0800)] 
BIGTOP-3195. Add pkgs-ind to package all artifacts inside docker

3 years agoBIGTOP-3194. Fix Phoenix QueryServer PID file name (#503)
JunyangLi [Sat, 23 Mar 2019 10:14:08 +0000 (03:14 -0700)] 
BIGTOP-3194. Fix Phoenix QueryServer PID file name (#503)

3 years agoBIGTOP-3193. Add REPO and MEMORY as options for docker-provisioner (#502)
Evans Ye [Wed, 20 Mar 2019 15:19:25 +0000 (23:19 +0800)] 
BIGTOP-3193. Add REPO and MEMORY as options for docker-provisioner (#502)

3 years agoBIGTOP-3142. Better user expereince when calling docker-hadoop.sh -d with no cluster...
Evans Ye [Mon, 18 Mar 2019 15:53:48 +0000 (23:53 +0800)] 
BIGTOP-3142. Better user expereince when calling docker-hadoop.sh -d with no cluster running (#500)

3 years agoBIGTOP-3190. Missing newline in Compatibility issue for Zeppelin with Spark 2.2.3...
Evans Ye [Sat, 16 Mar 2019 15:58:13 +0000 (23:58 +0800)] 
BIGTOP-3190. Missing newline in Compatibility issue for Zeppelin with Spark 2.2.3 (#501)

3 years agoBIGTOP-3190. Compatibility issue for Zeppelin with Spark 2.2.3 (#499)
Evans Ye [Sat, 16 Mar 2019 04:16:53 +0000 (12:16 +0800)] 
BIGTOP-3190. Compatibility issue for Zeppelin with Spark 2.2.3 (#499)

3 years agoBIGTOP-3191. Old Gradle version causes Kafka 2.1.1 build failed (#498)
Evans Ye [Fri, 15 Mar 2019 16:25:13 +0000 (00:25 +0800)] 
BIGTOP-3191. Old Gradle version causes Kafka 2.1.1 build failed (#498)

3 years agoRevert "BIGTOP-3188. Bump Zeppelin to 0.8.1" (#497)
Evans Ye [Fri, 15 Mar 2019 07:04:05 +0000 (15:04 +0800)] 
Revert "BIGTOP-3188. Bump Zeppelin to 0.8.1" (#497)

3 years agoBIGTOP-3189. Allow to specify more properties/options at command line for docker...
Evans Ye [Thu, 14 Mar 2019 17:13:06 +0000 (01:13 +0800)] 
BIGTOP-3189. Allow to specify more properties/options at command line for docker provisioner (#491)

3 years agoMerge pull request #496 from evans-ye/BIGTOP-3188
Evans Ye [Thu, 14 Mar 2019 17:07:45 +0000 (01:07 +0800)] 
Merge pull request #496 from evans-ye/BIGTOP-3188

BIGTOP-3188. Bump Zeppelin to 0.8.1

3 years agoMerge pull request #494 from evans-ye/BIGTOP-3187
Evans Ye [Thu, 14 Mar 2019 17:02:04 +0000 (01:02 +0800)] 
Merge pull request #494 from evans-ye/BIGTOP-3187

BIGTOP-3187. Bump Flume to 1.9.0

3 years agoBIGTOP-3186. Bump Spark to 2.2.3 (#495)
Evans Ye [Thu, 14 Mar 2019 17:01:45 +0000 (01:01 +0800)] 
BIGTOP-3186. Bump Spark to 2.2.3 (#495)

3 years agoBIGTOP-3185. Bump Kafka to 2.1.1 (#493)
Evans Ye [Thu, 14 Mar 2019 17:01:34 +0000 (01:01 +0800)] 
BIGTOP-3185. Bump Kafka to 2.1.1 (#493)

3 years agoBIGTOP-3188. Bump Zeppelin to 0.8.1 496/head
Evans Ye [Wed, 13 Mar 2019 12:38:23 +0000 (20:38 +0800)] 
BIGTOP-3188. Bump Zeppelin to 0.8.1

3 years agoBIGTOP-3186. Bump Spark to 2.2.3 495/head
Evans Ye [Wed, 13 Mar 2019 12:32:35 +0000 (20:32 +0800)] 
BIGTOP-3186. Bump Spark to 2.2.3

3 years agoBIGTOP-3187. Bump Flume to 1.9.0 494/head
Evans Ye [Wed, 13 Mar 2019 12:25:49 +0000 (20:25 +0800)] 
BIGTOP-3187. Bump Flume to 1.9.0

3 years agoRevert "BIGTOP-3165. Bump Spark to 2.4.0 (#482)" (#492)
Evans Ye [Wed, 13 Mar 2019 12:19:38 +0000 (20:19 +0800)] 
Revert "BIGTOP-3165. Bump Spark to 2.4.0 (#482)" (#492)

This reverts commit 664240e57f064c7ec13c3685bc33891526c5944b.

3 years agoURLConnection check fails with exception when it should return false (#490)
foscraig [Sun, 10 Mar 2019 17:59:56 +0000 (10:59 -0700)] 
URLConnection check fails with exception when it should return false (#490)

3 years agoBIGTOP-2012: added tests for verifying web hdfs functionality
srinivas-altiscale [Tue, 23 Feb 2016 13:19:01 +0000 (18:49 +0530)] 
BIGTOP-2012: added tests for verifying web hdfs functionality

Signed-off-by: Evans Ye <evansye@apache.org>
3 years agoBIGTOP-3171. Update Kafka Puppet module for version 1.1.1 (#477)
Evans Ye [Tue, 5 Mar 2019 04:49:22 +0000 (12:49 +0800)] 
BIGTOP-3171. Update Kafka Puppet module for version 1.1.1 (#477)

3 years agoBIGTOP-3165. Bump Spark to 2.4.0 (#482)
Evans Ye [Tue, 5 Mar 2019 04:49:05 +0000 (12:49 +0800)] 
BIGTOP-3165. Bump Spark to 2.4.0 (#482)

3 years agoBIGTOP-3164. Bump Kafka to 1.1.1 (#476)
Evans Ye [Tue, 5 Mar 2019 04:48:54 +0000 (12:48 +0800)] 
BIGTOP-3164. Bump Kafka to 1.1.1 (#476)

3 years agoBIGTOP-3163. Bump Hadoop to 2.8.5 (#478)
Evans Ye [Tue, 5 Mar 2019 04:48:39 +0000 (12:48 +0800)] 
BIGTOP-3163. Bump Hadoop to 2.8.5 (#478)

3 years agoBIGTOP-3181. Build as non-root for COMPONENT-pkg-ind (#488)
Evans Ye [Mon, 4 Mar 2019 16:27:28 +0000 (00:27 +0800)] 
BIGTOP-3181. Build as non-root for COMPONENT-pkg-ind (#488)

3 years agoBIGTOP-3180. Gradle 5 incompatible issue (#487)
Evans Ye [Sun, 3 Mar 2019 17:16:22 +0000 (01:16 +0800)] 
BIGTOP-3180. Gradle 5 incompatible issue (#487)

3 years agoBIGTOP-3151: Add flink smoke test
Jun He [Thu, 14 Feb 2019 07:04:47 +0000 (15:04 +0800)] 
BIGTOP-3151: Add flink smoke test

Add flink to smoke tests.

Change-Id: Ib6a538a97347ec0e77b51c81b09a9d23a1a25a1a
Signed-off-by: Jun He <jun.he@linaro.org>
3 years agoBIGTOP-3178: Fix two insecure maven repositories
Olaf Flebbe [Mon, 25 Feb 2019 18:27:07 +0000 (19:27 +0100)] 
BIGTOP-3178: Fix two insecure maven repositories

3 years agoBIGTOP-3177. [Build] Exit w/o container left dangling when running docker in gradle...
Evans Ye [Tue, 26 Feb 2019 10:56:55 +0000 (18:56 +0800)] 
BIGTOP-3177. [Build] Exit w/o container left dangling when running docker in gradle wrapper (#485)

3 years agoBIGTOP-3172. [Provisioner] Support to specify components and smoke-tests when launchi...
Evans Ye [Tue, 26 Feb 2019 10:55:42 +0000 (18:55 +0800)] 
BIGTOP-3172. [Provisioner] Support to specify components and smoke-tests when launching Docker Provisioner (#479)

3 years agoBIGTOP-3175. [Build] Support to specify commit SHA1 when building packages (#484)
Evans Ye [Tue, 26 Feb 2019 10:47:31 +0000 (18:47 +0800)] 
BIGTOP-3175. [Build] Support to specify commit SHA1 when building packages (#484)

3 years agoBIGTOP-3176. [Build] (#483)
Evans Ye [Tue, 26 Feb 2019 10:46:37 +0000 (18:46 +0800)] 
BIGTOP-3176. [Build] (#483)

3 years agoBIGTOP-3179. Connection refused by www-us.apache.org mirror site (#486)
Evans Ye [Tue, 26 Feb 2019 07:35:28 +0000 (15:35 +0800)] 
BIGTOP-3179. Connection refused by www-us.apache.org mirror site (#486)

3 years agoBIGTOP-3174. ./gradlew repo-ind failed on Bigtop build slaves (#481)
Evans Ye [Mon, 25 Feb 2019 09:56:16 +0000 (17:56 +0800)] 
BIGTOP-3174. ./gradlew repo-ind failed on Bigtop build slaves (#481)

3 years agoBIGTOP-3158. [Test] Fix test specification with maven failsafe plugin (#465)
Evans Ye [Sat, 23 Feb 2019 02:39:47 +0000 (10:39 +0800)] 
BIGTOP-3158. [Test] Fix test specification with maven failsafe plugin (#465)

3 years agoBIGTOP-3173. Fix bugs and improve usability of COMPONENT-pkg-ind (#480)
Evans Ye [Thu, 21 Feb 2019 07:37:03 +0000 (15:37 +0800)] 
BIGTOP-3173. Fix bugs and improve usability of COMPONENT-pkg-ind (#480)

3 years agoBIGTOP-3166. Update Kerberos module to comply with Puppet's syntax (#468)
Evans Ye [Tue, 19 Feb 2019 04:49:38 +0000 (12:49 +0800)] 
BIGTOP-3166. Update Kerberos module to comply with Puppet's syntax (#468)

3 years agoBIGTOP-3170. Loop and wait for daemon to be started up for Alluxio (#473)
Evans Ye [Tue, 19 Feb 2019 04:48:22 +0000 (12:48 +0800)] 
BIGTOP-3170. Loop and wait for daemon to be started up for Alluxio (#473)

3 years agoBIGTOP-3169. Enable local repo is not working on yum systems (#472)
Evans Ye [Tue, 19 Feb 2019 04:47:34 +0000 (12:47 +0800)] 
BIGTOP-3169. Enable local repo is not working on yum systems (#472)

3 years agoBIGTOP-3167. Nexus is always enabled for ./gradlew XXX-ind (#469)
Evans Ye [Tue, 19 Feb 2019 04:47:00 +0000 (12:47 +0800)] 
BIGTOP-3167. Nexus is always enabled for ./gradlew XXX-ind (#469)

3 years agoBIGTOP-3159. Failed to deploy Alluxio due to Puppet compatibility issue (#474)
Evans Ye [Tue, 19 Feb 2019 04:42:36 +0000 (12:42 +0800)] 
BIGTOP-3159. Failed to deploy Alluxio due to Puppet compatibility issue (#474)

3 years agoBIGTOP-3137: Giraph smoke tests implementation
Yuqi Gu [Thu, 17 Jan 2019 02:45:36 +0000 (02:45 +0000)] 
BIGTOP-3137: Giraph smoke tests implementation

Add smoke tests for Giraph

Change-Id: I80ec1fbc916d5f616e92a16a15db777c4f4d3979
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
Signed-off-by: Evans Ye <evansye@apache.org>
3 years agoBIGTOP-3160. [Provisioner] Treat both exit code 0 and 2 as success for Puppet executi...
Evans Ye [Wed, 13 Feb 2019 09:28:10 +0000 (17:28 +0800)] 
BIGTOP-3160. [Provisioner] Treat both exit code 0 and 2 as success for Puppet execution (#466)

3 years agoBIGTOP-3150. [Provisioner] Raise proper exit code and error messages when provisionin...
Evans Ye [Sun, 10 Feb 2019 07:34:36 +0000 (15:34 +0800)] 
BIGTOP-3150. [Provisioner] Raise proper exit code and error messages when provisioning failed (#458)

3 years agoBIGTOP-3153. Switch to docker cp based solution to build inside containers (#462)
Evans Ye [Sun, 10 Feb 2019 07:33:58 +0000 (15:33 +0800)] 
BIGTOP-3153. Switch to docker cp based solution to build inside containers (#462)

3 years agoBIGTOP-3157. Failed to start Ambari server and agent on Fedora 26 (#464)
Evans Ye [Sat, 9 Feb 2019 13:50:55 +0000 (21:50 +0800)] 
BIGTOP-3157. Failed to start Ambari server and agent on Fedora 26 (#464)

3 years agoBIGTOP-3154. [Provisioner] Failed to bootstrap provisioning environment on Debian...
Evans Ye [Tue, 5 Feb 2019 05:47:02 +0000 (13:47 +0800)] 
BIGTOP-3154. [Provisioner] Failed to bootstrap provisioning environment on Debian/Ubuntu (#463)

3 years agoBIGTOP-3009. Add gradle repo-ind (#460)
Evans Ye [Sun, 3 Feb 2019 06:52:43 +0000 (14:52 +0800)] 
BIGTOP-3009. Add gradle repo-ind (#460)

3 years agoBIGTOP-3152: No need to Force the use of Netty over Hadoop RPC in Giraph (#459)
Yuqi [Thu, 31 Jan 2019 08:05:12 +0000 (16:05 +0800)] 
BIGTOP-3152: No need to Force the use of Netty over Hadoop RPC in Giraph (#459)

For workaround for GIRAPH-198 originally, giraph activated netty rpc by setting giraph.useNetty from command line.
In GIRAPH-200 later, giraph removed hadoop RPC and keep just netty by default.
So we can remove the Netty configuration accordingly.

Change-Id: I2032c7b9dc89e5c19dccc7a3c4f21b47a6d9b2cc
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
3 years agoBIGTOP-3141. Release number is not honored by the build system (#452)
Evans Ye [Wed, 30 Jan 2019 09:32:20 +0000 (17:32 +0800)] 
BIGTOP-3141. Release number is not honored by the build system (#452)

3 years agoBIGTOP-3149. Support to enable Nexus proxy for Docker Provisioner (#457)
Evans Ye [Wed, 30 Jan 2019 07:38:27 +0000 (15:38 +0800)] 
BIGTOP-3149. Support to enable Nexus proxy for Docker Provisioner (#457)

3 years agoBIGTOP-3148. Error out when configure-nexus encounter any issue (#456)
Evans Ye [Tue, 29 Jan 2019 08:41:13 +0000 (16:41 +0800)] 
BIGTOP-3148. Error out when configure-nexus encounter any issue (#456)

3 years agoBIGTOP-3146. gradlew is not available in bigtop-tests/smoke-tests for running run_ite...
Evans Ye [Mon, 28 Jan 2019 06:11:54 +0000 (14:11 +0800)] 
BIGTOP-3146. gradlew is not available in bigtop-tests/smoke-tests for running run_itest.sh (#454)

3 years agoBIGTOP-3147: Nexus proxy cache configuration is broken (#455)
Olaf Flebbe [Sun, 27 Jan 2019 18:23:07 +0000 (19:23 +0100)] 
BIGTOP-3147: Nexus proxy cache configuration is broken (#455)

3 years agoBIGTOP-3135: Remove deprecated giraph-site.xml
Yuqi Gu [Mon, 14 Jan 2019 16:15:09 +0000 (16:15 +0000)] 
BIGTOP-3135: Remove deprecated giraph-site.xml

The 'bigtop-packages/src/common/giraph/giraph-site.xml' is deprecated.
The puppet used its templates giraph-site.xml file for giraph deployment.

Change-Id: Ib0b5d62c3dd69d43919704da5511096dc3e323b5
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
Signed-off-by: Jun He <junhe@apache.org>
3 years agoBIGTOP-3144. [Test] QFS smoke test failed on multi-node cluster (#453)
Evans Ye [Mon, 21 Jan 2019 09:08:18 +0000 (17:08 +0800)] 
BIGTOP-3144. [Test] QFS smoke test failed on multi-node cluster (#453)

3 years agoBIGTOP-3126. [Puppet] Failed to deploy QFS due to Permission denied error at initaili...
Evans Ye [Sat, 19 Jan 2019 07:41:32 +0000 (15:41 +0800)] 
BIGTOP-3126. [Puppet] Failed to deploy QFS due to Permission denied error at initailization (#447)

* Revert "BIGTOP-3126. [Puppet] Failed to deploy QFS due to Permission denied error at initailization"

This reverts commit 471276e1b743f143d7ef714e7cbc1ea83c2bc287.

* BIGTOP-3126. [Puppet] Failed to deploy QFS due to Permission denied error at initailization

3 years agoBIGTOP-3140. [Test] TestHadoopExamples.groovy can have $USER = null when running...
Evans Ye [Sat, 19 Jan 2019 07:40:33 +0000 (15:40 +0800)] 
BIGTOP-3140. [Test] TestHadoopExamples.groovy can have $USER = null when running in Docker (#450)

3 years agoBIGTOP-3139. Failed to deploy Ambari on CentOS/Fedora cause no service command availa...
Evans Ye [Sat, 19 Jan 2019 07:40:22 +0000 (15:40 +0800)] 
BIGTOP-3139. Failed to deploy Ambari on CentOS/Fedora cause no service command available (#449)

3 years agoBIGTOP-3138. Maven installation failed on debian-9 (#448)
Evans Ye [Sat, 19 Jan 2019 07:39:29 +0000 (15:39 +0800)] 
BIGTOP-3138. Maven installation failed on debian-9 (#448)