bigtop.git
2 years agoBIGTOP-3330: avoid duplicate jars between oozie and oozie-client branch-1.4
Luca Toscano [Sun, 22 Mar 2020 17:25:40 +0000 (18:25 +0100)] 
BIGTOP-3330: avoid duplicate jars between oozie and oozie-client

Add a workaround to the install_oozie.sh script to avoid duplicate
jars between oozie and oozie-client. This issue leads to override
errors when installing the oozie package on Debian (oozie-client
is among its dependencies).

Credis to Olaf Flebbe for the solution.

2 years agoBIGTOP-3317: fix broken symlink for hadoop-hdfs.jar
Luca Toscano [Sat, 29 Feb 2020 09:54:17 +0000 (10:54 +0100)] 
BIGTOP-3317: fix broken symlink for hadoop-hdfs.jar

On Debian 9 the hadoop-hdfs.jar is broken, and causes failures like
oozie sharedlib creation on HDFS. This change replaces it with
hadoop-hdfs-client.jar, that seems to work.

Apply the same fix also for rpm packages.

Signed-off-by: Olaf Flebbe <of@oflebbe.de>
2 years agoBIGTOP-3323: Fix hadoop pom for 1.4 branch
Olaf Flebbe [Sun, 8 Mar 2020 19:04:08 +0000 (20:04 +0100)] 
BIGTOP-3323: Fix hadoop pom for 1.4 branch

2 years agoBIGTOP-3308: add support for openssl 1.1.0 on Debian
Luca Toscano [Sat, 29 Feb 2020 10:03:23 +0000 (11:03 +0100)] 
BIGTOP-3308: add support for openssl 1.1.0 on Debian

In BIGTOP-2932 a patch was backported from Hadoop upstream to better
support openssl 1.1.x. Some time later a new commit was filed to address
some corner cases, but it was never backported to BigTop.

On Debian 9 openssl 1.1.0 is the default, and BigTop builds against it.
When executing the command "hadoop checknative -a" though an error shows up:

openssl: false EVP_CIPHER_CTX_cleanup

The issue is that EVP_CIPHER_CTX_cleanup was removed from openssl 1.1.0, but
OpensslCipher.c kept using it until a proper if guard was added by the
patch provided by this pull request.

In my case this issue caused Spark 2.4's RPC encryption, based on Openssl native
lib, to fail when establishing new connections between workers and AM on Yarn.
I rebuilt the hadoop deb package with the patch and tested in the Debian 9 Docker
image, the checknative util now returns correctly a positive "true" for openssl.
I also tested it with Spark 2.4 on a test Hadoop cluster and it seems working fine.

3 years agoBigtop 1.4.0 website update release-1.4.0
Evans Ye [Sun, 16 Jun 2019 04:29:37 +0000 (12:29 +0800)] 
Bigtop 1.4.0 website update

3 years agoBigtop 1.4.0 website update
Evans Ye [Sun, 16 Jun 2019 04:15:32 +0000 (12:15 +0800)] 
Bigtop 1.4.0 website update

3 years agoSwitch to 1.4.0 docker images for provisioner release-1.4.0-RC1
Evans Ye [Sat, 18 May 2019 14:26:49 +0000 (22:26 +0800)] 
Switch to 1.4.0 docker images for provisioner

3 years agoBigtop 1.4.0 release release-1.4.0-RC0
Evans Ye [Sun, 5 May 2019 06:39:53 +0000 (14:39 +0800)] 
Bigtop 1.4.0 release

3 years agoBIGTOP-3213. Bugs in pom.xml files when releasing Bigtop 1.4.0 (#529)
Evans Ye [Sat, 4 May 2019 20:07:16 +0000 (04:07 +0800)] 
BIGTOP-3213. Bugs in pom.xml files when releasing Bigtop 1.4.0 (#529)

3 years agoBIGTOP-3212. Deploy QFS client failed due to no such directory error (#526)
Evans Ye [Fri, 3 May 2019 08:38:09 +0000 (16:38 +0800)] 
BIGTOP-3212. Deploy QFS client failed due to no such directory error (#526)

3 years agoBIGTOP-3210. Missing /lib/lsb/init-functions when deploying Flink on Fedora 26 (...
Evans Ye [Tue, 23 Apr 2019 17:21:05 +0000 (01:21 +0800)] 
BIGTOP-3210. Missing /lib/lsb/init-functions when deploying Flink on Fedora 26 (#524)

3 years agoBIGTOP-3206. Missing /etc/init.d/functions when deploying Alluxio on Fedora 26 (...
Evans Ye [Tue, 23 Apr 2019 17:20:53 +0000 (01:20 +0800)] 
BIGTOP-3206. Missing /etc/init.d/functions when deploying Alluxio on Fedora 26 (#518)

3 years agoBIGTOP-3204. Bump Flink to 1.6.4 (#522)
Guodong Xu [Mon, 22 Apr 2019 04:51:27 +0000 (12:51 +0800)] 
BIGTOP-3204. Bump Flink to 1.6.4 (#522)

Bump Flink version from 1.4.2 to 1.6.4. There are three changes involved:
1. obviously, version number
2. in Flink 1.6.4, there is no 'resources' folder any more. Removed it.
3. set mode to 'legacy'

Starting from Flink v1.5, there is a rewrite of Flinkā€™s deployment and process
model (internally known as FLIP-6). A new option 'mode' was introduced to
indicate which executions to use. However, the way Bigtop puppet deploys
'flink-jobmanager' and 'flink-taskmanager', ie. calling 'flink-daemon.sh
jobmanager' and 'flink-daemon.sh taskmanager', is legacy. Without setting
mode to 'legacy', flink's built-in exmaples fail with error
"JobSubmissionException: Failed to submit JobGraph"

Signed-off-by: Guodong Xu <guodong.xu@linaro.org>
3 years agoBIGTOP-3207. [Provisioner] Do not exit when destroying got no cluster exists (#520)
Evans Ye [Sat, 20 Apr 2019 18:32:37 +0000 (02:32 +0800)] 
BIGTOP-3207. [Provisioner] Do not exit when destroying got no cluster exists (#520)

3 years agoBIGTOP-3209. Revert Kafka to 0.10.2.2 and Flume to 1.8.0 (#521)
Evans Ye [Sat, 20 Apr 2019 18:31:22 +0000 (02:31 +0800)] 
BIGTOP-3209. Revert Kafka to 0.10.2.2 and Flume to 1.8.0 (#521)

* Revert "BIGTOP-3185. Bump Kafka to 2.1.1 (#493)"

This reverts commit ca52568591010884687ac7616d09d97c63a89ebf.

* Revert "BIGTOP-3187. Bump Flume to 1.9.0"

This reverts commit 173d80e381cf8b527812e321f1908d90aeba9823.

* Revert "BIGTOP-3171. Update Kafka Puppet module for version 1.1.1 (#477)"

This reverts commit 6d5705e3e023caae39410888713f7bbf77578e09.

* Revert "BIGTOP-3164. Bump Kafka to 1.1.1 (#476)"

This reverts commit 12cb0ad24edb29e8cdac8d571a0472814629a40f.

3 years agoBIGTOP-3203. [Sandbox] Architecture string is a mess for Distributions (#516)
Evans Ye [Sat, 30 Mar 2019 18:18:35 +0000 (02:18 +0800)] 
BIGTOP-3203. [Sandbox] Architecture string is a mess for Distributions (#516)

3 years agoBIGTOP-3198. [Sandbox] Support AARCH64/PPC64LE (#511)
Evans Ye [Fri, 29 Mar 2019 14:50:09 +0000 (22:50 +0800)] 
BIGTOP-3198. [Sandbox] Support AARCH64/PPC64LE (#511)

3 years agoBIGTOP-3199. Can not run smoke test inside docker-provisioner (#512)
Evans Ye [Fri, 29 Mar 2019 14:42:19 +0000 (22:42 +0800)] 
BIGTOP-3199. Can not run smoke test inside docker-provisioner (#512)

3 years agoBIGTOP-3200. Bugfix Integration test framework 2.0 and documentation (#514)
Evans Ye [Fri, 29 Mar 2019 03:45:01 +0000 (11:45 +0800)] 
BIGTOP-3200. Bugfix Integration test framework 2.0 and documentation (#514)

3 years agoBIGTOP-3197. [Docker] Treat both exit code 0 and 2 as success for Puppet execution...
Evans Ye [Tue, 26 Mar 2019 09:18:23 +0000 (17:18 +0800)] 
BIGTOP-3197. [Docker] Treat both exit code 0 and 2 as success for Puppet execution (#508)

3 years agoChanging version to 1.4.0
Evans Ye [Sun, 24 Mar 2019 15:24:48 +0000 (23:24 +0800)] 
Changing version to 1.4.0

3 years agoPreparing for release 1.4.0
Evans Ye [Sun, 24 Mar 2019 15:10:50 +0000 (23:10 +0800)] 
Preparing for release 1.4.0

3 years agoBIGTOP-3195. Add pkgs-ind to package all artifacts inside docker (#504)
Evans Ye [Sun, 24 Mar 2019 14:57:35 +0000 (22:57 +0800)] 
BIGTOP-3195. Add pkgs-ind to package all artifacts inside docker (#504)

3 years agoBIGTOP-3196. Drop Apache Crunch in Bigtop distribution (#505)
Evans Ye [Sun, 24 Mar 2019 14:57:21 +0000 (22:57 +0800)] 
BIGTOP-3196. Drop Apache Crunch in Bigtop distribution (#505)

3 years agoBIGTOP-3192. Remove Spark 1.6 from the stack
Konstantin Boudnik [Sun, 17 Mar 2019 23:49:04 +0000 (19:49 -0400)] 
BIGTOP-3192. Remove Spark 1.6 from the stack

Removing Spark 1.6 component from the stack

3 years agoBIGTOP-3195. Add pkgs-ind to package all artifacts inside docker 504/head
Evans Ye [Sat, 23 Mar 2019 10:38:03 +0000 (18:38 +0800)] 
BIGTOP-3195. Add pkgs-ind to package all artifacts inside docker

3 years agoBIGTOP-3194. Fix Phoenix QueryServer PID file name (#503)
JunyangLi [Sat, 23 Mar 2019 10:14:08 +0000 (03:14 -0700)] 
BIGTOP-3194. Fix Phoenix QueryServer PID file name (#503)

3 years agoBIGTOP-3193. Add REPO and MEMORY as options for docker-provisioner (#502)
Evans Ye [Wed, 20 Mar 2019 15:19:25 +0000 (23:19 +0800)] 
BIGTOP-3193. Add REPO and MEMORY as options for docker-provisioner (#502)

3 years agoBIGTOP-3142. Better user expereince when calling docker-hadoop.sh -d with no cluster...
Evans Ye [Mon, 18 Mar 2019 15:53:48 +0000 (23:53 +0800)] 
BIGTOP-3142. Better user expereince when calling docker-hadoop.sh -d with no cluster running (#500)

3 years agoBIGTOP-3190. Missing newline in Compatibility issue for Zeppelin with Spark 2.2.3...
Evans Ye [Sat, 16 Mar 2019 15:58:13 +0000 (23:58 +0800)] 
BIGTOP-3190. Missing newline in Compatibility issue for Zeppelin with Spark 2.2.3 (#501)

3 years agoBIGTOP-3190. Compatibility issue for Zeppelin with Spark 2.2.3 (#499)
Evans Ye [Sat, 16 Mar 2019 04:16:53 +0000 (12:16 +0800)] 
BIGTOP-3190. Compatibility issue for Zeppelin with Spark 2.2.3 (#499)

3 years agoBIGTOP-3191. Old Gradle version causes Kafka 2.1.1 build failed (#498)
Evans Ye [Fri, 15 Mar 2019 16:25:13 +0000 (00:25 +0800)] 
BIGTOP-3191. Old Gradle version causes Kafka 2.1.1 build failed (#498)

3 years agoRevert "BIGTOP-3188. Bump Zeppelin to 0.8.1" (#497)
Evans Ye [Fri, 15 Mar 2019 07:04:05 +0000 (15:04 +0800)] 
Revert "BIGTOP-3188. Bump Zeppelin to 0.8.1" (#497)

3 years agoBIGTOP-3189. Allow to specify more properties/options at command line for docker...
Evans Ye [Thu, 14 Mar 2019 17:13:06 +0000 (01:13 +0800)] 
BIGTOP-3189. Allow to specify more properties/options at command line for docker provisioner (#491)

3 years agoMerge pull request #496 from evans-ye/BIGTOP-3188
Evans Ye [Thu, 14 Mar 2019 17:07:45 +0000 (01:07 +0800)] 
Merge pull request #496 from evans-ye/BIGTOP-3188

BIGTOP-3188. Bump Zeppelin to 0.8.1

3 years agoMerge pull request #494 from evans-ye/BIGTOP-3187
Evans Ye [Thu, 14 Mar 2019 17:02:04 +0000 (01:02 +0800)] 
Merge pull request #494 from evans-ye/BIGTOP-3187

BIGTOP-3187. Bump Flume to 1.9.0

3 years agoBIGTOP-3186. Bump Spark to 2.2.3 (#495)
Evans Ye [Thu, 14 Mar 2019 17:01:45 +0000 (01:01 +0800)] 
BIGTOP-3186. Bump Spark to 2.2.3 (#495)

3 years agoBIGTOP-3185. Bump Kafka to 2.1.1 (#493)
Evans Ye [Thu, 14 Mar 2019 17:01:34 +0000 (01:01 +0800)] 
BIGTOP-3185. Bump Kafka to 2.1.1 (#493)

3 years agoBIGTOP-3188. Bump Zeppelin to 0.8.1 496/head
Evans Ye [Wed, 13 Mar 2019 12:38:23 +0000 (20:38 +0800)] 
BIGTOP-3188. Bump Zeppelin to 0.8.1

3 years agoBIGTOP-3186. Bump Spark to 2.2.3 495/head
Evans Ye [Wed, 13 Mar 2019 12:32:35 +0000 (20:32 +0800)] 
BIGTOP-3186. Bump Spark to 2.2.3

3 years agoBIGTOP-3187. Bump Flume to 1.9.0 494/head
Evans Ye [Wed, 13 Mar 2019 12:25:49 +0000 (20:25 +0800)] 
BIGTOP-3187. Bump Flume to 1.9.0

3 years agoRevert "BIGTOP-3165. Bump Spark to 2.4.0 (#482)" (#492)
Evans Ye [Wed, 13 Mar 2019 12:19:38 +0000 (20:19 +0800)] 
Revert "BIGTOP-3165. Bump Spark to 2.4.0 (#482)" (#492)

This reverts commit 664240e57f064c7ec13c3685bc33891526c5944b.

3 years agoURLConnection check fails with exception when it should return false (#490)
foscraig [Sun, 10 Mar 2019 17:59:56 +0000 (10:59 -0700)] 
URLConnection check fails with exception when it should return false (#490)

3 years agoBIGTOP-2012: added tests for verifying web hdfs functionality
srinivas-altiscale [Tue, 23 Feb 2016 13:19:01 +0000 (18:49 +0530)] 
BIGTOP-2012: added tests for verifying web hdfs functionality

Signed-off-by: Evans Ye <evansye@apache.org>
3 years agoBIGTOP-3171. Update Kafka Puppet module for version 1.1.1 (#477)
Evans Ye [Tue, 5 Mar 2019 04:49:22 +0000 (12:49 +0800)] 
BIGTOP-3171. Update Kafka Puppet module for version 1.1.1 (#477)

3 years agoBIGTOP-3165. Bump Spark to 2.4.0 (#482)
Evans Ye [Tue, 5 Mar 2019 04:49:05 +0000 (12:49 +0800)] 
BIGTOP-3165. Bump Spark to 2.4.0 (#482)

3 years agoBIGTOP-3164. Bump Kafka to 1.1.1 (#476)
Evans Ye [Tue, 5 Mar 2019 04:48:54 +0000 (12:48 +0800)] 
BIGTOP-3164. Bump Kafka to 1.1.1 (#476)

3 years agoBIGTOP-3163. Bump Hadoop to 2.8.5 (#478)
Evans Ye [Tue, 5 Mar 2019 04:48:39 +0000 (12:48 +0800)] 
BIGTOP-3163. Bump Hadoop to 2.8.5 (#478)

3 years agoBIGTOP-3181. Build as non-root for COMPONENT-pkg-ind (#488)
Evans Ye [Mon, 4 Mar 2019 16:27:28 +0000 (00:27 +0800)] 
BIGTOP-3181. Build as non-root for COMPONENT-pkg-ind (#488)

3 years agoBIGTOP-3180. Gradle 5 incompatible issue (#487)
Evans Ye [Sun, 3 Mar 2019 17:16:22 +0000 (01:16 +0800)] 
BIGTOP-3180. Gradle 5 incompatible issue (#487)

3 years agoBIGTOP-3151: Add flink smoke test
Jun He [Thu, 14 Feb 2019 07:04:47 +0000 (15:04 +0800)] 
BIGTOP-3151: Add flink smoke test

Add flink to smoke tests.

Change-Id: Ib6a538a97347ec0e77b51c81b09a9d23a1a25a1a
Signed-off-by: Jun He <jun.he@linaro.org>
3 years agoBIGTOP-3178: Fix two insecure maven repositories
Olaf Flebbe [Mon, 25 Feb 2019 18:27:07 +0000 (19:27 +0100)] 
BIGTOP-3178: Fix two insecure maven repositories

3 years agoBIGTOP-3177. [Build] Exit w/o container left dangling when running docker in gradle...
Evans Ye [Tue, 26 Feb 2019 10:56:55 +0000 (18:56 +0800)] 
BIGTOP-3177. [Build] Exit w/o container left dangling when running docker in gradle wrapper (#485)

3 years agoBIGTOP-3172. [Provisioner] Support to specify components and smoke-tests when launchi...
Evans Ye [Tue, 26 Feb 2019 10:55:42 +0000 (18:55 +0800)] 
BIGTOP-3172. [Provisioner] Support to specify components and smoke-tests when launching Docker Provisioner (#479)

3 years agoBIGTOP-3175. [Build] Support to specify commit SHA1 when building packages (#484)
Evans Ye [Tue, 26 Feb 2019 10:47:31 +0000 (18:47 +0800)] 
BIGTOP-3175. [Build] Support to specify commit SHA1 when building packages (#484)

3 years agoBIGTOP-3176. [Build] (#483)
Evans Ye [Tue, 26 Feb 2019 10:46:37 +0000 (18:46 +0800)] 
BIGTOP-3176. [Build] (#483)

3 years agoBIGTOP-3179. Connection refused by www-us.apache.org mirror site (#486)
Evans Ye [Tue, 26 Feb 2019 07:35:28 +0000 (15:35 +0800)] 
BIGTOP-3179. Connection refused by www-us.apache.org mirror site (#486)

3 years agoBIGTOP-3174. ./gradlew repo-ind failed on Bigtop build slaves (#481)
Evans Ye [Mon, 25 Feb 2019 09:56:16 +0000 (17:56 +0800)] 
BIGTOP-3174. ./gradlew repo-ind failed on Bigtop build slaves (#481)

3 years agoBIGTOP-3158. [Test] Fix test specification with maven failsafe plugin (#465)
Evans Ye [Sat, 23 Feb 2019 02:39:47 +0000 (10:39 +0800)] 
BIGTOP-3158. [Test] Fix test specification with maven failsafe plugin (#465)

3 years agoBIGTOP-3173. Fix bugs and improve usability of COMPONENT-pkg-ind (#480)
Evans Ye [Thu, 21 Feb 2019 07:37:03 +0000 (15:37 +0800)] 
BIGTOP-3173. Fix bugs and improve usability of COMPONENT-pkg-ind (#480)

3 years agoBIGTOP-3166. Update Kerberos module to comply with Puppet's syntax (#468)
Evans Ye [Tue, 19 Feb 2019 04:49:38 +0000 (12:49 +0800)] 
BIGTOP-3166. Update Kerberos module to comply with Puppet's syntax (#468)

3 years agoBIGTOP-3170. Loop and wait for daemon to be started up for Alluxio (#473)
Evans Ye [Tue, 19 Feb 2019 04:48:22 +0000 (12:48 +0800)] 
BIGTOP-3170. Loop and wait for daemon to be started up for Alluxio (#473)

3 years agoBIGTOP-3169. Enable local repo is not working on yum systems (#472)
Evans Ye [Tue, 19 Feb 2019 04:47:34 +0000 (12:47 +0800)] 
BIGTOP-3169. Enable local repo is not working on yum systems (#472)

3 years agoBIGTOP-3167. Nexus is always enabled for ./gradlew XXX-ind (#469)
Evans Ye [Tue, 19 Feb 2019 04:47:00 +0000 (12:47 +0800)] 
BIGTOP-3167. Nexus is always enabled for ./gradlew XXX-ind (#469)

3 years agoBIGTOP-3159. Failed to deploy Alluxio due to Puppet compatibility issue (#474)
Evans Ye [Tue, 19 Feb 2019 04:42:36 +0000 (12:42 +0800)] 
BIGTOP-3159. Failed to deploy Alluxio due to Puppet compatibility issue (#474)

3 years agoBIGTOP-3137: Giraph smoke tests implementation
Yuqi Gu [Thu, 17 Jan 2019 02:45:36 +0000 (02:45 +0000)] 
BIGTOP-3137: Giraph smoke tests implementation

Add smoke tests for Giraph

Change-Id: I80ec1fbc916d5f616e92a16a15db777c4f4d3979
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
Signed-off-by: Evans Ye <evansye@apache.org>
3 years agoBIGTOP-3160. [Provisioner] Treat both exit code 0 and 2 as success for Puppet executi...
Evans Ye [Wed, 13 Feb 2019 09:28:10 +0000 (17:28 +0800)] 
BIGTOP-3160. [Provisioner] Treat both exit code 0 and 2 as success for Puppet execution (#466)

3 years agoBIGTOP-3150. [Provisioner] Raise proper exit code and error messages when provisionin...
Evans Ye [Sun, 10 Feb 2019 07:34:36 +0000 (15:34 +0800)] 
BIGTOP-3150. [Provisioner] Raise proper exit code and error messages when provisioning failed (#458)

3 years agoBIGTOP-3153. Switch to docker cp based solution to build inside containers (#462)
Evans Ye [Sun, 10 Feb 2019 07:33:58 +0000 (15:33 +0800)] 
BIGTOP-3153. Switch to docker cp based solution to build inside containers (#462)

3 years agoBIGTOP-3157. Failed to start Ambari server and agent on Fedora 26 (#464)
Evans Ye [Sat, 9 Feb 2019 13:50:55 +0000 (21:50 +0800)] 
BIGTOP-3157. Failed to start Ambari server and agent on Fedora 26 (#464)

3 years agoBIGTOP-3154. [Provisioner] Failed to bootstrap provisioning environment on Debian...
Evans Ye [Tue, 5 Feb 2019 05:47:02 +0000 (13:47 +0800)] 
BIGTOP-3154. [Provisioner] Failed to bootstrap provisioning environment on Debian/Ubuntu (#463)

3 years agoBIGTOP-3009. Add gradle repo-ind (#460)
Evans Ye [Sun, 3 Feb 2019 06:52:43 +0000 (14:52 +0800)] 
BIGTOP-3009. Add gradle repo-ind (#460)

3 years agoBIGTOP-3152: No need to Force the use of Netty over Hadoop RPC in Giraph (#459)
Yuqi [Thu, 31 Jan 2019 08:05:12 +0000 (16:05 +0800)] 
BIGTOP-3152: No need to Force the use of Netty over Hadoop RPC in Giraph (#459)

For workaround for GIRAPH-198 originally, giraph activated netty rpc by setting giraph.useNetty from command line.
In GIRAPH-200 later, giraph removed hadoop RPC and keep just netty by default.
So we can remove the Netty configuration accordingly.

Change-Id: I2032c7b9dc89e5c19dccc7a3c4f21b47a6d9b2cc
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
3 years agoBIGTOP-3141. Release number is not honored by the build system (#452)
Evans Ye [Wed, 30 Jan 2019 09:32:20 +0000 (17:32 +0800)] 
BIGTOP-3141. Release number is not honored by the build system (#452)

3 years agoBIGTOP-3149. Support to enable Nexus proxy for Docker Provisioner (#457)
Evans Ye [Wed, 30 Jan 2019 07:38:27 +0000 (15:38 +0800)] 
BIGTOP-3149. Support to enable Nexus proxy for Docker Provisioner (#457)

3 years agoBIGTOP-3148. Error out when configure-nexus encounter any issue (#456)
Evans Ye [Tue, 29 Jan 2019 08:41:13 +0000 (16:41 +0800)] 
BIGTOP-3148. Error out when configure-nexus encounter any issue (#456)

3 years agoBIGTOP-3146. gradlew is not available in bigtop-tests/smoke-tests for running run_ite...
Evans Ye [Mon, 28 Jan 2019 06:11:54 +0000 (14:11 +0800)] 
BIGTOP-3146. gradlew is not available in bigtop-tests/smoke-tests for running run_itest.sh (#454)

3 years agoBIGTOP-3147: Nexus proxy cache configuration is broken (#455)
Olaf Flebbe [Sun, 27 Jan 2019 18:23:07 +0000 (19:23 +0100)] 
BIGTOP-3147: Nexus proxy cache configuration is broken (#455)

3 years agoBIGTOP-3135: Remove deprecated giraph-site.xml
Yuqi Gu [Mon, 14 Jan 2019 16:15:09 +0000 (16:15 +0000)] 
BIGTOP-3135: Remove deprecated giraph-site.xml

The 'bigtop-packages/src/common/giraph/giraph-site.xml' is deprecated.
The puppet used its templates giraph-site.xml file for giraph deployment.

Change-Id: Ib0b5d62c3dd69d43919704da5511096dc3e323b5
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
Signed-off-by: Jun He <junhe@apache.org>
3 years agoBIGTOP-3144. [Test] QFS smoke test failed on multi-node cluster (#453)
Evans Ye [Mon, 21 Jan 2019 09:08:18 +0000 (17:08 +0800)] 
BIGTOP-3144. [Test] QFS smoke test failed on multi-node cluster (#453)

3 years agoBIGTOP-3126. [Puppet] Failed to deploy QFS due to Permission denied error at initaili...
Evans Ye [Sat, 19 Jan 2019 07:41:32 +0000 (15:41 +0800)] 
BIGTOP-3126. [Puppet] Failed to deploy QFS due to Permission denied error at initailization (#447)

* Revert "BIGTOP-3126. [Puppet] Failed to deploy QFS due to Permission denied error at initailization"

This reverts commit 471276e1b743f143d7ef714e7cbc1ea83c2bc287.

* BIGTOP-3126. [Puppet] Failed to deploy QFS due to Permission denied error at initailization

3 years agoBIGTOP-3140. [Test] TestHadoopExamples.groovy can have $USER = null when running...
Evans Ye [Sat, 19 Jan 2019 07:40:33 +0000 (15:40 +0800)] 
BIGTOP-3140. [Test] TestHadoopExamples.groovy can have $USER = null when running in Docker (#450)

3 years agoBIGTOP-3139. Failed to deploy Ambari on CentOS/Fedora cause no service command availa...
Evans Ye [Sat, 19 Jan 2019 07:40:22 +0000 (15:40 +0800)] 
BIGTOP-3139. Failed to deploy Ambari on CentOS/Fedora cause no service command available (#449)

3 years agoBIGTOP-3138. Maven installation failed on debian-9 (#448)
Evans Ye [Sat, 19 Jan 2019 07:39:29 +0000 (15:39 +0800)] 
BIGTOP-3138. Maven installation failed on debian-9 (#448)

3 years agoBIGTOP-3136. [Provisioner] Local built repo should have higher priority (#445)
Evans Ye [Fri, 18 Jan 2019 10:00:15 +0000 (18:00 +0800)] 
BIGTOP-3136. [Provisioner] Local built repo should have higher priority (#445)

3 years agoBIGTOP-3130. Failed to run Alluxio smoke test (#446)
Evans Ye [Fri, 18 Jan 2019 09:59:47 +0000 (17:59 +0800)] 
BIGTOP-3130. Failed to run Alluxio smoke test (#446)

3 years agoBIGTOP-3134. [Puppet] An upgrade to deploy Alluxio 1.8.1 (#443)
Evans Ye [Fri, 18 Jan 2019 09:59:36 +0000 (17:59 +0800)] 
BIGTOP-3134. [Puppet] An upgrade to deploy Alluxio 1.8.1 (#443)

3 years agoBIGTOP-3132. Bump Alluxio up to 1.8.1 (#442)
Evans Ye [Fri, 18 Jan 2019 09:56:28 +0000 (17:56 +0800)] 
BIGTOP-3132. Bump Alluxio up to 1.8.1 (#442)

3 years agoBIGTOP-3130. Failed to run Alluxio smoke test 446/head
Evans Ye [Tue, 15 Jan 2019 08:19:18 +0000 (16:19 +0800)] 
BIGTOP-3130. Failed to run Alluxio smoke test

3 years agoBIGTOP-3133. [Puppet] Add a module to deploy bigtop-utils (#441)
Evans Ye [Sun, 13 Jan 2019 18:25:19 +0000 (02:25 +0800)] 
BIGTOP-3133. [Puppet] Add a module to deploy bigtop-utils (#441)

3 years agoBIGTOP-3131. Apex smoke test requires mvn to compile test jar (#440)
Evans Ye [Fri, 11 Jan 2019 06:37:37 +0000 (14:37 +0800)] 
BIGTOP-3131. Apex smoke test requires mvn to compile test jar (#440)

3 years agoBIGTOP-3129. Failed to run QFS smoke test (#439)
Evans Ye [Thu, 10 Jan 2019 06:29:16 +0000 (14:29 +0800)] 
BIGTOP-3129. Failed to run QFS smoke test (#439)

3 years agoBIGTOP-3125: [provisioner] sbin/init is missed in puppet:opensuse-42.3
Jun He [Fri, 4 Jan 2019 07:10:23 +0000 (15:10 +0800)] 
BIGTOP-3125: [provisioner] sbin/init is missed in puppet:opensuse-42.3

The docker image, bigtop/puppet:opensuse-42.3 doesn't have /sbin/init installed.
This caused docker provisioner failed.

Change-Id: I48cbd25893c4d0008789335261ffecbc34175a13
Signed-off-by: Jun He <jun.he@linaro.org>
Signed-off-by: Evans Ye <evansye@apache.org>
3 years agoMerge pull request #438 from oflebbe/apachemaster
Evans Ye [Tue, 8 Jan 2019 17:48:42 +0000 (01:48 +0800)] 
Merge pull request #438 from oflebbe/apachemaster

BIGTOP-3128: Switch to new gitbox repository

3 years agoBIGTOP-3128: Switch to new gitbox repository 438/head
Olaf Flebbe [Mon, 7 Jan 2019 19:36:36 +0000 (20:36 +0100)] 
BIGTOP-3128: Switch to new gitbox repository

3 years agoBIGTOP-3124. Remove package installation in provisioner/utils/smoke-tests.sh and...
Evans Ye [Fri, 4 Jan 2019 18:35:23 +0000 (02:35 +0800)] 
BIGTOP-3124. Remove package installation in provisioner/utils/smoke-tests.sh and polish the script

3 years agoBIGTOP-3126. [Puppet] Failed to deploy QFS due to Permission denied error at initaili...
Evans Ye [Fri, 4 Jan 2019 18:30:54 +0000 (02:30 +0800)] 
BIGTOP-3126. [Puppet] Failed to deploy QFS due to Permission denied error at initailization

3 years agoBIGTOP-3118. [Puppet] Failed to deploy GPDB
Evans Ye [Tue, 25 Dec 2018 17:14:02 +0000 (01:14 +0800)] 
BIGTOP-3118. [Puppet] Failed to deploy GPDB

3 years agoBIGTOP-3115. [Puppet] Alluxio master/worker can not startup successfully
Evans Ye [Mon, 24 Dec 2018 05:15:18 +0000 (13:15 +0800)] 
BIGTOP-3115. [Puppet] Alluxio master/worker can not startup successfully

3 years agoBIGTOP-3120: Annoying warning message from Ambari snippet
Olaf Flebbe [Thu, 27 Dec 2018 13:36:33 +0000 (14:36 +0100)] 
BIGTOP-3120: Annoying warning message from Ambari snippet

Signed-off-by: Evans Ye <evansye@apache.org>