bigtop.git
8 months agoUpdate the release notes for 3.0.0 with BIGTOP-3588. rel/3.0.0 release-3.0.0
Kengo Seki [Thu, 14 Oct 2021 23:48:20 +0000 (08:48 +0900)] 
Update the release notes for 3.0.0 with BIGTOP-3588.

8 months agoBIGTOP-3588. Pin redis-rb version for Logstash to 4.4.0. (#820)
Kengo Seki [Thu, 14 Oct 2021 23:26:31 +0000 (08:26 +0900)] 
BIGTOP-3588. Pin redis-rb version for Logstash to 4.4.0. (#820)

(cherry picked from commit 6955a57dcededefc54ebb7f140ac91ab82fb4172)

8 months agoBigtop 3.0.0 release
Kengo Seki [Tue, 12 Oct 2021 00:13:52 +0000 (09:13 +0900)] 
Bigtop 3.0.0 release

8 months agoUpdate default values in hieradata for release 3.0.0
Kengo Seki [Mon, 11 Oct 2021 23:24:29 +0000 (08:24 +0900)] 
Update default values in hieradata for release 3.0.0

(cherry picked from commit c3f73f151f9a639d078280efa1479f22220b20a5)

8 months agoPreparing for release 3.0.0
Kengo Seki [Mon, 11 Oct 2021 23:13:17 +0000 (08:13 +0900)] 
Preparing for release 3.0.0

(cherry picked from commit 8d8de718e2ebad8c5d1c95fb2c31c4d928b417ad)

8 months agoBIGTOP-3585. Remove obsolete text replacement from do-component-build of Ambari....
Masatake Iwasaki [Mon, 11 Oct 2021 11:02:53 +0000 (20:02 +0900)] 
BIGTOP-3585. Remove obsolete text replacement from do-component-build of Ambari. (#818)

(cherry picked from commit 8d32e32b1962414d079b078ecfbf3d1ee1e787fa)

8 months agoBIGTOP-3587. Deploying Ambari to Ubuntu 18.04 and 20.04 fails on ppc64le. (#819)
Kengo Seki [Mon, 11 Oct 2021 08:35:04 +0000 (17:35 +0900)] 
BIGTOP-3587. Deploying Ambari to Ubuntu 18.04 and 20.04 fails on ppc64le. (#819)

(cherry picked from commit e26b148f00774accb74ee80669a7081aa273a780)

9 months agoBIGTOP-3584. Fix build failure of Ambari due to missing dependency on javax.el. ...
Masatake Iwasaki [Tue, 28 Sep 2021 05:01:56 +0000 (14:01 +0900)] 
BIGTOP-3584. Fix build failure of Ambari due to missing dependency on javax.el. (#817)

(cherry picked from commit bfbfbc4a064d698e5708d462f4dbb9db5f58d5e3)

9 months agoFix zeppelin build on ppc64le - JIRA BIGTOP-3560 (#813)
afsanjar [Sun, 19 Sep 2021 14:18:55 +0000 (09:18 -0500)] 
Fix zeppelin build on ppc64le - JIRA BIGTOP-3560 (#813)

(cherry picked from commit 84da675c85ccbcb7717b28ea833e4cb8ffc5a09d)

10 months agoBIGTOP-3582. Logstash RPM Build Fails. (#815)
Masatake Iwasaki [Wed, 1 Sep 2021 02:28:41 +0000 (11:28 +0900)] 
BIGTOP-3582. Logstash RPM Build Fails. (#815)

(cherry picked from commit d9f163507e69fc46acdbcf4bb12f5ca22d10e8d3)

10 months agoBIGTOP-3577. HBase smoke test partially fails on ppc64le. (#814)
Kengo Seki [Wed, 25 Aug 2021 21:40:02 +0000 (06:40 +0900)] 
BIGTOP-3577. HBase smoke test partially fails on ppc64le. (#814)

(cherry picked from commit 86ade65daa38946489eac5fc96d1687d62dd8acb)

10 months agoChanging version to 3.0.0
Kengo Seki [Thu, 26 Aug 2021 01:33:03 +0000 (10:33 +0900)] 
Changing version to 3.0.0

10 months agoBIGTOP-3580. Fix deployment failure on Debian 10 caused by the Debian 11 release...
Kengo Seki [Thu, 19 Aug 2021 03:42:57 +0000 (12:42 +0900)] 
BIGTOP-3580. Fix deployment failure on Debian 10 caused by the Debian 11 release. (#812)

10 months agoBIGTOP-3578. Solr smoke test fails on ppc64le. (#810)
Kengo Seki [Mon, 16 Aug 2021 01:49:57 +0000 (10:49 +0900)] 
BIGTOP-3578. Solr smoke test fails on ppc64le. (#810)

10 months agoBIGTOP-3579. Spark smoke test fails on Debian 9 and Ubuntu 18.04. (#808)
Kengo Seki [Fri, 13 Aug 2021 08:17:49 +0000 (17:17 +0900)] 
BIGTOP-3579. Spark smoke test fails on Debian 9 and Ubuntu 18.04. (#808)

10 months agoBIGTOP-3576. Deploying Ambari to Fedora 33 fails on ppc64le. (#809)
Kengo Seki [Fri, 13 Aug 2021 07:03:30 +0000 (16:03 +0900)] 
BIGTOP-3576. Deploying Ambari to Fedora 33 fails on ppc64le. (#809)

10 months agoBIGTOP-3575. Fix Hive rpm build warning due to missing dependency. (#806)
Anton Kurochkin [Wed, 11 Aug 2021 22:28:32 +0000 (01:28 +0300)] 
BIGTOP-3575. Fix Hive rpm build warning due to missing dependency. (#806)

11 months agoBIGTOP-3574. Starting Elasticsearch fails on ppc64le. (#805)
Kengo Seki [Tue, 27 Jul 2021 22:05:49 +0000 (07:05 +0900)] 
BIGTOP-3574. Starting Elasticsearch fails on ppc64le. (#805)

11 months agoBIGTOP-3561. Fix build failure of Kibana on ppc64le. (#804)
afsanjar [Fri, 16 Jul 2021 04:51:12 +0000 (23:51 -0500)] 
BIGTOP-3561. Fix build failure of Kibana on ppc64le. (#804)

11 months agoBIGTOP-3556: Minimum chnages for upgrading Bigtop-ambari-mpack aligned with Ambari...
Yuqi Gu [Thu, 15 Jul 2021 03:12:32 +0000 (11:12 +0800)] 
BIGTOP-3556: Minimum chnages for upgrading Bigtop-ambari-mpack aligned with Ambari 2.7.5 (#803)

minimum changes for bumping the version

Change-Id: Ic2b8936b2f9a5ecd18120bc2144ad09387ae33ea
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
11 months agoBIGTOP-3573. Tez smoke test fails on the ARM platform. (#801)
Masatake Iwasaki [Wed, 14 Jul 2021 07:58:01 +0000 (16:58 +0900)] 
BIGTOP-3573. Tez smoke test fails on the ARM platform. (#801)

11 months agoBIGTOP-3571. Ensure Hadoop and Flink are deployed in the correct order. (#799)
Kengo Seki [Tue, 13 Jul 2021 04:05:41 +0000 (13:05 +0900)] 
BIGTOP-3571. Ensure Hadoop and Flink are deployed in the correct order. (#799)

11 months agoBIGTOP-3569. Applying GPDB Puppet manifest fails on arm64 (addendum). (#800)
Kengo Seki [Tue, 13 Jul 2021 01:44:49 +0000 (10:44 +0900)] 
BIGTOP-3569. Applying GPDB Puppet manifest fails on arm64 (addendum). (#800)

11 months agoBIGTOP-3570. Fix Spark smoke test failures. (#798)
Kengo Seki [Tue, 13 Jul 2021 01:23:16 +0000 (10:23 +0900)] 
BIGTOP-3570. Fix Spark smoke test failures. (#798)

11 months agoBIGTOP-3569. Applying GPDB Puppet manifest fails on arm64. (#797)
Kengo Seki [Sat, 10 Jul 2021 13:40:32 +0000 (22:40 +0900)] 
BIGTOP-3569. Applying GPDB Puppet manifest fails on arm64. (#797)

11 months agoBIGTOP-3568: Fix Ambari-2.7.5 RPM installation issues (#796)
Yuqi Gu [Sat, 10 Jul 2021 13:05:56 +0000 (21:05 +0800)] 
BIGTOP-3568: Fix Ambari-2.7.5 RPM installation issues (#796)

Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
11 months agoBIGTOP-3567. Building Zeppelin fails due to the dependency downloading problem. ...
Kengo Seki [Wed, 7 Jul 2021 01:47:31 +0000 (10:47 +0900)] 
BIGTOP-3567. Building Zeppelin fails due to the dependency downloading problem. (#795)

11 months agoBIGTOP-3565. Fix build failure of Alluxio on Cent OS 7 ppc64le. (#794)
Masatake Iwasaki [Tue, 6 Jul 2021 04:07:55 +0000 (13:07 +0900)] 
BIGTOP-3565. Fix build failure of Alluxio on Cent OS 7 ppc64le. (#794)

12 months agoBIGTOP-3564. Fix build failure of Flink on Cent OS 7 ppc64le. (#793)
Masatake Iwasaki [Tue, 29 Jun 2021 00:32:28 +0000 (09:32 +0900)] 
BIGTOP-3564. Fix build failure of Flink on Cent OS 7 ppc64le. (#793)

12 months agoBIGTOP-3563. Building Hadoop for CentOS 8 fails due to cmake error. (#792)
Masatake Iwasaki [Mon, 28 Jun 2021 13:10:24 +0000 (22:10 +0900)] 
BIGTOP-3563. Building Hadoop for CentOS 8 fails due to cmake error. (#792)

12 months agoBIGTOP-3562. Building Logstash is failing due to the unavailability of keyserver...
Kengo Seki [Mon, 28 Jun 2021 02:05:07 +0000 (11:05 +0900)] 
BIGTOP-3562. Building Logstash is failing due to the unavailability of keyserver. (#791)

12 months agoBIGTOP-3558. Fix build failure of HBase on ppc64le. (#789)
Masatake Iwasaki [Fri, 25 Jun 2021 04:02:38 +0000 (13:02 +0900)] 
BIGTOP-3558. Fix build failure of HBase on ppc64le. (#789)

* BIGTOP-3558. Fix build failure of HBase on ppc64le.

* bumped asciidoctorj.pdf.version to avoid OOM. improved the readability by avoiding duplicate architecture specific conditionals.

* added ppc64le patch for protoc.

12 months agoBIGTOP-3559. Fix the download URL for pip2 in the GPDB deployment manifest. (#790)
Kengo Seki [Tue, 22 Jun 2021 10:12:57 +0000 (19:12 +0900)] 
BIGTOP-3559. Fix the download URL for pip2 in the GPDB deployment manifest. (#790)

12 months agoBIGTOP-3540. Fix toolchain to abort if R installation failed. (#776)
Kengo Seki [Tue, 22 Jun 2021 05:43:01 +0000 (14:43 +0900)] 
BIGTOP-3540. Fix toolchain to abort if R installation failed. (#776)

12 months agoBIGTOP-3555. Drop smoke-tests/odpi-runtime. (#787)
Masatake Iwasaki [Mon, 21 Jun 2021 13:43:37 +0000 (22:43 +0900)] 
BIGTOP-3555. Drop smoke-tests/odpi-runtime. (#787)

12 months agoBIGTOP-3552. Add missing files to ambari-agent RPM. (#782)
Masatake Iwasaki [Thu, 17 Jun 2021 04:39:58 +0000 (13:39 +0900)] 
BIGTOP-3552. Add missing files to ambari-agent RPM. (#782)

12 months agoBIGTOP-3551: Phantomjs caused Ambari build failure on non-x86 (#784)
Jun He [Mon, 14 Jun 2021 00:43:30 +0000 (08:43 +0800)] 
BIGTOP-3551: Phantomjs caused Ambari build failure on non-x86 (#784)

After ambari is bumped to 2.7.5, it cannot build on non-x86
platforms as phantomjs prebuilt is required.
This patch disables phantomjs reference as it is only used
for testing.

Change-Id: Ie23eae41441b201b31d6ed652ac203211b9482a7
Signed-off-by: Jun He <jun.he@arm.com>
12 months agoBIGTOP-3549: HBase build failure caused by protobuf in xolstice (#785)
Jun He [Thu, 10 Jun 2021 15:19:35 +0000 (23:19 +0800)] 
BIGTOP-3549: HBase build failure caused by protobuf in xolstice (#785)

Change-Id: I65a2b9abc1b8e5a8aad26cee189a2ccf002107a7
Signed-off-by: Jun He <jun.he@arm.com>
12 months agoBIGTOP-3548: Hive build failure caused by protoc-jar-maven-plugin missing aarch64...
Jun He [Thu, 10 Jun 2021 09:59:41 +0000 (17:59 +0800)] 
BIGTOP-3548: Hive build failure caused by protoc-jar-maven-plugin missing aarch64 support (#783)

This is a follow-up patch of 0cabb0791e430ec0f710371cecd20b10c9ae815c
to solve the build failure on CentOS-7.
The reason is protoc included in com.github.os72::protoc doesn't work
with legacy centos-7 libc. so we use protoc built by bigtop_toolchain
to create a local jar.

Change-Id: I22b6158997adb946237121ed509159e21d7b6b45
Signed-off-by: Jun He <jun.he@arm.com>
12 months agoBIGTOP-3554: Phoenix build failure caused by protoc-2.5.0 (#786)
Jun He [Wed, 9 Jun 2021 15:44:57 +0000 (23:44 +0800)] 
BIGTOP-3554: Phoenix build failure caused by protoc-2.5.0 (#786)

Change-Id: I7b153ae0c32b2d863488d3075c518e955d7cd9b2
Signed-off-by: Jun He <jun.he@arm.com>
12 months agoBIGTOP-3546. Could not find org.pentaho:pentaho-aggdesigner-algorithm:5.1.5-jhyde.
Matt Andruff [Mon, 31 May 2021 19:49:04 +0000 (15:49 -0400)] 
BIGTOP-3546. Could not find org.pentaho:pentaho-aggdesigner-algorithm:5.1.5-jhyde.

(cherry picked from commit 3eaa3126a3d147d3280407265dde4ebd33eb233f)

12 months agoBIGTOP-3548: Hive build failure caused by protoc-jar-maven-plugin missing aarch64...
Jun He [Sat, 5 Jun 2021 12:24:36 +0000 (20:24 +0800)] 
BIGTOP-3548: Hive build failure caused by protoc-jar-maven-plugin missing aarch64 support (#781)

Hive uses protoc-jar to provide protoc executable to
process *.proto files. The protoc-jar-maven-plugin-2.5.0
doesn't include non-x86 binaries which caused build
failure on non-x86 platforms.
Backport HIVE-21939 to 3.1.2 branch.

Change-Id: I14f9ce54272a3eda1557710ab4276d999eed4a57
Signed-off-by: Jun He <jun.he@arm.com>
13 months agoBIGTOP-3329. Bump ambari to v2.7.5. (#780)
Masatake Iwasaki [Wed, 2 Jun 2021 04:12:40 +0000 (13:12 +0900)] 
BIGTOP-3329. Bump ambari to v2.7.5. (#780)

* BIGTOP-3329. Bump ambari to v2.7.5.

* removed contents related to ambari-client and ambari-shell.

* addressed build failure on Ubuntu.

13 months agoBIGTOP-3545. Nexus configured by docker provisioner fails to download pentaho-aggdesi...
Masatake Iwasaki [Sat, 29 May 2021 01:34:16 +0000 (10:34 +0900)] 
BIGTOP-3545. Nexus configured by docker provisioner fails to download pentaho-aggdesigner-algorithm. (#779)

* BIGTOP-3545. Nexus configured by docker provisioner fails to download pentaho-aggdesigner-algorithm.

* renamed the patch based on relevant Hive JIRA issue id.

13 months agoBIGTOP-3544. Fix Spark build on Debian 9. (#778)
Kengo Seki [Thu, 27 May 2021 04:53:29 +0000 (13:53 +0900)] 
BIGTOP-3544. Fix Spark build on Debian 9. (#778)

13 months agoBIGTOP-3542. Fix build failure of Hadoop on ppc64le. (#777)
Masatake Iwasaki [Mon, 24 May 2021 01:05:51 +0000 (10:05 +0900)] 
BIGTOP-3542. Fix build failure of Hadoop on ppc64le. (#777)

13 months agoBIGTOP-3541: Smoke test on odpi-runtime failed (#775)
Leona Yoda [Tue, 18 May 2021 03:56:29 +0000 (12:56 +0900)] 
BIGTOP-3541: Smoke test on odpi-runtime failed (#775)

Co-authored-by: yoda-mon <Leona.Yoda@nttdata.com>
13 months agoBIGTOP-3538. Building GPDB fails on Fedora 33. (#773)
Kengo Seki [Mon, 17 May 2021 05:03:22 +0000 (14:03 +0900)] 
BIGTOP-3538. Building GPDB fails on Fedora 33. (#773)

13 months agoBIGTOP-3539. Building bigtop-groovy fails on all distros and platforms. (#774)
Kengo Seki [Mon, 17 May 2021 02:04:06 +0000 (11:04 +0900)] 
BIGTOP-3539. Building bigtop-groovy fails on all distros and platforms. (#774)

13 months agoBIGTOP-3537. Fix puppetize.sh to work with the latest CentOS 8 Docker image (addendum...
Kengo Seki [Sat, 15 May 2021 10:16:54 +0000 (19:16 +0900)] 
BIGTOP-3537. Fix puppetize.sh to work with the latest CentOS 8 Docker image (addendum). (#772)

13 months agoBIGTOP-3537. Fix puppetize.sh to work with the latest CentOS 8 Docker image. (#771)
Kengo Seki [Sat, 15 May 2021 06:52:18 +0000 (15:52 +0900)] 
BIGTOP-3537. Fix puppetize.sh to work with the latest CentOS 8 Docker image. (#771)

13 months agoBIGTOP-3457. Add libhdfspp packages to hadoop. (#770)
Masatake Iwasaki [Fri, 14 May 2021 21:44:53 +0000 (06:44 +0900)] 
BIGTOP-3457. Add libhdfspp packages to hadoop. (#770)

* BIGTOP-3457. Add libhdfspp packages to hadoop.

* addressed missing dependency information error.

* revert HADOOP-17196 to fix build failure on CentOS 7.

14 months agoBIGTOP-3523. Drop Ubuntu 16.04 support. (#768)
Kengo Seki [Mon, 26 Apr 2021 06:50:48 +0000 (15:50 +0900)] 
BIGTOP-3523. Drop Ubuntu 16.04 support. (#768)

14 months agoBIGTOP-3535: Add zstd compression headers to add native lib support (#767)
Xiao Yu [Tue, 20 Apr 2021 12:00:57 +0000 (12:00 +0000)] 
BIGTOP-3535: Add zstd compression headers to add native lib support (#767)

14 months agoBIGTOP-3485. Bump Solr to v8.7.0. (#765)
Masatake Iwasaki [Mon, 19 Apr 2021 02:09:24 +0000 (11:09 +0900)] 
BIGTOP-3485. Bump Solr to v8.7.0. (#765)

14 months agoBIGTOP-3532. Fix smoke-tests for Oozie 5.2.1. (#764)
Masatake Iwasaki [Mon, 19 Apr 2021 01:07:00 +0000 (10:07 +0900)] 
BIGTOP-3532. Fix smoke-tests for Oozie 5.2.1. (#764)

14 months agoBIGTOP-3536. Fix build failure of Hadoop on Fedora 33. (#766)
Masatake Iwasaki [Sun, 18 Apr 2021 01:37:51 +0000 (10:37 +0900)] 
BIGTOP-3536. Fix build failure of Hadoop on Fedora 33. (#766)

14 months agoBIGTOP-3531. Fix packaging of Oozie 5.2.1. (#763)
Masatake Iwasaki [Thu, 8 Apr 2021 14:16:05 +0000 (23:16 +0900)] 
BIGTOP-3531. Fix packaging of Oozie 5.2.1. (#763)

* BIGTOP-3531. Fix packaging of Oozie 5.2.1.

* set jetty version to 27.0-jre in do-component-build of hive.

* link each jars rather than whole lib directory.

* put client jars into lib-client directory then symlink from lib in order to make server/client package splitting work.

15 months agoBIGTOP-3529. Drop bigtop-tomcat. (#762)
Masatake Iwasaki [Wed, 31 Mar 2021 23:51:43 +0000 (08:51 +0900)] 
BIGTOP-3529. Drop bigtop-tomcat. (#762)

15 months agoBIGTOP-3528. Bump Oozie to 5.2.1 (#761)
Masatake Iwasaki [Wed, 24 Mar 2021 14:19:09 +0000 (23:19 +0900)] 
BIGTOP-3528. Bump Oozie to 5.2.1 (#761)

15 months agoBIGTOP-3521. Drop QFS. (#757)
Masatake Iwasaki [Fri, 19 Mar 2021 00:08:13 +0000 (09:08 +0900)] 
BIGTOP-3521. Drop QFS. (#757)

15 months agoBIGTOP-3527: replace ${PWD} with ${CURDIR} in debian rules files (#760)
Luca Toscano [Wed, 17 Mar 2021 23:34:05 +0000 (00:34 +0100)] 
BIGTOP-3527: replace ${PWD} with ${CURDIR} in debian rules files (#760)

According to
https://lintian.debian.org/tags/debian-rules-calls-pwd.html,
CURDIR is the preferred way in a makefile (like rules) to refer to the
current directory. For some reason I got building failures when running
a Debian 10 bigtop docker imagei and trying to build the hadoop pkg,
that got solved only applying this fix.

Applied the same fix to all the debian rules files with ${PWD}.

15 months agoBIGTOP-3526: Remove phantomjs depdency from yarn-ui (#759)
Jun He [Wed, 17 Mar 2021 15:01:52 +0000 (23:01 +0800)] 
BIGTOP-3526: Remove phantomjs depdency from yarn-ui (#759)

Haoop Yarn-UI depends on phantomjs (optional) while there is
not prebuilt binary other than x86 platform. And this will
cause hadoop build failure as yarn-ui has been enabled by BIGTOP-3456.

Change-Id: I10d034d3172787f9667d53d44b1663a04c9fdf93
Signed-off-by: Jun He <jun.he@arm.com>
Co-authored-by: Jun He <jun.he@arm.com>
15 months agoBIGTOP-3520. Drop ignite-hadoop. (#756)
Masatake Iwasaki [Wed, 17 Mar 2021 14:15:14 +0000 (23:15 +0900)] 
BIGTOP-3520. Drop ignite-hadoop. (#756)

15 months agoBIGTOP-3519. Drop Flume. (#755)
Masatake Iwasaki [Wed, 17 Mar 2021 12:44:49 +0000 (21:44 +0900)] 
BIGTOP-3519. Drop Flume. (#755)

15 months agoBIGTOP-3524: Hadoop 3.2.2 build failure on Arm (#758)
Jun He [Tue, 16 Mar 2021 13:30:12 +0000 (21:30 +0800)] 
BIGTOP-3524: Hadoop 3.2.2 build failure on Arm (#758)

Fix protobuf missing header on Arm64, and backport arm64 atomic ops.

Change-Id: I3d0899782e21f6012577f9949dc7ef3d6ca2f43d
Signed-off-by: Jun He <jun.he@arm.com>
Co-authored-by: Jun He <jun.he@arm.com>
15 months agoBIGTOP-3512. Drop Giraph. (#753)
Masatake Iwasaki [Wed, 10 Mar 2021 00:01:58 +0000 (09:01 +0900)] 
BIGTOP-3512. Drop Giraph. (#753)

15 months agoBIGTOP-3522. Drop Fedora 31 and add Fedora 33 support. (#752)
Kengo Seki [Tue, 9 Mar 2021 23:35:46 +0000 (08:35 +0900)] 
BIGTOP-3522. Drop Fedora 31 and add Fedora 33 support. (#752)

15 months agoBIGTOP-3511. Drop Mahout. (#744)
Masatake Iwasaki [Sun, 7 Mar 2021 23:25:28 +0000 (08:25 +0900)] 
BIGTOP-3511. Drop Mahout. (#744)

15 months agoBIGTOP-3492. Add Ubuntu 20.04 support to the Docker provisioner. (#747)
Kengo Seki [Sun, 7 Mar 2021 23:17:31 +0000 (08:17 +0900)] 
BIGTOP-3492. Add Ubuntu 20.04 support to the Docker provisioner. (#747)

15 months agoBIGTOP-3517. Bump Livy to 0.7.1. (#751)
Kengo Seki [Sun, 7 Mar 2021 15:05:37 +0000 (00:05 +0900)] 
BIGTOP-3517. Bump Livy to 0.7.1. (#751)

15 months agoBIGTOP-3513. Update deb resources for hadoop-yarn-router and hadoop-hdfs-dfsrouter...
Masatake Iwasaki [Sat, 6 Mar 2021 16:03:06 +0000 (01:03 +0900)] 
BIGTOP-3513. Update deb resources for hadoop-yarn-router and hadoop-hdfs-dfsrouter. (#748)

15 months agoBIGTOP-3516. Remove dead HBase jar link for Hive. (#750)
jshmchenxi [Fri, 5 Mar 2021 14:28:52 +0000 (22:28 +0800)] 
BIGTOP-3516. Remove dead HBase jar link for Hive. (#750)

16 months agoBIGTOP-3514. Bump GPDB to 5.28.5. (#746)
Kengo Seki [Wed, 3 Mar 2021 07:10:03 +0000 (16:10 +0900)] 
BIGTOP-3514. Bump GPDB to 5.28.5. (#746)

16 months agoBIGTOP-3456: Add hadoop-yarn-router and hadoop-hdfs-dfsrouter to hadoop services...
zhuqi [Tue, 2 Mar 2021 06:01:01 +0000 (14:01 +0800)] 
BIGTOP-3456: Add hadoop-yarn-router and hadoop-hdfs-dfsrouter to hadoop services (#703)

16 months agoBIGTOP-3508: drop /usr/share/java from sqoop's bin classpath (#745)
Luca Toscano [Mon, 1 Mar 2021 15:09:14 +0000 (16:09 +0100)] 
BIGTOP-3508: drop /usr/share/java from sqoop's bin classpath (#745)

Co-authored-by: Kengo Seki <sekikn@apache.org>
16 months agoBIGTOP-3507: CVE-2020-13957 mitigation backport (#743)
Jun He [Mon, 1 Mar 2021 15:04:30 +0000 (23:04 +0800)] 
BIGTOP-3507: CVE-2020-13957 mitigation backport (#743)

Fix unauthenticated configset uploads security risk. Patch in SOLR-14663
is backported to v6.6.6

Change-Id: I40c6f7d0edae057acd2182174dbf5fea84c0b825
Signed-off-by: Jun He <jun.he@arm.com>
16 months agoBIGTOP-3510. Drop sqoop2. (#741)
Masatake Iwasaki [Thu, 25 Feb 2021 14:05:30 +0000 (23:05 +0900)] 
BIGTOP-3510. Drop sqoop2. (#741)

16 months agoBIGTOP-3506. Update hadoop-httpfs resources based on hadoop-3. (#740)
Masatake Iwasaki [Wed, 24 Feb 2021 07:35:30 +0000 (16:35 +0900)] 
BIGTOP-3506. Update hadoop-httpfs resources based on hadoop-3. (#740)

* BIGTOP-3506. Update hadoop-httpfs resources based on hadoop-3.

* fixed typo and directory owner settings.

16 months agoBIGTOP-3505. Update hadoop-kms puppet manifests based on hadoop-3. (#739)
Masatake Iwasaki [Sun, 21 Feb 2021 14:04:50 +0000 (23:04 +0900)] 
BIGTOP-3505. Update hadoop-kms puppet manifests based on hadoop-3. (#739)

16 months agoBIGTOP-3501. Update hadoop-kms resources based on hadoop-3. (#738)
Masatake Iwasaki [Sat, 20 Feb 2021 13:55:42 +0000 (22:55 +0900)] 
BIGTOP-3501. Update hadoop-kms resources based on hadoop-3. (#738)

* BIGTOP-3501. Update hadoop-kms resources based on hadoop-3.

* added blank kms-site.xml to hadoop-kms package.

* added example hadoop-env.sh to hadoop-kms package.

16 months agoBIGTOP-3500. Bump Zeppelin to 0.9.0. (#737)
Kengo Seki [Thu, 18 Feb 2021 14:29:36 +0000 (23:29 +0900)] 
BIGTOP-3500. Bump Zeppelin to 0.9.0. (#737)

16 months agoBIGTOP-3495. Optional tools of hadoop-tools should be optional. (#736)
Masatake Iwasaki [Wed, 17 Feb 2021 02:33:02 +0000 (11:33 +0900)] 
BIGTOP-3495. Optional tools of hadoop-tools should be optional. (#736)

16 months agoBIGTOP-3400. Clean up or disable husky installed via packaging Kibana. (#735)
Kengo Seki [Tue, 16 Feb 2021 15:19:33 +0000 (00:19 +0900)] 
BIGTOP-3400. Clean up or disable husky installed via packaging Kibana. (#735)

16 months agoBIGTOP-3499. Fix Logstash build failure due to gem version incompatibility. (#734)
Kengo Seki [Tue, 16 Feb 2021 02:05:57 +0000 (11:05 +0900)] 
BIGTOP-3499. Fix Logstash build failure due to gem version incompatibility. (#734)

16 months agoBIGTOP-3491. Add Ubuntu 20.04 support to the Bigtop toolchain. (#728)
Kengo Seki [Mon, 15 Feb 2021 09:55:57 +0000 (18:55 +0900)] 
BIGTOP-3491. Add Ubuntu 20.04 support to the Bigtop toolchain. (#728)

16 months agoBIGTOP-3498. Bump Phoenix to 5.1.0. (#733)
Kengo Seki [Mon, 15 Feb 2021 06:56:41 +0000 (15:56 +0900)] 
BIGTOP-3498. Bump Phoenix to 5.1.0. (#733)

16 months agoBIGTOP-3484. Bump Alluxio to 2.4.1. (#724)
Kengo Seki [Fri, 12 Feb 2021 08:05:06 +0000 (17:05 +0900)] 
BIGTOP-3484. Bump Alluxio to 2.4.1. (#724)

16 months agoBIGTOP-3497. libcrypto.so should be provided for libhadoop.so. (#732)
Masatake Iwasaki [Wed, 10 Feb 2021 15:28:26 +0000 (00:28 +0900)] 
BIGTOP-3497. libcrypto.so should be provided for libhadoop.so. (#732)

16 months agoBIGTOP-3493. Bump YCSB to 0.17.0. (#729)
Kengo Seki [Tue, 9 Feb 2021 15:50:06 +0000 (00:50 +0900)] 
BIGTOP-3493. Bump YCSB to 0.17.0. (#729)

16 months agoBIGTOP-3494. Add MapReduce settings to yarn.nodemanager.env-whitelist in yarn-site...
Masatake Iwasaki [Tue, 9 Feb 2021 06:46:19 +0000 (15:46 +0900)] 
BIGTOP-3494. Add MapReduce settings to yarn.nodemanager.env-whitelist in yarn-site.xml. (#731)

16 months agoBIGTOP-3382. Upgrade Flink to 1.11.3 (#730)
okumurays [Tue, 9 Feb 2021 03:57:12 +0000 (12:57 +0900)] 
BIGTOP-3382. Upgrade Flink to 1.11.3 (#730)

16 months agoBIGTOP-3488. Bump Kafka to 2.4.1. (#727)
Kengo Seki [Mon, 8 Feb 2021 15:19:40 +0000 (00:19 +0900)] 
BIGTOP-3488. Bump Kafka to 2.4.1. (#727)

16 months agoBIGTOP-3489. Fix Livy build failure with Spark 3. (#725)
Kengo Seki [Mon, 8 Feb 2021 12:29:18 +0000 (21:29 +0900)] 
BIGTOP-3489. Fix Livy build failure with Spark 3. (#725)

16 months agoBIGTOP-3490. Bump Sqoop to 1.4.7. (#726)
Kengo Seki [Sun, 7 Feb 2021 14:12:50 +0000 (23:12 +0900)] 
BIGTOP-3490. Bump Sqoop to 1.4.7. (#726)

16 months agoBIGTOP-3480. Bump Hive to 3.1.2. (#718)
Kengo Seki [Fri, 5 Feb 2021 11:03:20 +0000 (20:03 +0900)] 
BIGTOP-3480. Bump Hive to 3.1.2. (#718)

16 months agoBIGTOP-3481. Bump Spark to 3.0.1. (#721)
Kengo Seki [Thu, 4 Feb 2021 07:16:02 +0000 (16:16 +0900)] 
BIGTOP-3481. Bump Spark to 3.0.1. (#721)

16 months agoBIGTOP-3486. Fix version mismatch of Jetty between Hadoop and HBase. (#722)
Masatake Iwasaki [Thu, 4 Feb 2021 03:44:32 +0000 (12:44 +0900)] 
BIGTOP-3486. Fix version mismatch of Jetty between Hadoop and HBase. (#722)

16 months agoBIGTOP-3478. Fix version mismatch of Guava between Hadoop and HBase. (#723)
Masatake Iwasaki [Thu, 4 Feb 2021 00:10:23 +0000 (09:10 +0900)] 
BIGTOP-3478. Fix version mismatch of Guava between Hadoop and HBase. (#723)

17 months agoBIGTOP-3479. Bump Tez to 0.10.0. (#717)
Kengo Seki [Sat, 30 Jan 2021 11:21:10 +0000 (20:21 +0900)] 
BIGTOP-3479. Bump Tez to 0.10.0. (#717)