bigtop.git
3 months agoUpdate the release notes for 3.0.1 branch-3.0 rel/3.0.1 release-3.0.1
Kengo Seki [Mon, 4 Apr 2022 00:49:19 +0000 (09:49 +0900)] 
Update the release notes for 3.0.1

3 months agoBIGTOP-3659. Ambari deployment fails due to the odpi-ambari-mpack version mismatch...
Kengo Seki [Mon, 4 Apr 2022 00:39:10 +0000 (09:39 +0900)] 
BIGTOP-3659. Ambari deployment fails due to the odpi-ambari-mpack version mismatch. (#881)

(cherry picked from commit 950b534778bc9030564ac4843a67d2b24d8761a8)

3 months agoBIGTOP-3657. Revert the download site to archive.apache.org partially (#879)
Kengo Seki [Tue, 29 Mar 2022 01:04:09 +0000 (10:04 +0900)] 
BIGTOP-3657. Revert the download site to archive.apache.org partially (#879)

(cherry picked from commit c4be81b957a174833f60230e4e708e151705b7d8)

3 months agoBigtop 3.0.1 release
Kengo Seki [Mon, 28 Mar 2022 00:42:21 +0000 (09:42 +0900)] 
Bigtop 3.0.1 release

3 months agoBIGTOP-3639 (addendum). Alluxio build fails on ppc64le. (#877)
Kengo Seki [Mon, 28 Mar 2022 00:39:17 +0000 (09:39 +0900)] 
BIGTOP-3639 (addendum). Alluxio build fails on ppc64le. (#877)

(cherry picked from commit 6094ff896a74030b60ba5ce436b582d2de16bbdb)

3 months agoBIGTOP-3656. Ambari Mpack fixes for debian/ubuntu (#852)
zloKOMAtic [Mon, 28 Mar 2022 00:09:33 +0000 (02:09 +0200)] 
BIGTOP-3656. Ambari Mpack fixes for debian/ubuntu (#852)

(cherry picked from commit 2584d0caeff221da3ad87d5f2e195605e802456f)

3 months agoBIGTOP-3655. Cluster deployment via Ambari fails on CentOS due to the lack of execute...
Kengo Seki [Sun, 27 Mar 2022 06:26:11 +0000 (15:26 +0900)] 
BIGTOP-3655. Cluster deployment via Ambari fails on CentOS due to the lack of execute permission. (#875)

(cherry picked from commit 945c102d14a04023913354e8bec8c5ac2b6470e5)

3 months agoBIGTOP-3592: Remove Ambari stack-select tool dependency from stack hooks (#825)
Yuqi Gu [Thu, 4 Nov 2021 10:01:46 +0000 (18:01 +0800)] 
BIGTOP-3592: Remove Ambari stack-select tool dependency from stack hooks (#825)

Change-Id: I8c34031fc8d21a6d908153f21b85e61b55b5a300
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
(cherry picked from commit 1c1eed9deab5aad4c713bc7afac47879b6407829)

3 months agoBIGTOP-3591: Upgrading Bigtop-Mpack services deploying scripts aligned to Ambari...
Yuqi Gu [Mon, 8 Nov 2021 02:04:31 +0000 (10:04 +0800)] 
BIGTOP-3591: Upgrading Bigtop-Mpack services deploying scripts aligned to Ambari-2.7.5 (#824)

After upgrading Ambari to 2.7.5, it failed to install the services from the Bigtop-Mpack.
The patch is is to upgrade Bigtop-Mpack services deploying scripts and fix the related issues.

Change-Id: I6fa8803dba46a8f908052eaf933ab9aa348df88c
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
(cherry picked from commit 60394e29f03ffdbdd739a932ffeefae1b98c2122)

3 months agoBIGTOP-3639: Alluxio build fails on ppc64le (#861)
afsanjar [Fri, 25 Mar 2022 23:07:42 +0000 (18:07 -0500)] 
BIGTOP-3639: Alluxio  build fails on ppc64le (#861)

(cherry picked from commit b296ae68de2e40c641361679439e05ba6df77f1b)

3 months agoBIGTOP-3654. Building Hadoop fails on ppc64le. (#874)
Kengo Seki [Wed, 23 Mar 2022 03:30:31 +0000 (12:30 +0900)] 
BIGTOP-3654. Building Hadoop fails on ppc64le. (#874)

(cherry picked from commit d3a29877bbbfd096fd1b7dfe422610d459545c37)

3 months agoBIGTOP-3653. Building Kibana fails due to the npm error. (#873)
Kengo Seki [Sun, 20 Mar 2022 05:40:00 +0000 (14:40 +0900)] 
BIGTOP-3653. Building Kibana fails due to the npm error. (#873)

(cherry picked from commit d377c5968248612d147e4c6b43810b94b12e423b)

3 months agoChanging version to 3.0.1
Kengo Seki [Mon, 14 Mar 2022 10:50:35 +0000 (19:50 +0900)] 
Changing version to 3.0.1

3 months agoBIGTOP-3652. Add the python-is-python2 package to the toolchain for Ubuntu 20.04...
Kengo Seki [Fri, 11 Mar 2022 09:38:55 +0000 (18:38 +0900)] 
BIGTOP-3652. Add the python-is-python2 package to the toolchain for Ubuntu 20.04. (#872)

(cherry picked from commit cfd45fa17c85ba74a4a26c224491bf4127603f78)

3 months agoBIGTOP-3649: Fix Nexus local mirror functionality (#870)
cheelio [Fri, 11 Mar 2022 05:44:05 +0000 (06:44 +0100)] 
BIGTOP-3649: Fix Nexus local mirror functionality (#870)

(cherry picked from commit 5d0802eff3c23dc4aeaa61129e1373040c88c620)

4 months agoBIGTOP-3648. Change download site to dlcdn.apache.org for installing Ant and Maven...
Kengo Seki [Sun, 27 Feb 2022 23:16:36 +0000 (08:16 +0900)] 
BIGTOP-3648. Change download site to dlcdn.apache.org for installing Ant and Maven. (#869)

(cherry picked from commit ea790db0c4fc6c5c0590cc86b3c736b766b857d8)

4 months agoBIGTOP-3647. Change RPM repository for CentOS 8 to Vault Mirror. (#868)
Kengo Seki [Fri, 25 Feb 2022 06:21:38 +0000 (15:21 +0900)] 
BIGTOP-3647. Change RPM repository for CentOS 8 to Vault Mirror. (#868)

(cherry picked from commit 42425b8126ec437706cb128249c9240a3d205be7)

4 months agoBIGTOP-3646. Upgrade Geode and TableStore SDK version for YCSB. (#867)
Kengo Seki [Fri, 25 Feb 2022 04:35:51 +0000 (13:35 +0900)] 
BIGTOP-3646. Upgrade Geode and TableStore SDK version for YCSB. (#867)

(cherry picked from commit f8a682615b3bda12d97677de4224b72080d57342)

4 months agoBIGTOP-3637. Add Rocky Linux 8 support. (#859)
Masatake Iwasaki [Sat, 5 Feb 2022 10:58:31 +0000 (19:58 +0900)] 
BIGTOP-3637. Add Rocky Linux 8 support. (#859)

(cherry picked from commit e22bb1114c64f99f65056485dd454bc78b4c9f13)

4 months agoBIGTOP-3642. Upgrade log4j to 2.17.1 on all components. (#863)
Kengo Seki [Tue, 15 Feb 2022 06:08:07 +0000 (15:08 +0900)] 
BIGTOP-3642. Upgrade log4j to 2.17.1 on all components. (#863)

(cherry picked from commit 54cccb2f217ce730f73d4a0c6da967536a90f03e)

4 months agoBIGTOP-3640: Upgrade hive's log4j2 version to 2.17.1 for Bigtop 3.0.x (#862)
Leona Yoda [Thu, 10 Feb 2022 06:59:45 +0000 (15:59 +0900)] 
BIGTOP-3640: Upgrade hive's log4j2 version to 2.17.1 for Bigtop 3.0.x (#862)

(cherry picked from commit 2a0f79e36c3b92b4dd356bcf04553040232e7f28)

5 months agoBIGTOP-3635: Bump logstash's log4j dependencies to 2.17.0 (#858)
Leona Yoda [Wed, 26 Jan 2022 10:07:37 +0000 (19:07 +0900)] 
BIGTOP-3635: Bump logstash's log4j dependencies to 2.17.0 (#858)

(cherry picked from commit d723c1b0320d5894321bc53a6f12a91ae07a07fd)

5 months agoBIGTOP-3634 Fix centos local repo functionality (#856)
cheelio [Tue, 25 Jan 2022 05:32:11 +0000 (06:32 +0100)] 
BIGTOP-3634 Fix centos local repo functionality (#856)

(cherry picked from commit 7702daf1cf0e3534e788fcf659c3c0060f1cd987)

5 months agoBIGTOP-3632: Bump elasticsearch's log4j dependencies to 2.17.0 (#855)
Leona Yoda [Fri, 21 Jan 2022 04:38:29 +0000 (13:38 +0900)] 
BIGTOP-3632: Bump elasticsearch's log4j dependencies to 2.17.0 (#855)

(cherry picked from commit fbba2de359c9e73c67ff93be1c8a9fa457215bc2)

5 months agoBIGTOP-3614: allow to change the docker-compose.yml file in the provisioner (#851)
Luca Toscano [Wed, 12 Jan 2022 15:10:27 +0000 (16:10 +0100)] 
BIGTOP-3614: allow to change the docker-compose.yml file in the provisioner (#851)

This is a simple change to allow docker-compose to use a different
config file when creating instances. This is useful when testing
new settings and also to keep multiple versions of docker-compose.yml
(if the same version cannot be re-used across multiple OS etc..).

For example, from my recent tests the actual docker-compose.yml
config seems not to work with cgroup v2 and systemd on Debian 10/11.

Add also a simple configuration file called docker-compose-cgroupsv2.yml
to be used and tested on different OS(s).

(cherry picked from commit 4648b7113cd88371b5ac74caad9fdc6323496fb6)

5 months agoBIGTOP-3626: Upgrade log4j dependencies for ycsb (#848)
Luca Toscano [Fri, 31 Dec 2021 11:34:53 +0000 (12:34 +0100)] 
BIGTOP-3626: Upgrade log4j dependencies for ycsb (#848)

At the time of writing upstream didn't release any official fix,
but https://github.com/brianfrankcooper/YCSB/pull/1583 seems
taking care of it.

Credits for the upstream fix: Filipe Oliveira <filipecosta.90@gmail.com>

(cherry picked from commit 265e891afe1c374a7eb8199963ef20913322b994)

6 months agoBIGTOP-3589. Fix build failure of Alluxio caused by buildnumber-maven-plugin. (#821)
Masatake Iwasaki [Thu, 30 Dec 2021 12:14:23 +0000 (21:14 +0900)] 
BIGTOP-3589. Fix build failure of Alluxio caused by buildnumber-maven-plugin. (#821)

(cherry picked from commit 78105fffd9902001c9c7ee79853912ba3690c47f)

6 months agoBIGTOP-3624: Bump alluxio's log4j dependencies to 2.17.0 (#847)
Luca Toscano [Sat, 25 Dec 2021 13:00:33 +0000 (14:00 +0100)] 
BIGTOP-3624: Bump alluxio's log4j dependencies to 2.17.0 (#847)

(cherry picked from commit a7671a933f780f9dfab84a46f2b62161392f13f0)

6 months agoBIGTOP-3618. Bump Solr to 8.11.1. (#843)
Masatake Iwasaki [Mon, 20 Dec 2021 15:05:36 +0000 (00:05 +0900)] 
BIGTOP-3618. Bump Solr to 8.11.1. (#843)

(cherry picked from commit 255860ea8a1446e2db857723152f743fb2814f9f)

6 months agoBIGTOP-3616. Bump Flink to 1.11.6. (#842)
Masatake Iwasaki [Mon, 20 Dec 2021 03:24:19 +0000 (12:24 +0900)] 
BIGTOP-3616. Bump Flink to 1.11.6. (#842)

(cherry picked from commit 89f2698f7b86a1ff13d0786e2de8d0fc7449f069)

6 months agoBIGTOP-3615. Upgrade log4j2 of Hive 3.1.2 to 2.16.0. (#841)
Masatake Iwasaki [Thu, 16 Dec 2021 01:29:38 +0000 (10:29 +0900)] 
BIGTOP-3615. Upgrade log4j2 of Hive 3.1.2 to 2.16.0. (#841)

(cherry picked from commit 12885ddf60c2b34b4b6e21ad68fec439f3f72ace)

6 months agoBIGTOP-3609 - Update ca-certificates for CentOS 7 (#838)
Luca Toscano [Tue, 7 Dec 2021 03:03:12 +0000 (04:03 +0100)] 
BIGTOP-3609 - Update ca-certificates for CentOS 7 (#838)

Due to https://access.redhat.com/articles/6338021 ant and maven classes
fail to download due to TLS certificate expiration check issues.
(cherry picked from commit 5a0a583f3a0d327b329e98061d27369b5eb60fe0)

6 months agoBIGTOP-3600 (addendum) - Deploy python*-dev deps on Debian images (#837)
Luca Toscano [Mon, 6 Dec 2021 09:20:25 +0000 (10:20 +0100)] 
BIGTOP-3600 (addendum) - Deploy python*-dev deps on Debian images (#837)

In https://github.com/apache/bigtop/pull/829 I caused some
failures in gpdb package builds, since python2.7-dev
dependencies are needed.

On Debian 9/10/11 python3-dev and python2.7-dev are available,
so better to be explicit and install both at the same time.

(cherry picked from commit d7d3e0edd8cdf4601ac11a9d7b8d9fe38c638001)

7 months agoBIGTOP-3607. Change the ambari metric repo to fix build error (#836)
vivostar [Sun, 28 Nov 2021 10:37:32 +0000 (18:37 +0800)] 
BIGTOP-3607. Change the ambari metric repo to fix build error (#836)

(cherry picked from commit ebbf2f763149da2132a055c11d00d41a4ca01eff)

7 months agoBIGTOP-3600 - Add Debian 11 support to the Docker provisioner (#829)
Luca Toscano [Tue, 16 Nov 2021 06:26:36 +0000 (07:26 +0100)] 
BIGTOP-3600 - Add Debian 11 support to the Docker provisioner (#829)

(cherry picked from commit b312bcd3bfb11b9d13112a783ddfd373c87a8818)

7 months agoBIGTOP-3595: Fix missing webui module for building Alluxio RMP package and failure...
chendeyong [Sat, 6 Nov 2021 12:16:51 +0000 (20:16 +0800)] 
BIGTOP-3595: Fix missing webui module for building Alluxio RMP package and failure to create alluxio user after installing Alluxio (#826)

(cherry picked from commit e3e1e0e70cda56153c0bbed87d8c40d4c36f06d7)

8 months agoBIGTOP-3593: Fix Bigtop solr check Rat Issues (#823)
Yuqi Gu [Mon, 1 Nov 2021 11:41:51 +0000 (19:41 +0800)] 
BIGTOP-3593: Fix Bigtop solr check Rat Issues (#823)

Change-Id: I0edd864e04a0081103d922c7a5317e83568f34f4
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
(cherry picked from commit 22cd25ebcef981ad7357de0969f8676f9a9b45cd)

8 months agoBIGTOP-3590. Hbase smoke tests failed on Ubuntu 20.04. (#822)
Masatake Iwasaki [Mon, 25 Oct 2021 09:54:22 +0000 (18:54 +0900)] 
BIGTOP-3590. Hbase smoke tests failed on Ubuntu 20.04. (#822)

(cherry picked from commit 1f0f13fb0862d48e0121dbe9dd44e64638d32947)

8 months agoUpdate the release notes for 3.0.0 with BIGTOP-3588. rel/3.0.0 release-3.0.0
Kengo Seki [Thu, 14 Oct 2021 23:48:20 +0000 (08:48 +0900)] 
Update the release notes for 3.0.0 with BIGTOP-3588.

8 months agoBIGTOP-3588. Pin redis-rb version for Logstash to 4.4.0. (#820)
Kengo Seki [Thu, 14 Oct 2021 23:26:31 +0000 (08:26 +0900)] 
BIGTOP-3588. Pin redis-rb version for Logstash to 4.4.0. (#820)

(cherry picked from commit 6955a57dcededefc54ebb7f140ac91ab82fb4172)

8 months agoBigtop 3.0.0 release
Kengo Seki [Tue, 12 Oct 2021 00:13:52 +0000 (09:13 +0900)] 
Bigtop 3.0.0 release

8 months agoUpdate default values in hieradata for release 3.0.0
Kengo Seki [Mon, 11 Oct 2021 23:24:29 +0000 (08:24 +0900)] 
Update default values in hieradata for release 3.0.0

(cherry picked from commit c3f73f151f9a639d078280efa1479f22220b20a5)

8 months agoPreparing for release 3.0.0
Kengo Seki [Mon, 11 Oct 2021 23:13:17 +0000 (08:13 +0900)] 
Preparing for release 3.0.0

(cherry picked from commit 8d8de718e2ebad8c5d1c95fb2c31c4d928b417ad)

8 months agoBIGTOP-3585. Remove obsolete text replacement from do-component-build of Ambari....
Masatake Iwasaki [Mon, 11 Oct 2021 11:02:53 +0000 (20:02 +0900)] 
BIGTOP-3585. Remove obsolete text replacement from do-component-build of Ambari. (#818)

(cherry picked from commit 8d32e32b1962414d079b078ecfbf3d1ee1e787fa)

8 months agoBIGTOP-3587. Deploying Ambari to Ubuntu 18.04 and 20.04 fails on ppc64le. (#819)
Kengo Seki [Mon, 11 Oct 2021 08:35:04 +0000 (17:35 +0900)] 
BIGTOP-3587. Deploying Ambari to Ubuntu 18.04 and 20.04 fails on ppc64le. (#819)

(cherry picked from commit e26b148f00774accb74ee80669a7081aa273a780)

9 months agoBIGTOP-3584. Fix build failure of Ambari due to missing dependency on javax.el. ...
Masatake Iwasaki [Tue, 28 Sep 2021 05:01:56 +0000 (14:01 +0900)] 
BIGTOP-3584. Fix build failure of Ambari due to missing dependency on javax.el. (#817)

(cherry picked from commit bfbfbc4a064d698e5708d462f4dbb9db5f58d5e3)

9 months agoFix zeppelin build on ppc64le - JIRA BIGTOP-3560 (#813)
afsanjar [Sun, 19 Sep 2021 14:18:55 +0000 (09:18 -0500)] 
Fix zeppelin build on ppc64le - JIRA BIGTOP-3560 (#813)

(cherry picked from commit 84da675c85ccbcb7717b28ea833e4cb8ffc5a09d)

10 months agoBIGTOP-3582. Logstash RPM Build Fails. (#815)
Masatake Iwasaki [Wed, 1 Sep 2021 02:28:41 +0000 (11:28 +0900)] 
BIGTOP-3582. Logstash RPM Build Fails. (#815)

(cherry picked from commit d9f163507e69fc46acdbcf4bb12f5ca22d10e8d3)

10 months agoBIGTOP-3577. HBase smoke test partially fails on ppc64le. (#814)
Kengo Seki [Wed, 25 Aug 2021 21:40:02 +0000 (06:40 +0900)] 
BIGTOP-3577. HBase smoke test partially fails on ppc64le. (#814)

(cherry picked from commit 86ade65daa38946489eac5fc96d1687d62dd8acb)

10 months agoChanging version to 3.0.0
Kengo Seki [Thu, 26 Aug 2021 01:33:03 +0000 (10:33 +0900)] 
Changing version to 3.0.0

10 months agoBIGTOP-3580. Fix deployment failure on Debian 10 caused by the Debian 11 release...
Kengo Seki [Thu, 19 Aug 2021 03:42:57 +0000 (12:42 +0900)] 
BIGTOP-3580. Fix deployment failure on Debian 10 caused by the Debian 11 release. (#812)

10 months agoBIGTOP-3578. Solr smoke test fails on ppc64le. (#810)
Kengo Seki [Mon, 16 Aug 2021 01:49:57 +0000 (10:49 +0900)] 
BIGTOP-3578. Solr smoke test fails on ppc64le. (#810)

10 months agoBIGTOP-3579. Spark smoke test fails on Debian 9 and Ubuntu 18.04. (#808)
Kengo Seki [Fri, 13 Aug 2021 08:17:49 +0000 (17:17 +0900)] 
BIGTOP-3579. Spark smoke test fails on Debian 9 and Ubuntu 18.04. (#808)

10 months agoBIGTOP-3576. Deploying Ambari to Fedora 33 fails on ppc64le. (#809)
Kengo Seki [Fri, 13 Aug 2021 07:03:30 +0000 (16:03 +0900)] 
BIGTOP-3576. Deploying Ambari to Fedora 33 fails on ppc64le. (#809)

10 months agoBIGTOP-3575. Fix Hive rpm build warning due to missing dependency. (#806)
Anton Kurochkin [Wed, 11 Aug 2021 22:28:32 +0000 (01:28 +0300)] 
BIGTOP-3575. Fix Hive rpm build warning due to missing dependency. (#806)

11 months agoBIGTOP-3574. Starting Elasticsearch fails on ppc64le. (#805)
Kengo Seki [Tue, 27 Jul 2021 22:05:49 +0000 (07:05 +0900)] 
BIGTOP-3574. Starting Elasticsearch fails on ppc64le. (#805)

11 months agoBIGTOP-3561. Fix build failure of Kibana on ppc64le. (#804)
afsanjar [Fri, 16 Jul 2021 04:51:12 +0000 (23:51 -0500)] 
BIGTOP-3561. Fix build failure of Kibana on ppc64le. (#804)

11 months agoBIGTOP-3556: Minimum chnages for upgrading Bigtop-ambari-mpack aligned with Ambari...
Yuqi Gu [Thu, 15 Jul 2021 03:12:32 +0000 (11:12 +0800)] 
BIGTOP-3556: Minimum chnages for upgrading Bigtop-ambari-mpack aligned with Ambari 2.7.5 (#803)

minimum changes for bumping the version

Change-Id: Ic2b8936b2f9a5ecd18120bc2144ad09387ae33ea
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
11 months agoBIGTOP-3573. Tez smoke test fails on the ARM platform. (#801)
Masatake Iwasaki [Wed, 14 Jul 2021 07:58:01 +0000 (16:58 +0900)] 
BIGTOP-3573. Tez smoke test fails on the ARM platform. (#801)

11 months agoBIGTOP-3571. Ensure Hadoop and Flink are deployed in the correct order. (#799)
Kengo Seki [Tue, 13 Jul 2021 04:05:41 +0000 (13:05 +0900)] 
BIGTOP-3571. Ensure Hadoop and Flink are deployed in the correct order. (#799)

11 months agoBIGTOP-3569. Applying GPDB Puppet manifest fails on arm64 (addendum). (#800)
Kengo Seki [Tue, 13 Jul 2021 01:44:49 +0000 (10:44 +0900)] 
BIGTOP-3569. Applying GPDB Puppet manifest fails on arm64 (addendum). (#800)

11 months agoBIGTOP-3570. Fix Spark smoke test failures. (#798)
Kengo Seki [Tue, 13 Jul 2021 01:23:16 +0000 (10:23 +0900)] 
BIGTOP-3570. Fix Spark smoke test failures. (#798)

11 months agoBIGTOP-3569. Applying GPDB Puppet manifest fails on arm64. (#797)
Kengo Seki [Sat, 10 Jul 2021 13:40:32 +0000 (22:40 +0900)] 
BIGTOP-3569. Applying GPDB Puppet manifest fails on arm64. (#797)

11 months agoBIGTOP-3568: Fix Ambari-2.7.5 RPM installation issues (#796)
Yuqi Gu [Sat, 10 Jul 2021 13:05:56 +0000 (21:05 +0800)] 
BIGTOP-3568: Fix Ambari-2.7.5 RPM installation issues (#796)

Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
11 months agoBIGTOP-3567. Building Zeppelin fails due to the dependency downloading problem. ...
Kengo Seki [Wed, 7 Jul 2021 01:47:31 +0000 (10:47 +0900)] 
BIGTOP-3567. Building Zeppelin fails due to the dependency downloading problem. (#795)

11 months agoBIGTOP-3565. Fix build failure of Alluxio on Cent OS 7 ppc64le. (#794)
Masatake Iwasaki [Tue, 6 Jul 2021 04:07:55 +0000 (13:07 +0900)] 
BIGTOP-3565. Fix build failure of Alluxio on Cent OS 7 ppc64le. (#794)

12 months agoBIGTOP-3564. Fix build failure of Flink on Cent OS 7 ppc64le. (#793)
Masatake Iwasaki [Tue, 29 Jun 2021 00:32:28 +0000 (09:32 +0900)] 
BIGTOP-3564. Fix build failure of Flink on Cent OS 7 ppc64le. (#793)

12 months agoBIGTOP-3563. Building Hadoop for CentOS 8 fails due to cmake error. (#792)
Masatake Iwasaki [Mon, 28 Jun 2021 13:10:24 +0000 (22:10 +0900)] 
BIGTOP-3563. Building Hadoop for CentOS 8 fails due to cmake error. (#792)

12 months agoBIGTOP-3562. Building Logstash is failing due to the unavailability of keyserver...
Kengo Seki [Mon, 28 Jun 2021 02:05:07 +0000 (11:05 +0900)] 
BIGTOP-3562. Building Logstash is failing due to the unavailability of keyserver. (#791)

12 months agoBIGTOP-3558. Fix build failure of HBase on ppc64le. (#789)
Masatake Iwasaki [Fri, 25 Jun 2021 04:02:38 +0000 (13:02 +0900)] 
BIGTOP-3558. Fix build failure of HBase on ppc64le. (#789)

* BIGTOP-3558. Fix build failure of HBase on ppc64le.

* bumped asciidoctorj.pdf.version to avoid OOM. improved the readability by avoiding duplicate architecture specific conditionals.

* added ppc64le patch for protoc.

12 months agoBIGTOP-3559. Fix the download URL for pip2 in the GPDB deployment manifest. (#790)
Kengo Seki [Tue, 22 Jun 2021 10:12:57 +0000 (19:12 +0900)] 
BIGTOP-3559. Fix the download URL for pip2 in the GPDB deployment manifest. (#790)

12 months agoBIGTOP-3540. Fix toolchain to abort if R installation failed. (#776)
Kengo Seki [Tue, 22 Jun 2021 05:43:01 +0000 (14:43 +0900)] 
BIGTOP-3540. Fix toolchain to abort if R installation failed. (#776)

12 months agoBIGTOP-3555. Drop smoke-tests/odpi-runtime. (#787)
Masatake Iwasaki [Mon, 21 Jun 2021 13:43:37 +0000 (22:43 +0900)] 
BIGTOP-3555. Drop smoke-tests/odpi-runtime. (#787)

12 months agoBIGTOP-3552. Add missing files to ambari-agent RPM. (#782)
Masatake Iwasaki [Thu, 17 Jun 2021 04:39:58 +0000 (13:39 +0900)] 
BIGTOP-3552. Add missing files to ambari-agent RPM. (#782)

12 months agoBIGTOP-3551: Phantomjs caused Ambari build failure on non-x86 (#784)
Jun He [Mon, 14 Jun 2021 00:43:30 +0000 (08:43 +0800)] 
BIGTOP-3551: Phantomjs caused Ambari build failure on non-x86 (#784)

After ambari is bumped to 2.7.5, it cannot build on non-x86
platforms as phantomjs prebuilt is required.
This patch disables phantomjs reference as it is only used
for testing.

Change-Id: Ie23eae41441b201b31d6ed652ac203211b9482a7
Signed-off-by: Jun He <jun.he@arm.com>
12 months agoBIGTOP-3549: HBase build failure caused by protobuf in xolstice (#785)
Jun He [Thu, 10 Jun 2021 15:19:35 +0000 (23:19 +0800)] 
BIGTOP-3549: HBase build failure caused by protobuf in xolstice (#785)

Change-Id: I65a2b9abc1b8e5a8aad26cee189a2ccf002107a7
Signed-off-by: Jun He <jun.he@arm.com>
12 months agoBIGTOP-3548: Hive build failure caused by protoc-jar-maven-plugin missing aarch64...
Jun He [Thu, 10 Jun 2021 09:59:41 +0000 (17:59 +0800)] 
BIGTOP-3548: Hive build failure caused by protoc-jar-maven-plugin missing aarch64 support (#783)

This is a follow-up patch of 0cabb0791e430ec0f710371cecd20b10c9ae815c
to solve the build failure on CentOS-7.
The reason is protoc included in com.github.os72::protoc doesn't work
with legacy centos-7 libc. so we use protoc built by bigtop_toolchain
to create a local jar.

Change-Id: I22b6158997adb946237121ed509159e21d7b6b45
Signed-off-by: Jun He <jun.he@arm.com>
12 months agoBIGTOP-3554: Phoenix build failure caused by protoc-2.5.0 (#786)
Jun He [Wed, 9 Jun 2021 15:44:57 +0000 (23:44 +0800)] 
BIGTOP-3554: Phoenix build failure caused by protoc-2.5.0 (#786)

Change-Id: I7b153ae0c32b2d863488d3075c518e955d7cd9b2
Signed-off-by: Jun He <jun.he@arm.com>
12 months agoBIGTOP-3546. Could not find org.pentaho:pentaho-aggdesigner-algorithm:5.1.5-jhyde.
Matt Andruff [Mon, 31 May 2021 19:49:04 +0000 (15:49 -0400)] 
BIGTOP-3546. Could not find org.pentaho:pentaho-aggdesigner-algorithm:5.1.5-jhyde.

(cherry picked from commit 3eaa3126a3d147d3280407265dde4ebd33eb233f)

13 months agoBIGTOP-3548: Hive build failure caused by protoc-jar-maven-plugin missing aarch64...
Jun He [Sat, 5 Jun 2021 12:24:36 +0000 (20:24 +0800)] 
BIGTOP-3548: Hive build failure caused by protoc-jar-maven-plugin missing aarch64 support (#781)

Hive uses protoc-jar to provide protoc executable to
process *.proto files. The protoc-jar-maven-plugin-2.5.0
doesn't include non-x86 binaries which caused build
failure on non-x86 platforms.
Backport HIVE-21939 to 3.1.2 branch.

Change-Id: I14f9ce54272a3eda1557710ab4276d999eed4a57
Signed-off-by: Jun He <jun.he@arm.com>
13 months agoBIGTOP-3329. Bump ambari to v2.7.5. (#780)
Masatake Iwasaki [Wed, 2 Jun 2021 04:12:40 +0000 (13:12 +0900)] 
BIGTOP-3329. Bump ambari to v2.7.5. (#780)

* BIGTOP-3329. Bump ambari to v2.7.5.

* removed contents related to ambari-client and ambari-shell.

* addressed build failure on Ubuntu.

13 months agoBIGTOP-3545. Nexus configured by docker provisioner fails to download pentaho-aggdesi...
Masatake Iwasaki [Sat, 29 May 2021 01:34:16 +0000 (10:34 +0900)] 
BIGTOP-3545. Nexus configured by docker provisioner fails to download pentaho-aggdesigner-algorithm. (#779)

* BIGTOP-3545. Nexus configured by docker provisioner fails to download pentaho-aggdesigner-algorithm.

* renamed the patch based on relevant Hive JIRA issue id.

13 months agoBIGTOP-3544. Fix Spark build on Debian 9. (#778)
Kengo Seki [Thu, 27 May 2021 04:53:29 +0000 (13:53 +0900)] 
BIGTOP-3544. Fix Spark build on Debian 9. (#778)

13 months agoBIGTOP-3542. Fix build failure of Hadoop on ppc64le. (#777)
Masatake Iwasaki [Mon, 24 May 2021 01:05:51 +0000 (10:05 +0900)] 
BIGTOP-3542. Fix build failure of Hadoop on ppc64le. (#777)

13 months agoBIGTOP-3541: Smoke test on odpi-runtime failed (#775)
Leona Yoda [Tue, 18 May 2021 03:56:29 +0000 (12:56 +0900)] 
BIGTOP-3541: Smoke test on odpi-runtime failed (#775)

Co-authored-by: yoda-mon <Leona.Yoda@nttdata.com>
13 months agoBIGTOP-3538. Building GPDB fails on Fedora 33. (#773)
Kengo Seki [Mon, 17 May 2021 05:03:22 +0000 (14:03 +0900)] 
BIGTOP-3538. Building GPDB fails on Fedora 33. (#773)

13 months agoBIGTOP-3539. Building bigtop-groovy fails on all distros and platforms. (#774)
Kengo Seki [Mon, 17 May 2021 02:04:06 +0000 (11:04 +0900)] 
BIGTOP-3539. Building bigtop-groovy fails on all distros and platforms. (#774)

13 months agoBIGTOP-3537. Fix puppetize.sh to work with the latest CentOS 8 Docker image (addendum...
Kengo Seki [Sat, 15 May 2021 10:16:54 +0000 (19:16 +0900)] 
BIGTOP-3537. Fix puppetize.sh to work with the latest CentOS 8 Docker image (addendum). (#772)

13 months agoBIGTOP-3537. Fix puppetize.sh to work with the latest CentOS 8 Docker image. (#771)
Kengo Seki [Sat, 15 May 2021 06:52:18 +0000 (15:52 +0900)] 
BIGTOP-3537. Fix puppetize.sh to work with the latest CentOS 8 Docker image. (#771)

13 months agoBIGTOP-3457. Add libhdfspp packages to hadoop. (#770)
Masatake Iwasaki [Fri, 14 May 2021 21:44:53 +0000 (06:44 +0900)] 
BIGTOP-3457. Add libhdfspp packages to hadoop. (#770)

* BIGTOP-3457. Add libhdfspp packages to hadoop.

* addressed missing dependency information error.

* revert HADOOP-17196 to fix build failure on CentOS 7.

14 months agoBIGTOP-3523. Drop Ubuntu 16.04 support. (#768)
Kengo Seki [Mon, 26 Apr 2021 06:50:48 +0000 (15:50 +0900)] 
BIGTOP-3523. Drop Ubuntu 16.04 support. (#768)

14 months agoBIGTOP-3535: Add zstd compression headers to add native lib support (#767)
Xiao Yu [Tue, 20 Apr 2021 12:00:57 +0000 (12:00 +0000)] 
BIGTOP-3535: Add zstd compression headers to add native lib support (#767)

14 months agoBIGTOP-3485. Bump Solr to v8.7.0. (#765)
Masatake Iwasaki [Mon, 19 Apr 2021 02:09:24 +0000 (11:09 +0900)] 
BIGTOP-3485. Bump Solr to v8.7.0. (#765)

14 months agoBIGTOP-3532. Fix smoke-tests for Oozie 5.2.1. (#764)
Masatake Iwasaki [Mon, 19 Apr 2021 01:07:00 +0000 (10:07 +0900)] 
BIGTOP-3532. Fix smoke-tests for Oozie 5.2.1. (#764)

14 months agoBIGTOP-3536. Fix build failure of Hadoop on Fedora 33. (#766)
Masatake Iwasaki [Sun, 18 Apr 2021 01:37:51 +0000 (10:37 +0900)] 
BIGTOP-3536. Fix build failure of Hadoop on Fedora 33. (#766)

14 months agoBIGTOP-3531. Fix packaging of Oozie 5.2.1. (#763)
Masatake Iwasaki [Thu, 8 Apr 2021 14:16:05 +0000 (23:16 +0900)] 
BIGTOP-3531. Fix packaging of Oozie 5.2.1. (#763)

* BIGTOP-3531. Fix packaging of Oozie 5.2.1.

* set jetty version to 27.0-jre in do-component-build of hive.

* link each jars rather than whole lib directory.

* put client jars into lib-client directory then symlink from lib in order to make server/client package splitting work.

15 months agoBIGTOP-3529. Drop bigtop-tomcat. (#762)
Masatake Iwasaki [Wed, 31 Mar 2021 23:51:43 +0000 (08:51 +0900)] 
BIGTOP-3529. Drop bigtop-tomcat. (#762)

15 months agoBIGTOP-3528. Bump Oozie to 5.2.1 (#761)
Masatake Iwasaki [Wed, 24 Mar 2021 14:19:09 +0000 (23:19 +0900)] 
BIGTOP-3528. Bump Oozie to 5.2.1 (#761)

15 months agoBIGTOP-3521. Drop QFS. (#757)
Masatake Iwasaki [Fri, 19 Mar 2021 00:08:13 +0000 (09:08 +0900)] 
BIGTOP-3521. Drop QFS. (#757)

15 months agoBIGTOP-3527: replace ${PWD} with ${CURDIR} in debian rules files (#760)
Luca Toscano [Wed, 17 Mar 2021 23:34:05 +0000 (00:34 +0100)] 
BIGTOP-3527: replace ${PWD} with ${CURDIR} in debian rules files (#760)

According to
https://lintian.debian.org/tags/debian-rules-calls-pwd.html,
CURDIR is the preferred way in a makefile (like rules) to refer to the
current directory. For some reason I got building failures when running
a Debian 10 bigtop docker imagei and trying to build the hadoop pkg,
that got solved only applying this fix.

Applied the same fix to all the debian rules files with ${PWD}.