bigtop.git
26 hours agoBIGTOP-3775: Failed to build Phoenix on Arm64/powerpc64le (#980) master
Yuqi Gu [Fri, 12 Aug 2022 04:53:00 +0000 (12:53 +0800)] 
BIGTOP-3775: Failed to build Phoenix on Arm64/powerpc64le (#980)

Change-Id: Ibe38c50e6cbf83d1e89f3b35c8c4ee500d49d329
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
2 days agoBIGTOP-3771. Fix failure of sqlline.py bundled with Phoenix. (#977)
Masatake Iwasaki [Wed, 10 Aug 2022 12:27:42 +0000 (21:27 +0900)] 
BIGTOP-3771. Fix failure of sqlline.py bundled with Phoenix. (#977)

* BIGTOP-3771. Fix failure of sqlline.py bundled with Phoenix.

2 days agoBIGTOP-3774: Drop Docker Sandbox and Vagrant Provisioner (#978)
Evans Ye [Wed, 10 Aug 2022 08:56:22 +0000 (16:56 +0800)] 
BIGTOP-3774: Drop Docker Sandbox and Vagrant Provisioner (#978)

* BIGTOP-3774: Drop Docker Sandbox and Vagrant Provisioner

* BIGTOP-3774: address yuqi's comment

3 days agoBIGTOP-3772: Add Solr support for Bigtop 3.1.0 Mpack (#976)
吴治国 [Wed, 10 Aug 2022 07:23:30 +0000 (15:23 +0800)] 
BIGTOP-3772: Add Solr support for Bigtop 3.1.0 Mpack (#976)

3 days agoBIGTOP-3740: Add Zeppelin support for Bigtop 3.1.0 Mpack (#954)
吴治国 [Wed, 10 Aug 2022 05:01:01 +0000 (13:01 +0800)] 
BIGTOP-3740: Add Zeppelin support for Bigtop 3.1.0 Mpack (#954)

* BIGTOP-3740: Add Zeppelin support for Bigtop 3.1.0 Mpack

3 days agoBIGTOP-3752: WebHDFS api path encode space character (#953)
吴治国 [Wed, 10 Aug 2022 04:44:13 +0000 (12:44 +0800)] 
BIGTOP-3752: WebHDFS api path encode space character (#953)

5 days agoBIGTOP-3700: Bump Zeppelin to 0.10.1 (#975)
Yuqi Gu [Mon, 8 Aug 2022 06:26:54 +0000 (14:26 +0800)] 
BIGTOP-3700: Bump Zeppelin to 0.10.1 (#975)

Change-Id: If7f59b4825c6ea32407ca5ae3ba08e7d392d1a77
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
5 days agoBIGTOP-3760. addendum. reverting temporary download URL for testing RC.
Masatake Iwasaki [Mon, 8 Aug 2022 04:09:40 +0000 (04:09 +0000)] 
BIGTOP-3760. addendum. reverting temporary download URL for testing RC.

6 days agoBigtop 3.1.1 release
Kengo Seki [Sun, 7 Aug 2022 07:15:25 +0000 (16:15 +0900)] 
Bigtop 3.1.1 release

6 days agoBigtop 3.1.1 website update
Kengo Seki [Sun, 7 Aug 2022 05:19:35 +0000 (14:19 +0900)] 
Bigtop 3.1.1 website update

7 days ago[WIP]BIGTOP-3760. Bump Hadoop to 3.3.4. (#964)
Masatake Iwasaki [Fri, 5 Aug 2022 10:12:00 +0000 (19:12 +0900)] 
[WIP]BIGTOP-3760. Bump Hadoop to 3.3.4. (#964)

* BIGTOP-3760. Bump Hadoop to 3.3.4.

* addressed additional dependency on okhttp in hbase-shaded.

* rebased the patch1-relocate-okhttp.diff to HBase 2.4.13.

* RC0 was canceled and RC1 is now under vote.

8 days agoBIGTOP-3769: Upgrade Sqoop ivy version to 2.5.0 (#974)
吴治国 [Fri, 5 Aug 2022 06:54:51 +0000 (14:54 +0800)] 
BIGTOP-3769: Upgrade Sqoop ivy version to 2.5.0 (#974)

* BIGTOP-3769: Upgrade Sqoop ivy version to 2.5.0

* merge patch

Co-authored-by: wuzhiguo <datakun-open@startdt.com>
10 days agoBIGTOP-3768. Add Spark User Hdfs Folder for Deploy Spark Thrift Server (#972)
Peng Lee [Wed, 3 Aug 2022 04:44:21 +0000 (00:44 -0400)] 
BIGTOP-3768. Add Spark User Hdfs Folder for Deploy Spark Thrift Server (#972)

11 days agoBIGTOP-3727: Add HBase support for Bigtop 3.1.0 Mpack (#947)
yzydhf [Mon, 1 Aug 2022 08:46:58 +0000 (16:46 +0800)] 
BIGTOP-3727: Add HBase support for Bigtop 3.1.0 Mpack (#947)

* BIGTOP-3727: Add HBase support for Bigtop 3.1.0 Mpack

* remove phoenix dependency

Co-authored-by: wangxiangjun <wangxiangjun@datakun-0003.com>
12 days agoBIGTOP-3765: Remove cmake conditional for Hadoop rpm spec (#971)
Yuqi Gu [Mon, 1 Aug 2022 03:42:48 +0000 (11:42 +0800)] 
BIGTOP-3765: Remove cmake conditional for Hadoop rpm spec (#971)

Change-Id: I0e7f47512b7717103e97ae51d712bfee8fe716a9
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
2 weeks agoBIGTOP-3761. Fix bigtop_toolchain to enable EPEL before downloading packages (#969)
Shuhei Yamasaki [Sat, 30 Jul 2022 00:08:07 +0000 (09:08 +0900)] 
BIGTOP-3761. Fix bigtop_toolchain to enable EPEL before downloading packages (#969)

Co-authored-by: Shuhei Yamasaki <Shuhei.Yamasaki@oss.nttdata.com>
2 weeks agoBIGTOP-3763: Fix Hive build issues about protobuf 2.5.0 on Arm64 and PPC64le (#970)
Yuqi Gu [Fri, 29 Jul 2022 09:07:36 +0000 (17:07 +0800)] 
BIGTOP-3763: Fix Hive build issues about protobuf 2.5.0 on Arm64 and PPC64le (#970)

Change-Id: I59811ca32e70a8a2c8eb261e55b0e8470590b7ce
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
2 weeks agoBIGTOP-3696. Bump Alluxio to 2.8.0 (#966)
Shuhei Yamasaki [Wed, 27 Jul 2022 02:10:23 +0000 (11:10 +0900)] 
BIGTOP-3696. Bump Alluxio to 2.8.0 (#966)

Co-authored-by: Shuhei Yamasaki <Shuhei.Yamasaki@oss.nttdata.com>
2 weeks agoBIGTOP-3754. Add Ubuntu 22.04 option (#956)
Leona Yoda [Tue, 26 Jul 2022 09:39:46 +0000 (18:39 +0900)] 
BIGTOP-3754. Add Ubuntu 22.04 option (#956)

2 weeks agoBIGTOP-3762: Add JVM options for spark build to avoid StackOverflowError (#967)
Leona Yoda [Tue, 26 Jul 2022 05:21:56 +0000 (14:21 +0900)] 
BIGTOP-3762: Add JVM options for spark build to avoid StackOverflowError (#967)

2 weeks agoBIGTOP-3758. Fix build failure of Tez against Hadoop 3.3. (#963)
Masatake Iwasaki [Mon, 25 Jul 2022 04:58:54 +0000 (13:58 +0900)] 
BIGTOP-3758. Fix build failure of Tez against Hadoop 3.3. (#963)

2 weeks agoBIGTOP-3755. Bump HBase to 2.4.13. (#960)
Masatake Iwasaki [Mon, 25 Jul 2022 03:57:05 +0000 (12:57 +0900)] 
BIGTOP-3755. Bump HBase to 2.4.13. (#960)

2 weeks agoBIGTOP-3759: Remove ELK from Bigtop 3.2.0 stack (#962)
吴治国 [Sun, 24 Jul 2022 00:54:41 +0000 (08:54 +0800)] 
BIGTOP-3759: Remove ELK from Bigtop 3.2.0 stack (#962)

2 weeks agoBIGTOP-3744. Puppet Deploy Hive on Tez add Resource Resizing Configs (#946)
Peng Lee [Sun, 24 Jul 2022 00:32:09 +0000 (20:32 -0400)] 
BIGTOP-3744. Puppet Deploy Hive on Tez add Resource Resizing Configs (#946)

3 weeks agoUpdate default values in hieradata for release 3.1.1
Kengo Seki [Sat, 23 Jul 2022 06:10:32 +0000 (15:10 +0900)] 
Update default values in hieradata for release 3.1.1

3 weeks agoBIGTOP-3750: Add Chrony synchronization to fix hostcheck issue in Mpack docker provis...
Yuqi Gu [Thu, 21 Jul 2022 09:47:35 +0000 (17:47 +0800)] 
BIGTOP-3750: Add Chrony synchronization to fix hostcheck issue in Mpack docker provisioner (#952)

Add Chrony synchronization to fix hostcheck issue in Mpack docker provisioner.
Also silence the shellcheck issues: SC2046 and SC2164.

Change-Id: I5e9609bde970d1ec590b13afb915551e4364e377
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
3 weeks agoBIGTOP-3697: Bump HBase to 2.4.12 (#959)
Yuqi Gu [Thu, 21 Jul 2022 09:38:00 +0000 (17:38 +0800)] 
BIGTOP-3697: Bump HBase to 2.4.12 (#959)

Change-Id: I5353c27351006501fe9bec1d1f23f5953857dd91
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
3 weeks agoBIGTOP-3708. Hive build error with Hadoop 3.3.3. (#958)
Masatake Iwasaki [Thu, 21 Jul 2022 08:36:53 +0000 (17:36 +0900)] 
BIGTOP-3708. Hive build error with Hadoop 3.3.3. (#958)

3 weeks agoBIGTOP-3737: Fix build failure of Sqoop due to unresolved dependency on javax.activat...
吴治国 [Thu, 21 Jul 2022 04:38:55 +0000 (12:38 +0800)] 
BIGTOP-3737: Fix build failure of Sqoop due to unresolved dependency on javax.activation-api (#957)

3 weeks agoBIGTOP-3753. Bump Solr to 8.11.2 (#955)
Shuhei Yamasaki [Tue, 19 Jul 2022 23:43:04 +0000 (08:43 +0900)] 
BIGTOP-3753. Bump Solr to 8.11.2 (#955)

3 weeks agoBIGTOP-3747. zeppelin includes plugins directory (#949)
Halim Kim [Tue, 19 Jul 2022 06:49:12 +0000 (15:49 +0900)] 
BIGTOP-3747. zeppelin includes plugins directory (#949)

* BIGTOP-3747. zeppelin includes plugins directory

* BIGTOP-3747 install_zeppelin.sh plugins dir added

Co-authored-by: halim-kim <halim.kim@navercorp.com>
3 weeks agoBIGTOP-3751. Fix build failure of Zeppelin due to dependency convergence error. ...
Masatake Iwasaki [Tue, 19 Jul 2022 06:47:56 +0000 (15:47 +0900)] 
BIGTOP-3751. Fix build failure of Zeppelin due to dependency convergence error. (#951)

* BIGTOP-3751. Fix build failure of Zeppelin due to dependency convergence error.

* bumped the release number.

3 weeks agoBIGTOP-3739: Add Tez support for Bigtop 3.1.0 Mpack (#948)
timyuer [Mon, 18 Jul 2022 15:45:05 +0000 (23:45 +0800)] 
BIGTOP-3739: Add Tez support for Bigtop 3.1.0 Mpack (#948)

* BIGTOP-3739: Add Tez support for Bigtop 3.1.0 Mpack

Co-authored-by: houyu <houyu@jndv.com>
4 weeks agoBIGTOP-3742: Add tez.tar.gz to tez lib dir (#945)
吴治国 [Sat, 16 Jul 2022 03:07:35 +0000 (11:07 +0800)] 
BIGTOP-3742: Add tez.tar.gz to tez lib dir (#945)

(cherry picked from commit 3d0a8d4957a6e12105a5e24dcb9f643bd6b7fbba)

4 weeks agoBIGTOP-3734: Add Sqoop support for Bigtop 3.1.0 Mpack (#943)
timyuer [Thu, 14 Jul 2022 11:36:44 +0000 (19:36 +0800)] 
BIGTOP-3734: Add Sqoop support for Bigtop 3.1.0 Mpack (#943)

Co-authored-by: houyu <houyu@jndv.com>
4 weeks agoBIGTOP-3735: Fix sqoop cannot found StringUtils from common-lang (#944)
吴治国 [Thu, 14 Jul 2022 03:26:14 +0000 (11:26 +0800)] 
BIGTOP-3735: Fix sqoop cannot found StringUtils from common-lang (#944)

(cherry picked from commit 2b13a53e64b79aaa113c5553577258dfb857c25e)

4 weeks agoBIGTOP-3728: Docker dev/test env for centos7 (#940)
吴治国 [Tue, 12 Jul 2022 10:13:59 +0000 (18:13 +0800)] 
BIGTOP-3728: Docker dev/test env for centos7 (#940)

* BIGTOP-3728: Docker dev/test env for centos7

4 weeks agoBIGTOP-3733. Building Logstash fails on Rocky 8 (#941)
Shuhei Yamasaki [Tue, 12 Jul 2022 04:46:02 +0000 (13:46 +0900)] 
BIGTOP-3733. Building Logstash fails on Rocky 8 (#941)

5 weeks agoBIGTOP-3721: Add Kafka support for Bigtop 3.1.0 Mpack (#930)
吴治国 [Fri, 8 Jul 2022 08:11:50 +0000 (16:11 +0800)] 
BIGTOP-3721: Add Kafka support for Bigtop 3.1.0 Mpack (#930)

* BIGTOP-3689: Add Kafka support for Bigtop 3.1.0 Mpack

5 weeks agoBIGTOP-3717: Update MapReduce service configuration in Mpack (#933)
Yuqi Gu [Fri, 8 Jul 2022 06:46:49 +0000 (14:46 +0800)] 
BIGTOP-3717: Update MapReduce service configuration in Mpack (#933)

Mapred configuration macros are deprected (HADOOP_MAPRED_ROOT_LOGGER,
HADOOP_JOB_HISTORYSERVER_OPTS, HADOOP_MAPRED_NICENESS, etc.).

Update them in Mpack aligned to
https://github.com/apache/hadoop/blob/trunk/hadoop-mapreduce-project/bin/mapred-config.sh#L38-L54

Change-Id: Id2f105d712119e8a930927b99e39b23ed74414a1
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
5 weeks agoBIGTOP-3718: Fix MapReduce2 service-check in Amabri Mpack (#932)
Yuqi Gu [Fri, 8 Jul 2022 06:46:02 +0000 (14:46 +0800)] 
BIGTOP-3718: Fix MapReduce2 service-check in Amabri Mpack (#932)

The patch is to fix the issues of checking MapReduce2 service and
"JAR does not exist".

Change-Id: I59ad4d3ecbe88af7bea25bf7177502ebb3e2cf6b
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
5 weeks agoBIGTOP-3724. Increment the release number of ZooKeeper and Kafka. (#938)
Masatake Iwasaki [Fri, 8 Jul 2022 05:22:20 +0000 (14:22 +0900)] 
BIGTOP-3724. Increment the release number of ZooKeeper and Kafka. (#938)

5 weeks agoBIGTOP-3719: Decouple Mpack HDFS services from Ambari Core (#931)
Yuqi Gu [Fri, 8 Jul 2022 05:11:31 +0000 (13:11 +0800)] 
BIGTOP-3719: Decouple Mpack HDFS services from Ambari Core (#931)

Decouple HDFS services from Ambari Core and fix the issues of HDFS
deployment from Bigtop 3.x repo. It's convenient for us to modify/upgrade
Mpack without re-building and re-deploying Ambari respectively.

Change-Id: I2fc2036c9fd261f082cc5359a827904df53a1d63
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
5 weeks agoBIGTOP-3725. Puppet 3 is removed from EPEL for CentOS 7. (#939)
Kengo Seki [Fri, 8 Jul 2022 03:43:35 +0000 (12:43 +0900)] 
BIGTOP-3725. Puppet 3 is removed from EPEL for CentOS 7. (#939)

5 weeks agoBIGTOP-3716: Rename the Yarn/MapReduce historyserver PID file (#934)
Yuqi Gu [Wed, 6 Jul 2022 13:34:33 +0000 (21:34 +0800)] 
BIGTOP-3716: Rename the Yarn/MapReduce historyserver PID file (#934)

The naming rule of Yarn/MapReduce historyserver PID file
is deprecated in Hadoop 3.x.

Change-Id: I9170ff6047f1be593279ef9c9f71dcb09614d7ef
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
5 weeks agoBIGTOP-2971. RPM packaging for Ranger. (#929)
Kengo Seki [Tue, 5 Jul 2022 06:30:26 +0000 (15:30 +0900)] 
BIGTOP-2971. RPM packaging for Ranger. (#929)

This PR is based on #326 submitted by @Xingwd (much appreciated!) and
includes the following updates:

* Upgrade Ranger version to 2.2.0

* Change the download site from ASF to GitHub, because the source
  tarball distributed on the former is unnecessarily large

* Add package dependencies to bigtop.bom

* Remove the assembly:assembly target from the mvn command since it
  doesn't work in recent releases

* Add the version info of other components to the mvn command

* Fix the lib paths in install_ranger.sh and the RPM spec file

* Add the #BIGTOP_PATCH_FILES and #BIGTOP_PATCH_COMMANDS comments to the
  RPM spec so that the patches provided by Bigtop are applied during
  building RPM

* Add patches for addressing RANGER-3373 and RANGER-3459

* Remove symlink to non-existent ojdbc6.jar in install_ranger.sh

* Replace the hard-coded paths to /usr/lib/rpm/redhat in the RPM spec
  with %{_rpmconfigdir} (cf. BIGTOP-1344)

* Define debug_package=nil in the RPM spec to avoid build failure on
  Fedora 35

5 weeks agoBIGTOP-3715. Add TestWebHDFS to smoke-tests. (#928)
Masatake Iwasaki [Mon, 4 Jul 2022 09:49:36 +0000 (18:49 +0900)] 
BIGTOP-3715. Add TestWebHDFS to smoke-tests. (#928)

* BIGTOP-3715. Add TestWebHDFS to smoke-tests.

* fixed typo.e

5 weeks agoBIGTOP-3711: Add read/write smoke tests for Kafka (#922)
Leona Yoda [Mon, 4 Jul 2022 09:04:47 +0000 (18:04 +0900)] 
BIGTOP-3711: Add read/write smoke tests for Kafka (#922)

* Add read/write test for a kafka topic

* reorder import statements

* add a timeout option to consumer

6 weeks agoBIGTOP-3712: Fix Kafka smoke test failure with Zookeeper built with maven (#925)
Leona Yoda [Thu, 30 Jun 2022 11:37:54 +0000 (20:37 +0900)] 
BIGTOP-3712: Fix Kafka smoke test failure with Zookeeper built with maven (#925)

6 weeks agoBIGTOP-3710. Fix build failure of HBase on aarch64 due to error in check-aggregate...
Masatake Iwasaki [Wed, 29 Jun 2022 08:14:53 +0000 (17:14 +0900)] 
BIGTOP-3710. Fix build failure of HBase on aarch64 due to error in check-aggregate-license. (#921)

6 weeks agoBIGTOP-3709. Bring protobuf 2.5.0 back for building HBase on aarch64 and ppc64le...
Masatake Iwasaki [Wed, 29 Jun 2022 03:16:18 +0000 (12:16 +0900)] 
BIGTOP-3709. Bring protobuf 2.5.0 back for building HBase on aarch64 and ppc64le. (#920)

6 weeks agoBIGTOP-3704: Update Yarn service configuration in Mpack (#917)
Yuqi Gu [Wed, 29 Jun 2022 03:11:03 +0000 (11:11 +0800)] 
BIGTOP-3704: Update Yarn service configuration in Mpack (#917)

* BIGTOP-3704: Update Yarn service configuration in Mpack

This patch is to modfify Yarn configuration directory and replace deprecated Macro
when deploying Yarn+mapReduce service by Ambari Mpack.

Change-Id: I75ebf89d376aea0aadd036e903ff275afd4cfa4f
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
* update deprecated Macro of Yarn

Change-Id: If43eaa361c41cbb5ba56cd8a7812573e566ed944
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
6 weeks agoBIGTOP-3699. Bump Spark to 3.2.1. (#919)
Leona Yoda [Mon, 27 Jun 2022 08:06:06 +0000 (17:06 +0900)] 
BIGTOP-3699. Bump Spark to 3.2.1. (#919)

6 weeks agoBIGTOP-3707: Update latest repo url for Provisioner docker yamls (#918)
Yuqi Gu [Mon, 27 Jun 2022 02:27:02 +0000 (10:27 +0800)] 
BIGTOP-3707: Update latest repo url for Provisioner docker yamls (#918)

Update repo url of 3.1.0 release for provisioner docker Distros yamls

Change-Id: Iac4125c555e83037604aee49e25f14a83c504964
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
7 weeks agoBIGTOP-3694. Fix Oozie build errors. (#911)
Leona Yoda [Thu, 23 Jun 2022 08:38:27 +0000 (17:38 +0900)] 
BIGTOP-3694. Fix Oozie build errors. (#911)

7 weeks agoBIGTOP-3706. Bump Hadoop to 3.3.3. (#916)
Masatake Iwasaki [Wed, 22 Jun 2022 12:12:14 +0000 (21:12 +0900)] 
BIGTOP-3706. Bump Hadoop to 3.3.3. (#916)

* BIGTOP-3706. Bump Hadoop to 3.3.3.

* using CapacityScheduler to make smoke-tests work run by root user with the default configuration.

7 weeks agoBIGTOP-3669. Use maven instead of ant to build ZooKeeper. (#890)
Masatake Iwasaki [Tue, 21 Jun 2022 09:41:33 +0000 (18:41 +0900)] 
BIGTOP-3669. Use maven instead of ant to build ZooKeeper. (#890)

7 weeks agoBIGTOP-3705: Refine the Ambari RPM spec to fix warning after rpm uninstallation ...
Yuqi Gu [Tue, 21 Jun 2022 04:48:27 +0000 (12:48 +0800)] 
BIGTOP-3705: Refine the Ambari RPM spec to fix warning after rpm uninstallation (#914)

Duplicated deleting operation ('%files' and '%preun%') in Ambari RPM spec
makes some warning issues when uninstalling Ambari rpm.
And '%config' in spec would create 'xxx.rpmsave' which was no longer needed.

Change-Id: Ic0f8a469ce69641e0482a3c7fcc259bd56f33c40
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
8 weeks agoBIGTOP-3438. Upgrade protobuf-2.5.0 to 3.7.1 for Hadoop-3.3.0. (#915)
Masatake Iwasaki [Fri, 17 Jun 2022 08:41:27 +0000 (17:41 +0900)] 
BIGTOP-3438. Upgrade protobuf-2.5.0 to 3.7.1 for Hadoop-3.3.0. (#915)

2 months agoBIGTOP-3698. Bump Hive to 3.1.3. (#912)
Leona Yoda [Fri, 10 Jun 2022 02:16:12 +0000 (11:16 +0900)] 
BIGTOP-3698. Bump Hive to 3.1.3. (#912)

2 months agoBIGTOP-3692: Upgrade flink version to 1.15.0 (#909)
Leona Yoda [Mon, 6 Jun 2022 23:00:55 +0000 (08:00 +0900)] 
BIGTOP-3692: Upgrade flink version to 1.15.0 (#909)

* upgrade flink version to 1.15.0 and add patches for husky

* use python3 in rpmbuild to avoid bytecompilation errors

2 months agoBIGTOP-3687. Add kubernetes client jar to Spark package. (#907)
Leona Yoda [Sun, 5 Jun 2022 17:21:54 +0000 (02:21 +0900)] 
BIGTOP-3687. Add kubernetes client jar to Spark package. (#907)

2 months agoBigtop 3.1.0 website update
Kengo Seki [Sat, 21 May 2022 12:33:02 +0000 (21:33 +0900)] 
Bigtop 3.1.0 website update

2 months agoBIGTOP-3685: make docker-provisioner to be used both in docker-compose v1 and v2...
Leona Yoda [Mon, 16 May 2022 14:10:46 +0000 (23:10 +0900)] 
BIGTOP-3685: make docker-provisioner to be used both in docker-compose v1 and v2 (#903)

3 months agoBIGTOP-3684: Fix RAT issues in Bigtop source tree (#902) 904/head
Yuqi Gu [Fri, 13 May 2022 05:35:14 +0000 (13:35 +0800)] 
BIGTOP-3684: Fix RAT issues in Bigtop source tree (#902)

Change-Id: Id9f057daa77af1150bd51af319a4519bc390532f
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
3 months agoBIGTOP-3680: Remove jruby version replacement to be updated. (#900)
Leona Yoda [Wed, 11 May 2022 09:59:39 +0000 (18:59 +0900)] 
BIGTOP-3680: Remove jruby version replacement to be updated. (#900)

3 months agoBIGTOP-3679. Building Phoenix for CentOS 7 fails on aarch64. (#899)
Masatake Iwasaki [Fri, 6 May 2022 16:11:22 +0000 (01:11 +0900)] 
BIGTOP-3679. Building Phoenix for CentOS 7 fails on aarch64. (#899)

3 months agoBIGTOP-3677 (addendum). Building HBase for CentOS 7 on arm64 and ppc64le fails due...
Kengo Seki [Fri, 6 May 2022 10:41:51 +0000 (19:41 +0900)] 
BIGTOP-3677 (addendum). Building HBase for CentOS 7 on arm64 and ppc64le fails due to missing libraries. (#898)

3 months agoBIGTOP-3678. Building Zeppelin fails due to dependency convergence error. (#897)
Kengo Seki [Mon, 2 May 2022 05:20:59 +0000 (14:20 +0900)] 
BIGTOP-3678. Building Zeppelin fails due to dependency convergence error. (#897)

3 months agoBIGTOP-3677. Building HBase for CentOS 7 on arm64 and ppc64le fails due to missing...
Masatake Iwasaki [Sat, 30 Apr 2022 11:25:43 +0000 (20:25 +0900)] 
BIGTOP-3677. Building HBase for CentOS 7 on arm64 and ppc64le fails due to missing libraries. (#896)

* BIGTOP-3677. Building HBase for CentOS 7 on arm64 fails due to missing libraries.

* needs the fix for ppc64le too.

* bumped the version of protobuf used for HBase on ppc64le.

3 months agoBIGTOP-3675. Building Tez fails due to broken dependency. (#895)
Kengo Seki [Fri, 29 Apr 2022 23:00:20 +0000 (08:00 +0900)] 
BIGTOP-3675. Building Tez fails due to broken dependency. (#895)

3 months agoBIGTOP-3676. Building Ambari for Debian 11 on ppc64le fails due to missing python...
Kengo Seki [Thu, 28 Apr 2022 13:07:25 +0000 (22:07 +0900)] 
BIGTOP-3676. Building Ambari for Debian 11 on ppc64le fails due to missing python. (#894)

3 months agoBigtop 3.1.0 release.
Kengo Seki [Tue, 26 Apr 2022 12:17:05 +0000 (21:17 +0900)] 
Bigtop 3.1.0 release.

3 months agoUpdate default values in hieradata for release 3.1.0
Kengo Seki [Tue, 26 Apr 2022 12:01:46 +0000 (21:01 +0900)] 
Update default values in hieradata for release 3.1.0

3 months agoBumping up the version to 3.2.0-SNAPSHOT
Kengo Seki [Tue, 26 Apr 2022 11:34:09 +0000 (20:34 +0900)] 
Bumping up the version to 3.2.0-SNAPSHOT

3 months agoPreparing for release 3.1.0
Kengo Seki [Tue, 26 Apr 2022 11:26:06 +0000 (20:26 +0900)] 
Preparing for release 3.1.0

3 months agoBIGTOP-3671. Add a patch for CVE-2021-22569 to bigtop_toolchain. (#888)
Masatake Iwasaki [Mon, 25 Apr 2022 13:07:13 +0000 (22:07 +0900)] 
BIGTOP-3671. Add a patch for CVE-2021-22569 to bigtop_toolchain. (#888)

3 months agoBIGTOP-3672: Always use HTTPS when accessing repos and not plain HTTP. (#889)
Martin Blom [Mon, 25 Apr 2022 10:56:41 +0000 (12:56 +0200)] 
BIGTOP-3672: Always use HTTPS when accessing repos and not plain HTTP. (#889)

3 months agoBIGTOP-3666: Replace the Docker provisioner config for CentOS 8 with Rocky 8 (#887)
Leona Yoda [Mon, 18 Apr 2022 12:43:15 +0000 (21:43 +0900)] 
BIGTOP-3666: Replace the Docker provisioner config for CentOS 8 with Rocky 8 (#887)

3 months agoBIGTOP-3664: Add warn message to gradle when users try to build on fedora-35 (#885)
Leona Yoda [Thu, 14 Apr 2022 00:51:23 +0000 (09:51 +0900)] 
BIGTOP-3664: Add warn message to gradle when users try to build on fedora-35 (#885)

4 months agoBIGTOP-3665: specify Fedora 35 as experimental state (#886)
Leona Yoda [Wed, 13 Apr 2022 11:44:01 +0000 (20:44 +0900)] 
BIGTOP-3665: specify Fedora 35 as experimental state (#886)

4 months agoBIGTOP-3663. Hadoop deployment fails on Fedora 35. (#883)
Masatake Iwasaki [Tue, 12 Apr 2022 05:05:29 +0000 (14:05 +0900)] 
BIGTOP-3663. Hadoop deployment fails on Fedora 35. (#883)

4 months agoBigtop 3.0.1 website update
Kengo Seki [Mon, 11 Apr 2022 10:47:57 +0000 (19:47 +0900)] 
Bigtop 3.0.1 website update

4 months agoBIGTOP-3662. Bump HBase to 2.4.11. (#882)
Masatake Iwasaki [Mon, 11 Apr 2022 03:03:55 +0000 (12:03 +0900)] 
BIGTOP-3662. Bump HBase to 2.4.11. (#882)

4 months agoBIGTOP-3659. Ambari deployment fails due to the odpi-ambari-mpack version mismatch...
Kengo Seki [Mon, 4 Apr 2022 00:39:10 +0000 (09:39 +0900)] 
BIGTOP-3659. Ambari deployment fails due to the odpi-ambari-mpack version mismatch. (#881)

4 months agoBIGTOP-3658. Add Fedora 35 support and drop 33. (#880)
Kengo Seki [Wed, 30 Mar 2022 15:47:15 +0000 (00:47 +0900)] 
BIGTOP-3658. Add Fedora 35 support and drop 33. (#880)

4 months agoBIGTOP-3606. Bump Hadoop to 3.2.3. (#878)
Masatake Iwasaki [Tue, 29 Mar 2022 08:59:33 +0000 (17:59 +0900)] 
BIGTOP-3606. Bump Hadoop to 3.2.3. (#878)

4 months agoBIGTOP-3657. Revert the download site to archive.apache.org partially (#879)
Kengo Seki [Tue, 29 Mar 2022 01:04:09 +0000 (10:04 +0900)] 
BIGTOP-3657. Revert the download site to archive.apache.org partially (#879)

4 months agoBIGTOP-3639 (addendum). Alluxio build fails on ppc64le. (#877)
Kengo Seki [Mon, 28 Mar 2022 00:39:17 +0000 (09:39 +0900)] 
BIGTOP-3639 (addendum). Alluxio build fails on ppc64le. (#877)

4 months agoBIGTOP-3656. Ambari Mpack fixes for debian/ubuntu (#852)
zloKOMAtic [Mon, 28 Mar 2022 00:09:33 +0000 (02:09 +0200)] 
BIGTOP-3656. Ambari Mpack fixes for debian/ubuntu (#852)

4 months agoBIGTOP-3655. Cluster deployment via Ambari fails on CentOS due to the lack of execute...
Kengo Seki [Sun, 27 Mar 2022 06:26:11 +0000 (15:26 +0900)] 
BIGTOP-3655. Cluster deployment via Ambari fails on CentOS due to the lack of execute permission. (#875)

4 months agoBIGTOP-3639: Alluxio build fails on ppc64le (#861)
afsanjar [Fri, 25 Mar 2022 23:07:42 +0000 (18:07 -0500)] 
BIGTOP-3639: Alluxio  build fails on ppc64le (#861)

4 months agoBIGTOP-3654. Building Hadoop fails on ppc64le. (#874)
Kengo Seki [Wed, 23 Mar 2022 03:30:31 +0000 (12:30 +0900)] 
BIGTOP-3654. Building Hadoop fails on ppc64le. (#874)

4 months agoBIGTOP-3653. Building Kibana fails due to the npm error. (#873)
Kengo Seki [Sun, 20 Mar 2022 05:40:00 +0000 (14:40 +0900)] 
BIGTOP-3653. Building Kibana fails due to the npm error. (#873)

5 months agoBIGTOP-3652. Add the python-is-python2 package to the toolchain for Ubuntu 20.04...
Kengo Seki [Fri, 11 Mar 2022 09:38:55 +0000 (18:38 +0900)] 
BIGTOP-3652. Add the python-is-python2 package to the toolchain for Ubuntu 20.04. (#872)

5 months agoBIGTOP-3649: Fix Nexus local mirror functionality (#870)
cheelio [Fri, 11 Mar 2022 05:44:05 +0000 (06:44 +0100)] 
BIGTOP-3649: Fix Nexus local mirror functionality (#870)

5 months agoBIGTOP-3650: Improve Hive's Debian packaging (#871)
Luca Toscano [Tue, 8 Mar 2022 06:44:13 +0000 (07:44 +0100)] 
BIGTOP-3650: Improve Hive's Debian packaging (#871)

Raised compat to '12' and followed some suggestions from Lintian.

5 months agoBIGTOP-3648. Change download site to dlcdn.apache.org for installing Ant and Maven...
Kengo Seki [Sun, 27 Feb 2022 23:16:36 +0000 (08:16 +0900)] 
BIGTOP-3648. Change download site to dlcdn.apache.org for installing Ant and Maven. (#869)

5 months agoBIGTOP-3647. Change RPM repository for CentOS 8 to Vault Mirror. (#868)
Kengo Seki [Fri, 25 Feb 2022 06:21:38 +0000 (15:21 +0900)] 
BIGTOP-3647. Change RPM repository for CentOS 8 to Vault Mirror. (#868)

5 months agoBIGTOP-3646. Upgrade Geode and TableStore SDK version for YCSB. (#867)
Kengo Seki [Fri, 25 Feb 2022 04:35:51 +0000 (13:35 +0900)] 
BIGTOP-3646. Upgrade Geode and TableStore SDK version for YCSB. (#867)