hbase.git
3 months agoRevert "HBASE-27062 ThreadPool is unnecessary in HBaseInterClusterReplication… (...
chenglei [Wed, 22 Jun 2022 11:38:48 +0000 (19:38 +0800)] 
Revert "HBASE-27062 ThreadPool is unnecessary in HBaseInterClusterReplication… (#4463)" (#4559)

3 months agoHBASE-27062 ThreadPool is unnecessary in HBaseInterClusterReplication… (#4463)
chenglei [Wed, 22 Jun 2022 11:33:05 +0000 (19:33 +0800)] 
HBASE-27062 ThreadPool is unnecessary in HBaseInterClusterReplication… (#4463)

* HBASE-27062 ThreadPool is unnecessary in HBaseInterClusterReplicationEndpoint when use AsyncClusterConnection

3 months agoHBASE-27098 Fix link for field comments (#4499)
litao [Wed, 22 Jun 2022 01:29:34 +0000 (09:29 +0800)] 
HBASE-27098 Fix link for field comments (#4499)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
3 months agoHBASE-27143 Add hbase-unsafe as a dependency for a MR job triggered by hbase shell...
Tak Lon (Stephen) Wu [Tue, 21 Jun 2022 20:38:09 +0000 (13:38 -0700)] 
HBASE-27143 Add hbase-unsafe as a dependency for a MR job triggered by hbase shell (#4554)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-26969:Eliminate MOB renames when SFT is enabled (#4418)
BukrosSzabolcs [Tue, 21 Jun 2022 09:18:55 +0000 (11:18 +0200)] 
HBASE-26969:Eliminate MOB renames when SFT is enabled (#4418)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
3 months agoHBASE-27099 The log printing fspread/fsread cost time unit should be milliseconds...
xiaozhang0319 [Mon, 20 Jun 2022 16:13:33 +0000 (00:13 +0800)] 
HBASE-27099 The log printing fspread/fsread cost time unit should be milliseconds (#4500)

Co-authored-by: xiaozhang <issac.zhang@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-27128 when open archiveRetries totalLogSize calculation mistake (#4546)
SiCheng-Zheng [Mon, 20 Jun 2022 15:45:35 +0000 (23:45 +0800)] 
HBASE-27128 when open archiveRetries totalLogSize calculation mistake (#4546)

Co-authored-by: zhengsicheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5833756e5e7cdc01d50538e5c9f959a79fcfd7a3)

3 months agoHBASE-27125 The batch size of cleaning expired mob files should have an upper bound...
Xiaolin Ha [Fri, 17 Jun 2022 15:35:26 +0000 (23:35 +0800)] 
HBASE-27125 The batch size of cleaning expired mob files should have an upper bound (#4541)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-27117 Update the method comments for RegionServerAccounting (#4532)
litao [Fri, 17 Jun 2022 00:18:18 +0000 (08:18 +0800)] 
HBASE-27117 Update the method comments for RegionServerAccounting (#4532)

3 months agoHBASE-26956 ExportSnapshot tool supports removing TTL (#4351) 3.0.0-alpha-3RC0 rel/3.0.0-alpha-3
XinSun [Wed, 15 Jun 2022 07:04:17 +0000 (15:04 +0800)] 
HBASE-26956 ExportSnapshot tool supports removing TTL (#4351)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-26167 Allow users to not start zookeeper and dfs cluster when using TestingHBas...
xicm [Wed, 15 Jun 2022 02:48:48 +0000 (10:48 +0800)] 
HBASE-26167 Allow users to not start zookeeper and dfs cluster when using TestingHBaseCluster (#4534)

Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Yu Li <liyu@apache.org>
3 months agoRevert "HBASE-26167 Allow users to not start zookeeper and dfs cluster when using...
Duo Zhang [Wed, 15 Jun 2022 02:53:48 +0000 (10:53 +0800)] 
Revert "HBASE-26167 Allow users to not start zookeeper and dfs cluster when using TestingHBaseCluster (#4534)"

This reverts commit 11ae7208dd18ffcf8cd3631f5ca190ad19651209.

3 months agoHBASE-27121 Set version as 3.0.0-alpha-3 in master in prep for first RC of 3.0.0...
Duo Zhang [Wed, 15 Jun 2022 02:51:31 +0000 (10:51 +0800)] 
HBASE-27121 Set version as 3.0.0-alpha-3 in master in prep for first RC of 3.0.0-alpha-3 (#4535)

Signed-off-by: Xin Sun <ddupgs@gmail.com>
3 months agoHBASE-26167 Allow users to not start zookeeper and dfs cluster when using TestingHBas...
Duo Zhang [Wed, 15 Jun 2022 02:48:48 +0000 (10:48 +0800)] 
HBASE-26167 Allow users to not start zookeeper and dfs cluster when using TestingHBaseCluster (#4534)

Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Yu Li <liyu@apache.org>
3 months agoHBASE-27091 Speed up the loading of table descriptor from filesystem (#4493)
LiangJun He [Sat, 11 Jun 2022 00:48:23 +0000 (08:48 +0800)] 
HBASE-27091 Speed up the loading of table descriptor from filesystem (#4493)

Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
Signed-off-by: Yu Li <liyu@apache.org>
3 months agoRevert "HBASE-27091 Speed up the loading of table descriptor from filesystem (#4493)"
Yu Li [Tue, 14 Jun 2022 16:47:28 +0000 (00:47 +0800)] 
Revert "HBASE-27091 Speed up the loading of table descriptor from filesystem (#4493)"

This reverts commit 5d0f4dc729a471c1dd0b926f0d6fabdbca01d7f7 to correct signed-off info.

3 months agoHBASE-27091 Speed up the loading of table descriptor from filesystem (#4493)
LiangJun He [Sat, 11 Jun 2022 00:48:23 +0000 (08:48 +0800)] 
HBASE-27091 Speed up the loading of table descriptor from filesystem (#4493)

Signed-off-by: Yu Li <liyu@apache.org>
3 months agoHBASE-26856 BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted
Mohammad Arshad [Tue, 17 May 2022 05:24:38 +0000 (10:54 +0530)] 
HBASE-26856 BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted

Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of
ByteBuffer's underlying array instead of original ByteBuffer

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
3 months agoPurging references to ports 60010 and 60030 from the book
itstitus [Mon, 13 Jun 2022 11:07:15 +0000 (16:37 +0530)] 
Purging references to ports 60010 and 60030 from the book

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
3 months agoHBASE-27106 update asciidoctor site building. (#4522)
Sean Busbey [Mon, 13 Jun 2022 08:46:10 +0000 (03:46 -0500)] 
HBASE-27106 update asciidoctor site building. (#4522)

- update asciidoctor maven plugin to latest
- update the asciidoctor pdf dependency to latest
- allow the plugin to use its own version of jruby

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
3 months agoHBASE-27028 Add a shell command for flushing master local region (#4457)
LiangJun He [Mon, 13 Jun 2022 03:09:05 +0000 (11:09 +0800)] 
HBASE-27028 Add a shell command for flushing master local region (#4457)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoRevert "HBASE-25709 Close region may stuck when region is compacting and skipped...
Viraj Jasani [Sun, 12 Jun 2022 17:22:42 +0000 (10:22 -0700)] 
Revert "HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)" (#4524)

This reverts commit f3a48d19101a6a485628f71fc4b980fb95b44ad2.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
3 months agoHBASE-27097 SimpleRpcServer is broken (#4521)
Andrew Purtell [Sat, 11 Jun 2022 17:40:40 +0000 (10:40 -0700)] 
HBASE-27097 SimpleRpcServer is broken (#4521)

Apply https://issues.apache.org/jira/secure/attachment/13044874/MultiByteBuff.patch
from Lijin Bin on JIRA.

Co-authored-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
3 months agoRevert "HBASE-27084 Add spotless:check in mvn verify stage (#4482)"
Duo Zhang [Sat, 11 Jun 2022 16:12:05 +0000 (00:12 +0800)] 
Revert "HBASE-27084 Add spotless:check in mvn verify stage (#4482)"

This reverts commit a060e71c530556743189c9ee8b01a90e0f2891af.

3 months agoHBASE-26923 PerformanceEvaluation support encryption option (#4489)
wenwj0 [Sat, 11 Jun 2022 12:10:25 +0000 (20:10 +0800)] 
HBASE-26923 PerformanceEvaluation support encryption option (#4489)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-26366 Provide meaningful parent spans to ZK interactions
Nick Dimiduk [Fri, 10 Jun 2022 14:25:55 +0000 (16:25 +0200)] 
HBASE-26366 Provide meaningful parent spans to ZK interactions

Signed-off-by: Andrew Purtell <apurtell@apache.org>
3 months agoHBASE-27102 Vacate the .idea folder in order to simplify spotless configuration
Nick Dimiduk [Thu, 9 Jun 2022 13:14:21 +0000 (15:14 +0200)] 
HBASE-27102 Vacate the .idea folder in order to simplify spotless configuration

Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-27095 HbckChore should produce a report
Nick Dimiduk [Fri, 10 Jun 2022 13:46:24 +0000 (15:46 +0200)] 
HBASE-27095 HbckChore should produce a report

In #4470 for HBASE-26192, it was noted that the HbckChore is kind of a pain to use and test
because it maintains a bunch of local state. By contract, the CatalogJanitorChore makes a nice
self-contained report. Let's update HbckChore to do the same.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
3 months agoHBASE-27103 All MR UTs are broken because of ClassNotFound (#4514)
Andrew Purtell [Thu, 9 Jun 2022 17:00:10 +0000 (10:00 -0700)] 
HBASE-27103 All MR UTs are broken because of ClassNotFound (#4514)

Signed-off-by: Sean Busbey <busbey@apache.org>
Co-authored-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-27066 The Region Visualizer display failed
Nick Dimiduk [Mon, 6 Jun 2022 14:12:05 +0000 (16:12 +0200)] 
HBASE-27066 The Region Visualizer display failed

Reviewed-by: litao <tomleescut@gmail.com>
3 months agoRevert "HBASE-27066 The Region Visualizer display failed (#4472)"
Nick Dimiduk [Mon, 6 Jun 2022 13:37:21 +0000 (15:37 +0200)] 
Revert "HBASE-27066 The Region Visualizer display failed (#4472)"

This reverts commit 5c116d239f4fbfdb8ef9c4d945b2c1a9ad6c416e.

3 months agoHBASE-27092 Regionserver table on Master UI is broken (#4495)
litao [Wed, 8 Jun 2022 00:37:48 +0000 (08:37 +0800)] 
HBASE-27092 Regionserver table on Master UI is broken (#4495)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
3 months agoHBASE-27093 AsyncNonMetaRegionLocator:put Complete CompletableFuture outside lock...
wangzhi [Tue, 7 Jun 2022 04:17:52 +0000 (12:17 +0800)] 
HBASE-27093 AsyncNonMetaRegionLocator:put Complete CompletableFuture outside lock block (#4496)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-27038 CellComparator should extend Serializable (#4492)
Bryan Beaudreault [Mon, 6 Jun 2022 21:44:13 +0000 (17:44 -0400)] 
HBASE-27038 CellComparator should extend Serializable (#4492)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
3 months agoHBASE-27084 Add spotless:check in mvn verify stage (#4482)
Duo Zhang [Mon, 6 Jun 2022 11:49:34 +0000 (19:49 +0800)] 
HBASE-27084 Add spotless:check in mvn verify stage (#4482)

Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
3 months agoHBASE-27080 Optimize debug output log of ConstantSizeRegionSplitPolicy class. (#4481)
liuzhuang2017 [Mon, 6 Jun 2022 05:37:58 +0000 (13:37 +0800)] 
HBASE-27080 Optimize debug output log of ConstantSizeRegionSplitPolicy class. (#4481)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-27017: MOB snapshot is broken when FileBased SFT is used (#4466)
BukrosSzabolcs [Sun, 5 Jun 2022 18:51:28 +0000 (20:51 +0200)] 
HBASE-27017: MOB snapshot is broken when FileBased SFT is used (#4466)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
3 months agoHBASE-26983 Upgrade JRuby to 9.3.4.0 (#4378)
Sean Busbey [Sun, 5 Jun 2022 05:15:59 +0000 (00:15 -0500)] 
HBASE-26983 Upgrade JRuby to 9.3.4.0 (#4378)

- Update JRuby
- Replace java_kind_of since it has been removed
- update jcoding / joni to match jruby

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
3 months agoHBASE-26993 Make the new framework for region replication could work for SKIP_WAL...
chenglei [Fri, 3 Jun 2022 08:39:17 +0000 (16:39 +0800)] 
HBASE-26993 Make the new framework for region replication could work for SKIP_WAL (#4392)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-26985 check permission for SecureBulkLoadManager (#4379)
skysiders [Thu, 2 Jun 2022 22:28:22 +0000 (06:28 +0800)] 
HBASE-26985 check permission for SecureBulkLoadManager (#4379)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
4 months agoHBASE-27046 The filenum in AbstractFSWAL should be monotone increasing (#4449)
Duo Zhang [Thu, 2 Jun 2022 15:55:23 +0000 (23:55 +0800)] 
HBASE-27046 The filenum in AbstractFSWAL should be monotone increasing (#4449)

Signed-off-by: Xin Sun <ddupgs@gmail.com>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
4 months agoHBASE-26962: Add mob info in web UI (#4359)
liangxs [Thu, 2 Jun 2022 15:53:03 +0000 (23:53 +0800)] 
HBASE-26962: Add mob info in web UI (#4359)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
4 months agoHBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) (...
Xiaolin Ha [Thu, 2 Jun 2022 15:52:14 +0000 (23:52 +0800)] 
HBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) (#4405)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
4 months agoHBASE-27036 Displays the number of decommissioned region server for status command...
litao [Thu, 2 Jun 2022 15:51:39 +0000 (23:51 +0800)] 
HBASE-27036 Displays the number of decommissioned region server for status command (#4431)

add decommissionedServers to cluster metric

Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org
4 months agoHBASE-27039 Some methods of MasterRegion should be annotated for testing only (#4433)
LiangJun He [Thu, 2 Jun 2022 13:27:25 +0000 (21:27 +0800)] 
HBASE-27039 Some methods of MasterRegion should be annotated for testing only (#4433)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
4 months agoHBASE-27037 Display the region server state on the Web UI (#4432)
litao [Thu, 2 Jun 2022 13:19:45 +0000 (21:19 +0800)] 
HBASE-27037 Display the region server state on the Web UI (#4432)

Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
4 months agoHBASE-27023 Fix license issues after running spotless:apply (#4458)
Duo Zhang [Thu, 2 Jun 2022 12:18:00 +0000 (20:18 +0800)] 
HBASE-27023 Fix license issues after running spotless:apply (#4458)

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
4 months agoHBASE-27082 Change the return value of RSGroupInfo.getServers from SortedSet to Set...
Duo Zhang [Wed, 1 Jun 2022 15:30:52 +0000 (23:30 +0800)] 
HBASE-27082 Change the return value of RSGroupInfo.getServers from SortedSet to Set to keep compatibility (#4480)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
4 months agoHBASE-27079 Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE (...
Andrew Purtell [Tue, 31 May 2022 19:43:04 +0000 (12:43 -0700)] 
HBASE-27079 Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE (#4476)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
4 months agoHBASE-27067 Upgrade pyjwt to version 2.4.0 or later for dev-support/git-jira-release...
Andrew Purtell [Tue, 31 May 2022 18:52:52 +0000 (11:52 -0700)] 
HBASE-27067 Upgrade pyjwt to version 2.4.0 or later for dev-support/git-jira-release-audit (#4473)

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
4 months agoHBASE-27068 NPE occurs when the active master has not yet been elected (#4474)
litao [Tue, 31 May 2022 18:49:49 +0000 (02:49 +0800)] 
HBASE-27068 NPE occurs when the active master has not yet been elected (#4474)

Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org
4 months agoHBASE-27064 CME in TestRegionNormalizerWorkQueue (#4468)
Andrew Purtell [Tue, 31 May 2022 18:33:06 +0000 (11:33 -0700)] 
HBASE-27064 CME in TestRegionNormalizerWorkQueue (#4468)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
4 months agoHBASE-27069 Hbase SecureBulkload permission regression (#4475)
Istvan Toth [Tue, 31 May 2022 08:52:35 +0000 (10:52 +0200)] 
HBASE-27069 Hbase SecureBulkload permission regression (#4475)

Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
4 months agoHBASE-27066 The Region Visualizer display failed (#4472)
litao [Sun, 29 May 2022 18:53:50 +0000 (02:53 +0800)] 
HBASE-27066 The Region Visualizer display failed (#4472)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
4 months agoHBASE-27065 Build against Hadoop 3.3.3 (#4467)
Andrew Purtell [Fri, 27 May 2022 21:03:23 +0000 (14:03 -0700)] 
HBASE-27065 Build against Hadoop 3.3.3 (#4467)

When building against Hadoop 3.3.3 and any future version of Hadoop
incorporating reload4j the new Enforcer rule we have active in
branch-2.5 and up to exclude other logging frameworks besides log4j2
will trigger. We need to add exclusions to prevent that from
happening so the build will succeed.

Also exclude leveldbjni-all to avoid a LICENSE file generation error.

Add netty-all to hadoop-hdfs test context... to fix tests failing
trying to init minidfscluster.

Co-authored-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
4 months agoHBASE-26854 Shell startup logs a bunch of noise (#4469)
Andrew Purtell [Fri, 27 May 2022 21:00:41 +0000 (14:00 -0700)] 
HBASE-26854 Shell startup logs a bunch of noise (#4469)

Upon startup the shell logs a bunch of noise, mainly from zookeeper.
Also hide WARN level logging from the Hadoop libraries

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
4 months agoHBASE-27061 two phase bulkload is broken when SFT is in use. (#4465)
Sergey Soldatov [Thu, 26 May 2022 10:01:21 +0000 (03:01 -0700)] 
HBASE-27061 two phase bulkload is broken when SFT is in use. (#4465)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
4 months agoHBASE-26649 Addendum fix spotless error
Duo Zhang [Wed, 25 May 2022 13:28:47 +0000 (21:28 +0800)] 
HBASE-26649 Addendum fix spotless error

4 months agoHBASE-27055 Add additional comments when using HBASE_TRACE_OPTS with standalone mode...
Tak Lon (Stephen) Wu [Tue, 24 May 2022 16:27:15 +0000 (09:27 -0700)] 
HBASE-27055 Add additional comments when using HBASE_TRACE_OPTS with standalone mode (#4452)

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
4 months agoHBASE-26342 Support custom paths of independent configuration and pool for hfile...
Xiaolin Ha [Tue, 24 May 2022 01:53:48 +0000 (09:53 +0800)] 
HBASE-26342 Support custom paths of independent configuration and pool for hfile cleaner (#4403)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
4 months agoHBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocat...
huaxiangsun [Mon, 23 May 2022 15:54:00 +0000 (08:54 -0700)] 
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() (#4442)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
4 months agoHBASE-27027 Use jetty SslContextFactory.Server instead of deprecated SslContextFactor...
bitterfox [Sun, 22 May 2022 03:32:17 +0000 (12:32 +0900)] 
HBASE-27027 Use jetty SslContextFactory.Server instead of deprecated SslContextFactory (#4425)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
4 months agoHBASE-27030 Fix undefined local variable error in draining_servers.rb (#4427)
Junegunn Choi [Sun, 22 May 2022 03:31:48 +0000 (12:31 +0900)] 
HBASE-27030 Fix undefined local variable error in draining_servers.rb (#4427)

HBASE-21812 replaced a for-loop with an each block.
Each block introduces a new scope, so a local variable defined inside it
cannot be accessed afterwards.

  NameError: undefined local variable or method `admin' for main:Object
    getServerNames at /opt/khp/hbase/bin/draining_servers.rb:81
        addServers at /opt/khp/hbase/bin/draining_servers.rb:88
            <main> at /opt/khp/hbase/bin/draining_servers.rb:146

This commit defines the admin local variable in the current scope beforehand,
so that we can still access it after the block.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
4 months agoHBASE-27047 Fix typo for metric drainingRegionServers (#4441)
litao [Sun, 22 May 2022 03:28:01 +0000 (11:28 +0800)] 
HBASE-27047 Fix typo for metric drainingRegionServers (#4441)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
4 months agoHBASE-27054 TestStochasticLoadBalancerRegionReplicaLargeCluster.testRegionReplicasOnL...
d-c-manning [Sat, 21 May 2022 16:17:04 +0000 (09:17 -0700)] 
HBASE-27054 TestStochasticLoadBalancerRegionReplicaLargeCluster.testRegionReplicasOnLargeCluster is flaky (#4454)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
4 months agoHBASE-27043 Let lock wait timeout to improve performance of SnapshotHFileCleaner...
Xiaolin Ha [Fri, 20 May 2022 22:32:58 +0000 (06:32 +0800)] 
HBASE-27043 Let lock wait timeout to improve performance of SnapshotHFileCleaner (#4437)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
4 months agoHBASE-27052 TestAsyncTableScanner.testScanWrongColumnFamily is flaky (#4451)
Nick Dimiduk [Fri, 20 May 2022 22:13:23 +0000 (00:13 +0200)] 
HBASE-27052 TestAsyncTableScanner.testScanWrongColumnFamily is flaky (#4451)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
4 months agoHBASE-27051 TestReplicationSource.testReplicationSourceInitializingMetric is flaky...
Andrew Purtell [Fri, 20 May 2022 22:10:42 +0000 (15:10 -0700)] 
HBASE-27051 TestReplicationSource.testReplicationSourceInitializingMetric is flaky (#4448)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
4 months agoHBASE-27050 Support unit test pattern matching again (#4447)
Andrew Purtell [Fri, 20 May 2022 22:07:10 +0000 (15:07 -0700)] 
HBASE-27050 Support unit test pattern matching again (#4447)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
4 months agoHBASE-27018 Add a tool command list_liveservers (#4416)
litao [Thu, 19 May 2022 22:47:16 +0000 (06:47 +0800)] 
HBASE-27018 Add a tool command list_liveservers (#4416)

Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
4 months agoHBASE-27006 Move nightly integration testing to new larger test node class. (#4438)
Sean Busbey [Wed, 18 May 2022 19:18:49 +0000 (14:18 -0500)] 
HBASE-27006 Move nightly integration testing to new larger test node class. (#4438)

4 months agoHBASE-27045 Disable TestClusterScopeQuotaThrottle (#4440)
Duo Zhang [Wed, 18 May 2022 12:29:06 +0000 (20:29 +0800)] 
HBASE-27045 Disable TestClusterScopeQuotaThrottle (#4440)

Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
4 months agoRevert "HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupte...
Nick Dimiduk [Wed, 18 May 2022 10:59:37 +0000 (12:59 +0200)] 
Revert "HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted (#4394)"

This reverts commit c198f23e5eb078abc47d4c3439477c6c2b4d5136.

4 months agoHBASE-27040 Optimize the log display of the ZKProcedureUtil.java (#4434)
LiangJun He [Tue, 17 May 2022 07:29:43 +0000 (15:29 +0800)] 
HBASE-27040 Optimize the log display of the ZKProcedureUtil.java (#4434)

Signed-off-by: Yu Li <liyu@apache.org>
4 months agoHBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted (...
Mohammad Arshad [Tue, 17 May 2022 05:24:38 +0000 (10:54 +0530)] 
HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted (#4394)

Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of ByteBuffer's underlying array instead of original ByteBuffer

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
4 months agoHBASE-27032 The draining region servers metric description is incorrect (#4428)
litao [Tue, 17 May 2022 05:05:35 +0000 (13:05 +0800)] 
HBASE-27032 The draining region servers metric description is incorrect (#4428)

Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
4 months agoHBASE-26986 Trace a one-shot execution of a Master procedure
Nick Dimiduk [Thu, 28 Apr 2022 15:19:24 +0000 (17:19 +0200)] 
HBASE-26986 Trace a one-shot execution of a Master procedure

This one adds a tracing context to the Master's ProcedureV2 execution. This ties all the spans
that result from a procedure execution back to a procedure by name. Maybe in a follow-on issue, we
can serialize span context along with procedures and display procedure start/stop/retry events and
parent-child hierarchy in tracing visualization.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
4 months agoHBASE-27019 Minor compression performance improvements (#4420)
Andrew Purtell [Sat, 14 May 2022 01:29:10 +0000 (18:29 -0700)] 
HBASE-27019 Minor compression performance improvements (#4420)

TRACE level logging is expensive enough to warrant removal. They were
useful during development but are now just overhead.

Also we unnecessarily create new compressor and decompressor instances
in the reset() methods for the Aircompressor and Lz4 codecs. Remove.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
4 months agoHBASE-26905 ReplicationPeerManager#checkPeerExists should throw ReplicationPeerNotFou...
Rushabh Shah [Sat, 14 May 2022 01:24:19 +0000 (18:24 -0700)] 
HBASE-26905 ReplicationPeerManager#checkPeerExists should throw ReplicationPeerNotFoundException if peer doesn't exists (#4422)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
4 months agoHBASE-27013 Introduce read all bytes when using pread for prefetch (#4414)
Tak Lon (Stephen) Wu [Fri, 13 May 2022 19:16:35 +0000 (12:16 -0700)] 
HBASE-27013 Introduce read all bytes when using pread for prefetch (#4414)

- introduce optional flag `hfile.pread.all.bytes.enabled` for pread that must read full bytes with the next block header

4 months agoHBASE-27024 The User API and Developer API links are broken on hbase.apache.org ...
Duo Zhang [Fri, 13 May 2022 07:05:37 +0000 (15:05 +0800)] 
HBASE-27024 The User API and Developer API links are broken on hbase.apache.org (#4424)

Signed-off-by: Sean Busbey <busbey@apache.org>
4 months agoHBASE-27021 StoreFileInfo should set its initialPath in a consistent way
Wellington Chevreuil [Tue, 10 May 2022 16:33:55 +0000 (17:33 +0100)] 
HBASE-27021 StoreFileInfo should set its initialPath in a consistent way

(Amending spotless errors after revert by Duo)

4 months agoRevert "HBASE-27021 StoreFileInfo should set its initialPath in a consistent way...
Duo Zhang [Thu, 12 May 2022 08:42:30 +0000 (16:42 +0800)] 
Revert "HBASE-27021 StoreFileInfo should set its initialPath in a consistent way (#4419)"

Revert due to failure spotless:check

This reverts commit aa31b0f695ab02015a7a183aaf10ac9963a22ddb.

4 months agoHBASE-27021 StoreFileInfo should set its initialPath in a consistent way (#4419)
Wellington Ramos Chevreuil [Thu, 12 May 2022 08:36:46 +0000 (09:36 +0100)] 
HBASE-27021 StoreFileInfo should set its initialPath in a consistent way (#4419)

Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
4 months agoHBASE-27020 Fix spotless warn for master branch (#4417)
litao [Wed, 11 May 2022 06:36:37 +0000 (14:36 +0800)] 
HBASE-27020 Fix spotless warn for master branch (#4417)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed by: Rushabh Shah <shahrs87@gmail.com>

4 months agoHBASE-27003 Optimize log format for PerformanceEvaluation (#4411)
litao [Wed, 11 May 2022 05:31:44 +0000 (13:31 +0800)] 
HBASE-27003 Optimize log format for PerformanceEvaluation (#4411)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
4 months agoHBASE-26999 HStore should try write WAL compaction marker before repl… (#4407)
Wellington Ramos Chevreuil [Mon, 9 May 2022 09:24:47 +0000 (10:24 +0100)] 
HBASE-26999 HStore should try write WAL compaction marker before repl… (#4407)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
4 months agoHBASE-27015. Fix log format for ServerManager (#4415)
litao [Sun, 8 May 2022 20:33:17 +0000 (04:33 +0800)] 
HBASE-27015. Fix log format for ServerManager (#4415)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
4 months agoHBASE-26994 MasterFileSystem create directory without permission check (#4391)
skysiders [Sun, 8 May 2022 20:26:53 +0000 (04:26 +0800)] 
HBASE-26994 MasterFileSystem create directory without permission check (#4391)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
4 months agoHBASE-26330 Document new provided compression codecs (#4396)
Andrew Purtell [Sat, 7 May 2022 18:25:43 +0000 (11:25 -0700)] 
HBASE-26330 Document new provided compression codecs (#4396)

Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org
4 months agoHBASE-27014 Update downloads.xml for release 2.4.12
Andrew Purtell [Sat, 7 May 2022 18:16:48 +0000 (11:16 -0700)] 
HBASE-27014 Update downloads.xml for release 2.4.12

Signed-off-by: Andrew Purtell <apurtell@apache.org>
4 months agoHBASE-26963 ReplicationSource#removePeer hangs if we try to remove bad peer. (#4361)
Rushabh Shah [Sat, 7 May 2022 17:37:05 +0000 (10:37 -0700)] 
HBASE-26963 ReplicationSource#removePeer hangs if we try to remove bad peer. (#4361)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
4 months agoHBASE-27000 Block cache stats (Misses Caching) display error in RS web UI (#4406)
litao [Fri, 6 May 2022 06:32:28 +0000 (14:32 +0800)] 
HBASE-27000 Block cache stats (Misses Caching) display error in RS web UI (#4406)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
4 months agoHBASE-26984 Chaos Monkey thread dies in ITBLL Chaos GracefulRollingRestartRsAction...
huaxiangsun [Thu, 5 May 2022 14:37:41 +0000 (09:37 -0500)] 
HBASE-26984 Chaos Monkey thread dies in ITBLL Chaos GracefulRollingRestartRsAction (#4383)

There are two cases here:
  1. Chaos Monkey thread died and there is no chaos after that.
  2. Sometimes, regions are being moved back too quick that region server has not finished its initliazation yet.
     wait sometime to make sure that region server finishes its initialization.

Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
4 months agoHBASE-26995 Remove ref guide check in pre commit and nightly for branches other than...
Duo Zhang [Thu, 5 May 2022 10:25:22 +0000 (18:25 +0800)] 
HBASE-26995 Remove ref guide check in pre commit and nightly for branches other than master (#4399)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit 9a41117ca5edaa381b913efb3b8d48f7c98e905c)

4 months agoHBASE-26931 Add the information of EOL releases to our ref guide on master branch...
Duo Zhang [Thu, 5 May 2022 10:26:26 +0000 (18:26 +0800)] 
HBASE-26931 Add the information of EOL releases to our ref guide on master branch (#4388)

Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
4 months agoHBASE-26990 Add default implementation for BufferedMutator interface setters (#4387)
Bryan Beaudreault [Tue, 3 May 2022 18:57:49 +0000 (14:57 -0400)] 
HBASE-26990 Add default implementation for BufferedMutator interface setters (#4387)

Signed-off-by: Josh Elser <elserj@apache.org>
4 months agoHBASE-26892 Add spotless:check in our pre commit general check (#4393)
Duo Zhang [Tue, 3 May 2022 13:14:24 +0000 (21:14 +0800)] 
HBASE-26892 Add spotless:check in our pre commit general check (#4393)

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
4 months agoHBASE-26648 Improve fidelity of RegionLocator spans (addendum)
Nick Dimiduk [Mon, 2 May 2022 17:20:06 +0000 (19:20 +0200)] 
HBASE-26648 Improve fidelity of RegionLocator spans (addendum)

Addendum extends the test case to cover both `RpcConnectionRegistry` and `ZKConnectionRegistry`.

5 months agoHBASE-26989 TestStochasticLoadBalancer fixes for performance and consistency (#4385)
d-c-manning [Mon, 2 May 2022 17:33:13 +0000 (10:33 -0700)] 
HBASE-26989 TestStochasticLoadBalancer fixes for performance and consistency (#4385)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Reviewed by: Rushabh Shah <shahrs87@gmail.com>