hbase.git
3 months agoHBASE-27174 Update downloads.xml for release 2.4.13
Andrew Purtell [Fri, 1 Jul 2022 19:54:21 +0000 (12:54 -0700)] 
HBASE-27174 Update downloads.xml for release 2.4.13

Signed-off-by: Andrew Purtell <apurtell@apache.org>
3 months agoHBASE-27169 TestSeparateClientZKCluster is flaky (#4587)
Duo Zhang [Fri, 1 Jul 2022 14:09:01 +0000 (22:09 +0800)] 
HBASE-27169 TestSeparateClientZKCluster is flaky (#4587)

Signed-off-by: Xin Sun <ddupgs@gmail.com>
3 months agoHBASE-26218 Add logs in Canary tool (#4501)
Ishika [Thu, 30 Jun 2022 13:53:20 +0000 (19:23 +0530)] 
HBASE-26218 Add logs in Canary tool (#4501)

Co-authored-by: Ishika Soni <isoni@isoni-ltmag9r.internal.salesforce.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-27164 Add 3.0.0-alpha-3 to download page (#4583)
Duo Zhang [Wed, 29 Jun 2022 03:07:33 +0000 (11:07 +0800)] 
HBASE-27164 Add 3.0.0-alpha-3 to download page (#4583)

Signed-off-by: Xin Sun <ddupgs@gmail.com>
3 months agoHBASE-27165 Set version as 3.0.0-alpha-4-SNAPSHOT in master (#4582)
Duo Zhang [Wed, 29 Jun 2022 03:04:21 +0000 (11:04 +0800)] 
HBASE-27165 Set version as 3.0.0-alpha-4-SNAPSHOT in master (#4582)

Signed-off-by: Xin Sun <ddupgs@gmail.com>
3 months agoHBASE-27158 Add namespace column family to UNDELETABLE_META_COLUMNFAMILIES (#4578)
Ruanhui [Wed, 29 Jun 2022 02:27:53 +0000 (10:27 +0800)] 
HBASE-27158 Add namespace column family to UNDELETABLE_META_COLUMNFAMILIES (#4578)

Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-27166 WAL value compression minor improvements (#4584)
Andrew Purtell [Tue, 28 Jun 2022 19:49:25 +0000 (12:49 -0700)] 
HBASE-27166 WAL value compression minor improvements (#4584)

A larger IO buffer for absorbing WALCodec writes can improve the compression
ratio of larger values, because the compressor will be given a larger internal
buffer over which there will be more match opportunities. Does not impact the
ability to read existing written files.

Also, reset the BAOS internal buffer on the way out of compress() so potential
large-ish buffers do not linger on the heap longer than necessary.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-27160 ClientZKSyncer.deleteDataForClientZkUntilSuccess should break from the...
Duo Zhang [Sun, 26 Jun 2022 07:22:25 +0000 (15:22 +0800)] 
HBASE-27160 ClientZKSyncer.deleteDataForClientZkUntilSuccess should break from the loop when deletion is succeeded (#4579)

Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
3 months agoRevert "HBASE-26856 BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted"
Andrew Purtell [Sat, 25 Jun 2022 17:58:25 +0000 (10:58 -0700)] 
Revert "HBASE-26856 BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted"

This reverts commit f526609331ba5d6c2377135fdac3ff1dbe71c175.

See also HBASE-27151 TestMultiRespectsLimits.testBlockMultiLimits repeatable failure

3 months agoHBASE-27025 Change Hbase book's description for 74.7.3. Load Balancing META table...
huaxiangsun [Fri, 24 Jun 2022 15:01:24 +0000 (08:01 -0700)] 
HBASE-27025 Change Hbase book's description for 74.7.3. Load Balancing META table load (#4530)

Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-27060 Allow sharing connections between AggregationClient instances (#4566)
Bryan Beaudreault [Fri, 24 Jun 2022 14:47:33 +0000 (10:47 -0400)] 
HBASE-27060 Allow sharing connections between AggregationClient instances (#4566)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-27146 Avoid CellUtil.cloneRow in MetaCellComparator (#4571)
Duo Zhang [Fri, 24 Jun 2022 14:29:17 +0000 (22:29 +0800)] 
HBASE-27146 Avoid CellUtil.cloneRow in MetaCellComparator (#4571)

Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Reviewed-by: SiCheng-Zheng <643463623@qq.com>
3 months agoHBASE-26095 Modify our ref guide to mention the deprecation of HBTU and also how...
Duo Zhang [Fri, 24 Jun 2022 04:45:00 +0000 (12:45 +0800)] 
HBASE-26095 Modify our ref guide to mention the deprecation of HBTU and also how to make use of the new TestingHBaseCluster (#4542)

Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
3 months agoHBASE-27111 Make Netty channel bytebuf allocator configurable. (#4525)
Andrew Purtell [Thu, 23 Jun 2022 22:13:29 +0000 (15:13 -0700)] 
HBASE-27111 Make Netty channel bytebuf allocator configurable. (#4525)

Support site configuration of the bytebuf allocator that Netty will use for
NettyRpcServer channels. Property name is 'hbase.netty.rpcserver.allocator'.
Default is no value, which is equivalent to "pooled". Valid values are:
- "pooled": use PooledByteBufAllocator
- "unpooled": use UnpooledByteBufAllocator
- "heap": use HeapByteBufAllocator, which is a PooledByteBufAllocator that
   preferentially allocates buffers on heap wherever possible
- <class>: If the value is none of the recognized labels, treat it as a class
  name implementing org.apache.hbase.thirdparty.io.netty.buffer.ByteBufAllocator.
  This allows the user to add a custom implementation, perhaps for debugging.

Also updates ReflectionUtils with a new helper method.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
3 months agoHBASE-27001 The deleted variable cannot be printed out (#4479)
Kerasone [Thu, 23 Jun 2022 17:11:32 +0000 (01:11 +0800)] 
HBASE-27001 The deleted variable cannot be printed out (#4479)

* The deleted variable cannot be printed out, add it

Co-authored-by: selina.yan <selina.yan@huolala.cn>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
3 months agoHBASE-26945 Quotas causes too much load on meta for large clusters (#4567)
Bryan Beaudreault [Thu, 23 Jun 2022 14:34:29 +0000 (10:34 -0400)] 
HBASE-26945 Quotas causes too much load on meta for large clusters (#4567)

Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
3 months agoHBASE-26790 Addendum ensure test is not flaky due to async caching
Bryan Beaudreault [Thu, 23 Jun 2022 14:22:55 +0000 (10:22 -0400)] 
HBASE-26790 Addendum ensure test is not flaky due to async caching

3 months agoHBASE-26790 getAllRegionLocations can cache locations with null hostname (#4565)
Bryan Beaudreault [Thu, 23 Jun 2022 12:24:49 +0000 (08:24 -0400)] 
HBASE-26790 getAllRegionLocations can cache locations with null hostname (#4565)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
3 months agoHBASE-27105 HBaseInterClusterReplicationEndpoint should honor replication adaptive...
Pankaj [Thu, 23 Jun 2022 07:21:48 +0000 (12:51 +0530)] 
HBASE-27105 HBaseInterClusterReplicationEndpoint should honor replication adaptive timeout (#4515)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
3 months agoHBASE-27141 Upgrade hbase-thirdparty dependency to 4.1.1 (#4552)
Duo Zhang [Wed, 22 Jun 2022 14:38:12 +0000 (22:38 +0800)] 
HBASE-27141 Upgrade hbase-thirdparty dependency to 4.1.1 (#4552)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
3 months agoHBASE-27062 Remove ThreadPool in HBaseInterClusterReplicationEndpoint when use AsyncC...
chenglei [Wed, 22 Jun 2022 12:01:56 +0000 (20:01 +0800)] 
HBASE-27062 Remove ThreadPool in HBaseInterClusterReplicationEndpoint when use AsyncClusterConnection (#4560)

3 months agoRevert "HBASE-27062 ThreadPool is unnecessary in HBaseInterClusterReplication… (...
chenglei [Wed, 22 Jun 2022 11:38:48 +0000 (19:38 +0800)] 
Revert "HBASE-27062 ThreadPool is unnecessary in HBaseInterClusterReplication… (#4463)" (#4559)

3 months agoHBASE-27062 ThreadPool is unnecessary in HBaseInterClusterReplication… (#4463)
chenglei [Wed, 22 Jun 2022 11:33:05 +0000 (19:33 +0800)] 
HBASE-27062 ThreadPool is unnecessary in HBaseInterClusterReplication… (#4463)

* HBASE-27062 ThreadPool is unnecessary in HBaseInterClusterReplicationEndpoint when use AsyncClusterConnection

3 months agoHBASE-27098 Fix link for field comments (#4499)
litao [Wed, 22 Jun 2022 01:29:34 +0000 (09:29 +0800)] 
HBASE-27098 Fix link for field comments (#4499)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
3 months agoHBASE-27143 Add hbase-unsafe as a dependency for a MR job triggered by hbase shell...
Tak Lon (Stephen) Wu [Tue, 21 Jun 2022 20:38:09 +0000 (13:38 -0700)] 
HBASE-27143 Add hbase-unsafe as a dependency for a MR job triggered by hbase shell (#4554)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-26969:Eliminate MOB renames when SFT is enabled (#4418)
BukrosSzabolcs [Tue, 21 Jun 2022 09:18:55 +0000 (11:18 +0200)] 
HBASE-26969:Eliminate MOB renames when SFT is enabled (#4418)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
3 months agoHBASE-27099 The log printing fspread/fsread cost time unit should be milliseconds...
xiaozhang0319 [Mon, 20 Jun 2022 16:13:33 +0000 (00:13 +0800)] 
HBASE-27099 The log printing fspread/fsread cost time unit should be milliseconds (#4500)

Co-authored-by: xiaozhang <issac.zhang@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-27128 when open archiveRetries totalLogSize calculation mistake (#4546)
SiCheng-Zheng [Mon, 20 Jun 2022 15:45:35 +0000 (23:45 +0800)] 
HBASE-27128 when open archiveRetries totalLogSize calculation mistake (#4546)

Co-authored-by: zhengsicheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5833756e5e7cdc01d50538e5c9f959a79fcfd7a3)

3 months agoHBASE-27125 The batch size of cleaning expired mob files should have an upper bound...
Xiaolin Ha [Fri, 17 Jun 2022 15:35:26 +0000 (23:35 +0800)] 
HBASE-27125 The batch size of cleaning expired mob files should have an upper bound (#4541)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-27117 Update the method comments for RegionServerAccounting (#4532)
litao [Fri, 17 Jun 2022 00:18:18 +0000 (08:18 +0800)] 
HBASE-27117 Update the method comments for RegionServerAccounting (#4532)

3 months agoHBASE-26956 ExportSnapshot tool supports removing TTL (#4351) 3.0.0-alpha-3RC0 rel/3.0.0-alpha-3
XinSun [Wed, 15 Jun 2022 07:04:17 +0000 (15:04 +0800)] 
HBASE-26956 ExportSnapshot tool supports removing TTL (#4351)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-26167 Allow users to not start zookeeper and dfs cluster when using TestingHBas...
xicm [Wed, 15 Jun 2022 02:48:48 +0000 (10:48 +0800)] 
HBASE-26167 Allow users to not start zookeeper and dfs cluster when using TestingHBaseCluster (#4534)

Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Yu Li <liyu@apache.org>
3 months agoRevert "HBASE-26167 Allow users to not start zookeeper and dfs cluster when using...
Duo Zhang [Wed, 15 Jun 2022 02:53:48 +0000 (10:53 +0800)] 
Revert "HBASE-26167 Allow users to not start zookeeper and dfs cluster when using TestingHBaseCluster (#4534)"

This reverts commit 11ae7208dd18ffcf8cd3631f5ca190ad19651209.

3 months agoHBASE-27121 Set version as 3.0.0-alpha-3 in master in prep for first RC of 3.0.0...
Duo Zhang [Wed, 15 Jun 2022 02:51:31 +0000 (10:51 +0800)] 
HBASE-27121 Set version as 3.0.0-alpha-3 in master in prep for first RC of 3.0.0-alpha-3 (#4535)

Signed-off-by: Xin Sun <ddupgs@gmail.com>
3 months agoHBASE-26167 Allow users to not start zookeeper and dfs cluster when using TestingHBas...
Duo Zhang [Wed, 15 Jun 2022 02:48:48 +0000 (10:48 +0800)] 
HBASE-26167 Allow users to not start zookeeper and dfs cluster when using TestingHBaseCluster (#4534)

Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Yu Li <liyu@apache.org>
3 months agoHBASE-27091 Speed up the loading of table descriptor from filesystem (#4493)
LiangJun He [Sat, 11 Jun 2022 00:48:23 +0000 (08:48 +0800)] 
HBASE-27091 Speed up the loading of table descriptor from filesystem (#4493)

Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
Signed-off-by: Yu Li <liyu@apache.org>
3 months agoRevert "HBASE-27091 Speed up the loading of table descriptor from filesystem (#4493)"
Yu Li [Tue, 14 Jun 2022 16:47:28 +0000 (00:47 +0800)] 
Revert "HBASE-27091 Speed up the loading of table descriptor from filesystem (#4493)"

This reverts commit 5d0f4dc729a471c1dd0b926f0d6fabdbca01d7f7 to correct signed-off info.

3 months agoHBASE-27091 Speed up the loading of table descriptor from filesystem (#4493)
LiangJun He [Sat, 11 Jun 2022 00:48:23 +0000 (08:48 +0800)] 
HBASE-27091 Speed up the loading of table descriptor from filesystem (#4493)

Signed-off-by: Yu Li <liyu@apache.org>
3 months agoHBASE-26856 BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted
Mohammad Arshad [Tue, 17 May 2022 05:24:38 +0000 (10:54 +0530)] 
HBASE-26856 BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted

Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of
ByteBuffer's underlying array instead of original ByteBuffer

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
3 months agoPurging references to ports 60010 and 60030 from the book
itstitus [Mon, 13 Jun 2022 11:07:15 +0000 (16:37 +0530)] 
Purging references to ports 60010 and 60030 from the book

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
3 months agoHBASE-27106 update asciidoctor site building. (#4522)
Sean Busbey [Mon, 13 Jun 2022 08:46:10 +0000 (03:46 -0500)] 
HBASE-27106 update asciidoctor site building. (#4522)

- update asciidoctor maven plugin to latest
- update the asciidoctor pdf dependency to latest
- allow the plugin to use its own version of jruby

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
3 months agoHBASE-27028 Add a shell command for flushing master local region (#4457)
LiangJun He [Mon, 13 Jun 2022 03:09:05 +0000 (11:09 +0800)] 
HBASE-27028 Add a shell command for flushing master local region (#4457)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoRevert "HBASE-25709 Close region may stuck when region is compacting and skipped...
Viraj Jasani [Sun, 12 Jun 2022 17:22:42 +0000 (10:22 -0700)] 
Revert "HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)" (#4524)

This reverts commit f3a48d19101a6a485628f71fc4b980fb95b44ad2.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
3 months agoHBASE-27097 SimpleRpcServer is broken (#4521)
Andrew Purtell [Sat, 11 Jun 2022 17:40:40 +0000 (10:40 -0700)] 
HBASE-27097 SimpleRpcServer is broken (#4521)

Apply https://issues.apache.org/jira/secure/attachment/13044874/MultiByteBuff.patch
from Lijin Bin on JIRA.

Co-authored-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
3 months agoRevert "HBASE-27084 Add spotless:check in mvn verify stage (#4482)"
Duo Zhang [Sat, 11 Jun 2022 16:12:05 +0000 (00:12 +0800)] 
Revert "HBASE-27084 Add spotless:check in mvn verify stage (#4482)"

This reverts commit a060e71c530556743189c9ee8b01a90e0f2891af.

3 months agoHBASE-26923 PerformanceEvaluation support encryption option (#4489)
wenwj0 [Sat, 11 Jun 2022 12:10:25 +0000 (20:10 +0800)] 
HBASE-26923 PerformanceEvaluation support encryption option (#4489)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-26366 Provide meaningful parent spans to ZK interactions
Nick Dimiduk [Fri, 10 Jun 2022 14:25:55 +0000 (16:25 +0200)] 
HBASE-26366 Provide meaningful parent spans to ZK interactions

Signed-off-by: Andrew Purtell <apurtell@apache.org>
3 months agoHBASE-27102 Vacate the .idea folder in order to simplify spotless configuration
Nick Dimiduk [Thu, 9 Jun 2022 13:14:21 +0000 (15:14 +0200)] 
HBASE-27102 Vacate the .idea folder in order to simplify spotless configuration

Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-27095 HbckChore should produce a report
Nick Dimiduk [Fri, 10 Jun 2022 13:46:24 +0000 (15:46 +0200)] 
HBASE-27095 HbckChore should produce a report

In #4470 for HBASE-26192, it was noted that the HbckChore is kind of a pain to use and test
because it maintains a bunch of local state. By contract, the CatalogJanitorChore makes a nice
self-contained report. Let's update HbckChore to do the same.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
3 months agoHBASE-27103 All MR UTs are broken because of ClassNotFound (#4514)
Andrew Purtell [Thu, 9 Jun 2022 17:00:10 +0000 (10:00 -0700)] 
HBASE-27103 All MR UTs are broken because of ClassNotFound (#4514)

Signed-off-by: Sean Busbey <busbey@apache.org>
Co-authored-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-27066 The Region Visualizer display failed
Nick Dimiduk [Mon, 6 Jun 2022 14:12:05 +0000 (16:12 +0200)] 
HBASE-27066 The Region Visualizer display failed

Reviewed-by: litao <tomleescut@gmail.com>
3 months agoRevert "HBASE-27066 The Region Visualizer display failed (#4472)"
Nick Dimiduk [Mon, 6 Jun 2022 13:37:21 +0000 (15:37 +0200)] 
Revert "HBASE-27066 The Region Visualizer display failed (#4472)"

This reverts commit 5c116d239f4fbfdb8ef9c4d945b2c1a9ad6c416e.

3 months agoHBASE-27092 Regionserver table on Master UI is broken (#4495)
litao [Wed, 8 Jun 2022 00:37:48 +0000 (08:37 +0800)] 
HBASE-27092 Regionserver table on Master UI is broken (#4495)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
3 months agoHBASE-27093 AsyncNonMetaRegionLocator:put Complete CompletableFuture outside lock...
wangzhi [Tue, 7 Jun 2022 04:17:52 +0000 (12:17 +0800)] 
HBASE-27093 AsyncNonMetaRegionLocator:put Complete CompletableFuture outside lock block (#4496)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-27038 CellComparator should extend Serializable (#4492)
Bryan Beaudreault [Mon, 6 Jun 2022 21:44:13 +0000 (17:44 -0400)] 
HBASE-27038 CellComparator should extend Serializable (#4492)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
3 months agoHBASE-27084 Add spotless:check in mvn verify stage (#4482)
Duo Zhang [Mon, 6 Jun 2022 11:49:34 +0000 (19:49 +0800)] 
HBASE-27084 Add spotless:check in mvn verify stage (#4482)

Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
3 months agoHBASE-27080 Optimize debug output log of ConstantSizeRegionSplitPolicy class. (#4481)
liuzhuang2017 [Mon, 6 Jun 2022 05:37:58 +0000 (13:37 +0800)] 
HBASE-27080 Optimize debug output log of ConstantSizeRegionSplitPolicy class. (#4481)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
3 months agoHBASE-27017: MOB snapshot is broken when FileBased SFT is used (#4466)
BukrosSzabolcs [Sun, 5 Jun 2022 18:51:28 +0000 (20:51 +0200)] 
HBASE-27017: MOB snapshot is broken when FileBased SFT is used (#4466)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
3 months agoHBASE-26983 Upgrade JRuby to 9.3.4.0 (#4378)
Sean Busbey [Sun, 5 Jun 2022 05:15:59 +0000 (00:15 -0500)] 
HBASE-26983 Upgrade JRuby to 9.3.4.0 (#4378)

- Update JRuby
- Replace java_kind_of since it has been removed
- update jcoding / joni to match jruby

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
4 months agoHBASE-26993 Make the new framework for region replication could work for SKIP_WAL...
chenglei [Fri, 3 Jun 2022 08:39:17 +0000 (16:39 +0800)] 
HBASE-26993 Make the new framework for region replication could work for SKIP_WAL (#4392)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
4 months agoHBASE-26985 check permission for SecureBulkLoadManager (#4379)
skysiders [Thu, 2 Jun 2022 22:28:22 +0000 (06:28 +0800)] 
HBASE-26985 check permission for SecureBulkLoadManager (#4379)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
4 months agoHBASE-27046 The filenum in AbstractFSWAL should be monotone increasing (#4449)
Duo Zhang [Thu, 2 Jun 2022 15:55:23 +0000 (23:55 +0800)] 
HBASE-27046 The filenum in AbstractFSWAL should be monotone increasing (#4449)

Signed-off-by: Xin Sun <ddupgs@gmail.com>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
4 months agoHBASE-26962: Add mob info in web UI (#4359)
liangxs [Thu, 2 Jun 2022 15:53:03 +0000 (23:53 +0800)] 
HBASE-26962: Add mob info in web UI (#4359)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
4 months agoHBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) (...
Xiaolin Ha [Thu, 2 Jun 2022 15:52:14 +0000 (23:52 +0800)] 
HBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) (#4405)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
4 months agoHBASE-27036 Displays the number of decommissioned region server for status command...
litao [Thu, 2 Jun 2022 15:51:39 +0000 (23:51 +0800)] 
HBASE-27036 Displays the number of decommissioned region server for status command (#4431)

add decommissionedServers to cluster metric

Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org
4 months agoHBASE-27039 Some methods of MasterRegion should be annotated for testing only (#4433)
LiangJun He [Thu, 2 Jun 2022 13:27:25 +0000 (21:27 +0800)] 
HBASE-27039 Some methods of MasterRegion should be annotated for testing only (#4433)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
4 months agoHBASE-27037 Display the region server state on the Web UI (#4432)
litao [Thu, 2 Jun 2022 13:19:45 +0000 (21:19 +0800)] 
HBASE-27037 Display the region server state on the Web UI (#4432)

Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
4 months agoHBASE-27023 Fix license issues after running spotless:apply (#4458)
Duo Zhang [Thu, 2 Jun 2022 12:18:00 +0000 (20:18 +0800)] 
HBASE-27023 Fix license issues after running spotless:apply (#4458)

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
4 months agoHBASE-27082 Change the return value of RSGroupInfo.getServers from SortedSet to Set...
Duo Zhang [Wed, 1 Jun 2022 15:30:52 +0000 (23:30 +0800)] 
HBASE-27082 Change the return value of RSGroupInfo.getServers from SortedSet to Set to keep compatibility (#4480)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
4 months agoHBASE-27079 Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE (...
Andrew Purtell [Tue, 31 May 2022 19:43:04 +0000 (12:43 -0700)] 
HBASE-27079 Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE (#4476)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
4 months agoHBASE-27067 Upgrade pyjwt to version 2.4.0 or later for dev-support/git-jira-release...
Andrew Purtell [Tue, 31 May 2022 18:52:52 +0000 (11:52 -0700)] 
HBASE-27067 Upgrade pyjwt to version 2.4.0 or later for dev-support/git-jira-release-audit (#4473)

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
4 months agoHBASE-27068 NPE occurs when the active master has not yet been elected (#4474)
litao [Tue, 31 May 2022 18:49:49 +0000 (02:49 +0800)] 
HBASE-27068 NPE occurs when the active master has not yet been elected (#4474)

Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org
4 months agoHBASE-27064 CME in TestRegionNormalizerWorkQueue (#4468)
Andrew Purtell [Tue, 31 May 2022 18:33:06 +0000 (11:33 -0700)] 
HBASE-27064 CME in TestRegionNormalizerWorkQueue (#4468)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
4 months agoHBASE-27069 Hbase SecureBulkload permission regression (#4475)
Istvan Toth [Tue, 31 May 2022 08:52:35 +0000 (10:52 +0200)] 
HBASE-27069 Hbase SecureBulkload permission regression (#4475)

Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
4 months agoHBASE-27066 The Region Visualizer display failed (#4472)
litao [Sun, 29 May 2022 18:53:50 +0000 (02:53 +0800)] 
HBASE-27066 The Region Visualizer display failed (#4472)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
4 months agoHBASE-27065 Build against Hadoop 3.3.3 (#4467)
Andrew Purtell [Fri, 27 May 2022 21:03:23 +0000 (14:03 -0700)] 
HBASE-27065 Build against Hadoop 3.3.3 (#4467)

When building against Hadoop 3.3.3 and any future version of Hadoop
incorporating reload4j the new Enforcer rule we have active in
branch-2.5 and up to exclude other logging frameworks besides log4j2
will trigger. We need to add exclusions to prevent that from
happening so the build will succeed.

Also exclude leveldbjni-all to avoid a LICENSE file generation error.

Add netty-all to hadoop-hdfs test context... to fix tests failing
trying to init minidfscluster.

Co-authored-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
4 months agoHBASE-26854 Shell startup logs a bunch of noise (#4469)
Andrew Purtell [Fri, 27 May 2022 21:00:41 +0000 (14:00 -0700)] 
HBASE-26854 Shell startup logs a bunch of noise (#4469)

Upon startup the shell logs a bunch of noise, mainly from zookeeper.
Also hide WARN level logging from the Hadoop libraries

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
4 months agoHBASE-27061 two phase bulkload is broken when SFT is in use. (#4465)
Sergey Soldatov [Thu, 26 May 2022 10:01:21 +0000 (03:01 -0700)] 
HBASE-27061 two phase bulkload is broken when SFT is in use. (#4465)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
4 months agoHBASE-26649 Addendum fix spotless error
Duo Zhang [Wed, 25 May 2022 13:28:47 +0000 (21:28 +0800)] 
HBASE-26649 Addendum fix spotless error

4 months agoHBASE-27055 Add additional comments when using HBASE_TRACE_OPTS with standalone mode...
Tak Lon (Stephen) Wu [Tue, 24 May 2022 16:27:15 +0000 (09:27 -0700)] 
HBASE-27055 Add additional comments when using HBASE_TRACE_OPTS with standalone mode (#4452)

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
4 months agoHBASE-26342 Support custom paths of independent configuration and pool for hfile...
Xiaolin Ha [Tue, 24 May 2022 01:53:48 +0000 (09:53 +0800)] 
HBASE-26342 Support custom paths of independent configuration and pool for hfile cleaner (#4403)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
4 months agoHBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocat...
huaxiangsun [Mon, 23 May 2022 15:54:00 +0000 (08:54 -0700)] 
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() (#4442)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
4 months agoHBASE-27027 Use jetty SslContextFactory.Server instead of deprecated SslContextFactor...
bitterfox [Sun, 22 May 2022 03:32:17 +0000 (12:32 +0900)] 
HBASE-27027 Use jetty SslContextFactory.Server instead of deprecated SslContextFactory (#4425)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
4 months agoHBASE-27030 Fix undefined local variable error in draining_servers.rb (#4427)
Junegunn Choi [Sun, 22 May 2022 03:31:48 +0000 (12:31 +0900)] 
HBASE-27030 Fix undefined local variable error in draining_servers.rb (#4427)

HBASE-21812 replaced a for-loop with an each block.
Each block introduces a new scope, so a local variable defined inside it
cannot be accessed afterwards.

  NameError: undefined local variable or method `admin' for main:Object
    getServerNames at /opt/khp/hbase/bin/draining_servers.rb:81
        addServers at /opt/khp/hbase/bin/draining_servers.rb:88
            <main> at /opt/khp/hbase/bin/draining_servers.rb:146

This commit defines the admin local variable in the current scope beforehand,
so that we can still access it after the block.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
4 months agoHBASE-27047 Fix typo for metric drainingRegionServers (#4441)
litao [Sun, 22 May 2022 03:28:01 +0000 (11:28 +0800)] 
HBASE-27047 Fix typo for metric drainingRegionServers (#4441)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
4 months agoHBASE-27054 TestStochasticLoadBalancerRegionReplicaLargeCluster.testRegionReplicasOnL...
d-c-manning [Sat, 21 May 2022 16:17:04 +0000 (09:17 -0700)] 
HBASE-27054 TestStochasticLoadBalancerRegionReplicaLargeCluster.testRegionReplicasOnLargeCluster is flaky (#4454)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
4 months agoHBASE-27043 Let lock wait timeout to improve performance of SnapshotHFileCleaner...
Xiaolin Ha [Fri, 20 May 2022 22:32:58 +0000 (06:32 +0800)] 
HBASE-27043 Let lock wait timeout to improve performance of SnapshotHFileCleaner (#4437)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
4 months agoHBASE-27052 TestAsyncTableScanner.testScanWrongColumnFamily is flaky (#4451)
Nick Dimiduk [Fri, 20 May 2022 22:13:23 +0000 (00:13 +0200)] 
HBASE-27052 TestAsyncTableScanner.testScanWrongColumnFamily is flaky (#4451)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
4 months agoHBASE-27051 TestReplicationSource.testReplicationSourceInitializingMetric is flaky...
Andrew Purtell [Fri, 20 May 2022 22:10:42 +0000 (15:10 -0700)] 
HBASE-27051 TestReplicationSource.testReplicationSourceInitializingMetric is flaky (#4448)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
4 months agoHBASE-27050 Support unit test pattern matching again (#4447)
Andrew Purtell [Fri, 20 May 2022 22:07:10 +0000 (15:07 -0700)] 
HBASE-27050 Support unit test pattern matching again (#4447)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
4 months agoHBASE-27018 Add a tool command list_liveservers (#4416)
litao [Thu, 19 May 2022 22:47:16 +0000 (06:47 +0800)] 
HBASE-27018 Add a tool command list_liveservers (#4416)

Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
4 months agoHBASE-27006 Move nightly integration testing to new larger test node class. (#4438)
Sean Busbey [Wed, 18 May 2022 19:18:49 +0000 (14:18 -0500)] 
HBASE-27006 Move nightly integration testing to new larger test node class. (#4438)

4 months agoHBASE-27045 Disable TestClusterScopeQuotaThrottle (#4440)
Duo Zhang [Wed, 18 May 2022 12:29:06 +0000 (20:29 +0800)] 
HBASE-27045 Disable TestClusterScopeQuotaThrottle (#4440)

Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
4 months agoRevert "HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupte...
Nick Dimiduk [Wed, 18 May 2022 10:59:37 +0000 (12:59 +0200)] 
Revert "HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted (#4394)"

This reverts commit c198f23e5eb078abc47d4c3439477c6c2b4d5136.

4 months agoHBASE-27040 Optimize the log display of the ZKProcedureUtil.java (#4434)
LiangJun He [Tue, 17 May 2022 07:29:43 +0000 (15:29 +0800)] 
HBASE-27040 Optimize the log display of the ZKProcedureUtil.java (#4434)

Signed-off-by: Yu Li <liyu@apache.org>
4 months agoHBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted (...
Mohammad Arshad [Tue, 17 May 2022 05:24:38 +0000 (10:54 +0530)] 
HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted (#4394)

Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of ByteBuffer's underlying array instead of original ByteBuffer

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
4 months agoHBASE-27032 The draining region servers metric description is incorrect (#4428)
litao [Tue, 17 May 2022 05:05:35 +0000 (13:05 +0800)] 
HBASE-27032 The draining region servers metric description is incorrect (#4428)

Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
4 months agoHBASE-26986 Trace a one-shot execution of a Master procedure
Nick Dimiduk [Thu, 28 Apr 2022 15:19:24 +0000 (17:19 +0200)] 
HBASE-26986 Trace a one-shot execution of a Master procedure

This one adds a tracing context to the Master's ProcedureV2 execution. This ties all the spans
that result from a procedure execution back to a procedure by name. Maybe in a follow-on issue, we
can serialize span context along with procedures and display procedure start/stop/retry events and
parent-child hierarchy in tracing visualization.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
4 months agoHBASE-27019 Minor compression performance improvements (#4420)
Andrew Purtell [Sat, 14 May 2022 01:29:10 +0000 (18:29 -0700)] 
HBASE-27019 Minor compression performance improvements (#4420)

TRACE level logging is expensive enough to warrant removal. They were
useful during development but are now just overhead.

Also we unnecessarily create new compressor and decompressor instances
in the reset() methods for the Aircompressor and Lz4 codecs. Remove.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
4 months agoHBASE-26905 ReplicationPeerManager#checkPeerExists should throw ReplicationPeerNotFou...
Rushabh Shah [Sat, 14 May 2022 01:24:19 +0000 (18:24 -0700)] 
HBASE-26905 ReplicationPeerManager#checkPeerExists should throw ReplicationPeerNotFoundException if peer doesn't exists (#4422)

Signed-off-by: Andrew Purtell <apurtell@apache.org>