hbase.git
8 months agoHBASE-26679 Wait on the future returned by FanOutOneBlockAsyncDFSOutput.flush would...
chenglei [Fri, 28 Jan 2022 05:36:20 +0000 (13:36 +0800)] 
HBASE-26679 Wait on the future returned by FanOutOneBlockAsyncDFSOutput.flush would stuck (#4039)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
8 months agoHBASE-26709 Ban the usage of junit 3 TestCase (#4065)
Duo Zhang [Thu, 27 Jan 2022 05:41:48 +0000 (13:41 +0800)] 
HBASE-26709 Ban the usage of junit 3 TestCase (#4065)

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
8 months agoHBASE-26690 Modify FSTableDescriptors to not rely on renaming when writing TableDescr...
Duo Zhang [Thu, 27 Jan 2022 05:28:56 +0000 (13:28 +0800)] 
HBASE-26690 Modify FSTableDescriptors to not rely on renaming when writing TableDescriptor (#4054)

Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
8 months agoHBASE-26473 Introduce `db.hbase.container_operations` span attribute
Nick Dimiduk [Thu, 18 Nov 2021 17:24:45 +0000 (09:24 -0800)] 
HBASE-26473 Introduce `db.hbase.container_operations` span attribute

For batch operations, collect and annotate the associated span with the set of all operations
contained in the batch.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
8 months agoHBASE-26711 Remove 2.3 from Downloads page (#4068)
Peter Somogyi [Wed, 26 Jan 2022 15:36:33 +0000 (16:36 +0100)] 
HBASE-26711 Remove 2.3 from Downloads page (#4068)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
8 months agoRevert "HBASE-26688 Threads shared EMPTY_RESULT may lead to unexpected client job...
Duo Zhang [Wed, 26 Jan 2022 05:39:20 +0000 (13:39 +0800)] 
Revert "HBASE-26688 Threads shared EMPTY_RESULT may lead to unexpected client job down. (#4048)"

This reverts commit d77ede4a29f415d6755d28a76abeaa39e5d34921.

8 months agoHBASE-26577 Update ref guide section for IT and Chaos Monkey to explain the additions...
Wellington Ramos Chevreuil [Tue, 25 Jan 2022 17:25:48 +0000 (17:25 +0000)] 
HBASE-26577 Update ref guide section for IT and Chaos Monkey to explain the additions from HBASE-26556 (#4007)

Signed-off-by: Josh Elser <elserj@apache.org>
8 months agoHBASE-26700 The way we bypass broken track file is not enough in StoreFileListFile...
Duo Zhang [Tue, 25 Jan 2022 06:51:11 +0000 (14:51 +0800)] 
HBASE-26700 The way we bypass broken track file is not enough in StoreFileListFile (#4055)

Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
8 months agoHBASE-26688 Threads shared EMPTY_RESULT may lead to unexpected client job down. ...
Yutong Xiao [Tue, 25 Jan 2022 06:48:56 +0000 (14:48 +0800)] 
HBASE-26688 Threads shared EMPTY_RESULT may lead to unexpected client job down. (#4048)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
8 months agoHBASE-26474 Implement connection-level attributes (addendum)
Nick Dimiduk [Wed, 12 Jan 2022 21:34:51 +0000 (13:34 -0800)] 
HBASE-26474 Implement connection-level attributes (addendum)

Addressing additional comments raised in branch-2 backport PR #4014

8 months agoHBASE-26614 Refactor code related to "dump"ing ZK nodes (#3969)
Nick Dimiduk [Mon, 24 Jan 2022 19:33:18 +0000 (11:33 -0800)] 
HBASE-26614 Refactor code related to "dump"ing ZK nodes (#3969)

The code starting at `ZKUtil.dump(ZKWatcher)` is a small mess – it has cyclic dependencies woven
through itself, `ZKWatcher` and `RecoverableZooKeeper`. It also initializes a static variable in
`ZKUtil` through the factory for `RecoverableZooKeeper` instances. Let's decouple and clean it
up.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
8 months agoHBASE-26675 Data race on Compactor.writer (#4035)
Duo Zhang [Mon, 24 Jan 2022 11:45:50 +0000 (19:45 +0800)] 
HBASE-26675 Data race on Compactor.writer (#4035)

Signed-off-by: Xin Sun <ddupgs@gmail.com>
8 months agoRevert "HBASE-26697 Migrate HBase Nightly HBase-Flaky-Tests and HBase-Find-Flaky...
Duo Zhang [Sat, 22 Jan 2022 11:35:44 +0000 (19:35 +0800)] 
Revert "HBASE-26697 Migrate HBase Nightly HBase-Flaky-Tests and HBase-Find-Flaky-Tests to ci-hbase (#4053)"

This reverts commit a42d6dbbf72fc685536a26a689399bee056487d2.

8 months agoHBASE-26697 Migrate HBase Nightly HBase-Flaky-Tests and HBase-Find-Flaky-Tests to...
Duo Zhang [Sat, 22 Jan 2022 06:16:34 +0000 (14:16 +0800)] 
HBASE-26697 Migrate HBase Nightly HBase-Flaky-Tests and HBase-Find-Flaky-Tests to ci-hbase (#4053)

Signed-off-by: Yulin Niu <niuyulin@apache.org>
8 months agoHBASE-26661 Remove deprecated methods in MasterObserver (#4031)
sunyuting1 [Wed, 19 Jan 2022 11:25:06 +0000 (19:25 +0800)] 
HBASE-26661 Remove deprecated methods in MasterObserver (#4031)

Signrd-off-by: Duo Zhang <zhangduo@apache.org>
8 months agoHBASE-26674 Should modify filesCompacting under storeWriteLock (#4040)
Duo Zhang [Wed, 19 Jan 2022 05:59:35 +0000 (13:59 +0800)] 
HBASE-26674 Should modify filesCompacting under storeWriteLock (#4040)

Signed-off-by: Josh Elser <elserj@apache.org>
8 months agoHBASE-26662 User.createUserForTesting should not reset UserProvider.groups every...
Wellington Ramos Chevreuil [Tue, 18 Jan 2022 12:32:27 +0000 (12:32 +0000)] 
HBASE-26662 User.createUserForTesting should not reset UserProvider.groups every time if hbase.group.service.for.test.only is true (#4029)

Signed-off-by: Josh Elser <elserj@apache.org>
Signrd-off-by: Duo Zhang <zhangduo@apache.org>
8 months agoHBASE-26654 ModifyTableDescriptorProcedure shoud load TableDescriptor while executing...
Duo Zhang [Sun, 16 Jan 2022 08:25:28 +0000 (16:25 +0800)] 
HBASE-26654 ModifyTableDescriptorProcedure shoud load TableDescriptor while executing (#4034)

Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
8 months agoHBASE-26671 Misspellings of hbck usage (#4033)
xianjingfeng [Sun, 16 Jan 2022 08:23:23 +0000 (16:23 +0800)] 
HBASE-26671 Misspellings of hbck usage (#4033)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
8 months agoHBASE-26469 correct HBase shell exit behavior to match code passed to exit (#4018)
Sean Busbey [Wed, 29 Sep 2021 04:00:11 +0000 (23:00 -0500)] 
HBASE-26469 correct HBase shell exit behavior to match code passed to exit (#4018)

* refactors how we handle running the passed in initialization script to make use of IRB sessions
  directly instead of reimplementing things ourselves
* simplify how we initialize our IRB config
* insert a shim for capturing exit codes passed via user calls to exit
* make use of user provided exit code unless we're reading stdin in interactive mode

This changes the exit code of the shell
* a 0 return code, or no return code, passed to a call to exit from stdin in non-interactive mode
  will now exit cleanly. in prior versions this would have exitted with an error and non-zero exit
  code.
* for other combinations of passing in an initilization script or reading from stdin with using the
  non-interactive flag, the exit code being 0 or non-0 should now line up with releases prior to
  2.4.z, which is a change in behavior compared to 2.4.z.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
8 months agoHBASE-26551 Add FastPath feature to HBase RWQueueRpcExecutor (#3929)
Yutong Xiao [Thu, 13 Jan 2022 03:11:12 +0000 (11:11 +0800)] 
HBASE-26551 Add FastPath feature to HBase RWQueueRpcExecutor (#3929)

Signed-off-by: Reid Chan <reidchan@apache.org>
8 months agoHBASE-26657 ProfileServlet should move the output location to hbase specific director...
Viraj Jasani [Tue, 11 Jan 2022 10:29:44 +0000 (15:59 +0530)] 
HBASE-26657 ProfileServlet should move the output location to hbase specific directory (#4022)

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
8 months agoHBASE-26520 Remove use of `db.hbase.namespance` tracing attribute (#4015)
Nick Dimiduk [Tue, 11 Jan 2022 01:02:50 +0000 (17:02 -0800)] 
HBASE-26520 Remove use of `db.hbase.namespance` tracing attribute (#4015)

The HBase-specific attribute `db.hbase.namespace` has been deprecated in favor of the generic
`db.name`. See also https://github.com/open-telemetry/opentelemetry-specification/issues/1760

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
8 months agoHBASE-26397 Display the excluded datanodes on regionserver UI (#3990)
Xiaolin Ha [Mon, 10 Jan 2022 04:53:05 +0000 (12:53 +0800)] 
HBASE-26397 Display the excluded datanodes on regionserver UI (#3990)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
8 months agoHBASE-26006 Update ref guide about the 2.4.x release line (#3992)
Duo Zhang [Sat, 8 Jan 2022 16:29:25 +0000 (00:29 +0800)] 
HBASE-26006 Update ref guide about the 2.4.x release line (#3992)

Amending-Author: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Reviewed-by: Nick Dimiduk <ndimiduk@apache.org>
8 months agoHBASE-26543 correct parsing of shell args with GetoptLong (#4000)
Sean Busbey [Wed, 15 Dec 2021 20:35:01 +0000 (14:35 -0600)] 
HBASE-26543 correct parsing of shell args with GetoptLong (#4000)

Signed-off-by: Mike Drob <mdrob@apache.org>
8 months agoHBASE-26643 Addendum align the test code with branch-2
Duo Zhang [Fri, 7 Jan 2022 16:39:06 +0000 (00:39 +0800)] 
HBASE-26643 Addendum align the test code with branch-2

8 months agoHBASE-26643 Addendum align the test code with branch-2
Duo Zhang [Fri, 7 Jan 2022 16:11:28 +0000 (00:11 +0800)] 
HBASE-26643 Addendum align the test code with branch-2

8 months agoHBASE-26643 LoadBalancer should not return empty map (#4005)
Duo Zhang [Fri, 7 Jan 2022 15:50:37 +0000 (23:50 +0800)] 
HBASE-26643 LoadBalancer should not return empty map (#4005)

Signed-off-by: Yulin Niu <niuyulin@apache.org>
8 months agoHBASE-26586 Should not rely on the global config when setting SFT implementation...
Duo Zhang [Fri, 7 Jan 2022 15:39:18 +0000 (23:39 +0800)] 
HBASE-26586 Should not rely on the global config when setting SFT implementation for a table while upgrading (#4006)

Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
8 months agoHBASE-26639 The implementation of TestMergesSplitsAddToTracker is problematic (#4010)
Duo Zhang [Fri, 7 Jan 2022 15:05:47 +0000 (23:05 +0800)] 
HBASE-26639 The implementation of TestMergesSplitsAddToTracker is problematic (#4010)

Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
8 months agoHBASE-26646 WALPlayer should obtain token from filesystem (#4003)
meiyi [Fri, 7 Jan 2022 09:37:29 +0000 (17:37 +0800)] 
HBASE-26646 WALPlayer should obtain token from filesystem (#4003)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
8 months agoHBASE-26616 Refactor code related to ZooKeeper authentication (#3973)
Nick Dimiduk [Fri, 7 Jan 2022 01:04:15 +0000 (17:04 -0800)] 
HBASE-26616 Refactor code related to ZooKeeper authentication (#3973)

This refactor reduces the size and scope of the `ZKUtil` class. The core of this refactor is
moving the `login*` methods from `ZKUtil` into their own class, `ZKAuthentication`. The class
`JaasConfiguration` is also moved along with them.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
8 months agoHBASE-26632 Should use downloads.apache.org for checksum, signature, changes.md and...
fcb-xiaobo [Thu, 6 Jan 2022 12:34:52 +0000 (20:34 +0800)] 
HBASE-26632 Should use downloads.apache.org for checksum, signature, changes.md and releasenote.md (#4002)

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
8 months agoHBASE-26474 Implement connection-level attributes (#3952)
Nick Dimiduk [Wed, 5 Jan 2022 23:32:12 +0000 (15:32 -0800)] 
HBASE-26474 Implement connection-level attributes (#3952)

Add support for `db.system`, `db.connection_string`, `db.user`.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
8 months agoHBASE-26585 Add SFT configuration to META table descriptor when creating META (#3998)
Wellington Ramos Chevreuil [Wed, 5 Jan 2022 12:20:07 +0000 (12:20 +0000)] 
HBASE-26585 Add SFT configuration to META table descriptor when creating META (#3998)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
8 months agoHBASE-26578 CompactedHFilesDischarger should be shutdown when aborting regionserver...
Xiaolin Ha [Wed, 5 Jan 2022 03:10:16 +0000 (11:10 +0800)] 
HBASE-26578 CompactedHFilesDischarger should be shutdown when aborting regionserver (#3946)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
8 months agoHBASE-26567 Remove IndexType from ChunkCreator (#3947)
chenglei [Tue, 4 Jan 2022 16:05:54 +0000 (00:05 +0800)] 
HBASE-26567 Remove IndexType from ChunkCreator (#3947)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
8 months agoHBASE-26631 Upgrade junit to 4.13.2 (#3997)
fcb-xiaobo [Tue, 4 Jan 2022 15:58:06 +0000 (23:58 +0800)] 
HBASE-26631 Upgrade junit to 4.13.2 (#3997)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
8 months agoHBASE-26634 Upgrade log4j to 2.17.1 (#3996)
xiaozhang0319 [Tue, 4 Jan 2022 15:56:56 +0000 (23:56 +0800)] 
HBASE-26634 Upgrade log4j to 2.17.1 (#3996)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
8 months agoHBASE-26641 Split TestMasterFailoverWithProcedures (#3994)
Duo Zhang [Sun, 2 Jan 2022 16:35:14 +0000 (00:35 +0800)] 
HBASE-26641 Split TestMasterFailoverWithProcedures (#3994)

Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
8 months agoHBASE-26629 Add expiration for long time vacant scanners in Thrift2 (#3984)
Yutong Xiao [Sun, 2 Jan 2022 13:19:31 +0000 (21:19 +0800)] 
HBASE-26629 Add expiration for long time vacant scanners in Thrift2 (#3984)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
8 months agoHBASE-26494 Using RefCnt to fix the flawed MemStoreLABImpl (#3983)
chenglei [Sat, 1 Jan 2022 12:50:52 +0000 (20:50 +0800)] 
HBASE-26494 Using RefCnt to fix the flawed MemStoreLABImpl (#3983)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
8 months agoHBASE-26635 Optimize decodeNumeric in OrderedBytes (#3986)
Yutong Xiao [Sat, 1 Jan 2022 12:42:57 +0000 (20:42 +0800)] 
HBASE-26635 Optimize decodeNumeric in OrderedBytes (#3986)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
8 months agoHBASE-26540 Implement a tool to verify the lag of region replication (#3950) 3891/head
Duo Zhang [Fri, 17 Dec 2021 13:24:26 +0000 (21:24 +0800)] 
HBASE-26540 Implement a tool to verify the lag of region replication (#3950)

Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
8 months agoHBASE-26539 The default rpc timeout 200ms is too small for replicating meta edits...
Duo Zhang [Mon, 6 Dec 2021 15:42:42 +0000 (23:42 +0800)] 
HBASE-26539 The default rpc timeout 200ms is too small for replicating meta edits (#3919)

Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
8 months agoHBASE-26538 Should find a way to clear the replication queue for a legacy region_repl...
Duo Zhang [Mon, 6 Dec 2021 15:42:25 +0000 (23:42 +0800)] 
HBASE-26538 Should find a way to clear the replication queue for a legacy region_replica_replication peer (#3918)

Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
8 months agoHBASE-26486 Attach the new region replication framework design doc to git repo (...
Duo Zhang [Sat, 27 Nov 2021 13:29:28 +0000 (21:29 +0800)] 
HBASE-26486 Attach the new region replication framework design doc to git repo (#3884)

Signed-off-by: Yulin Niu <niuyulin@apache.org>
8 months agoHBASE-26478 Update ref guide about the new region replication framework (#3885)
Duo Zhang [Sat, 27 Nov 2021 13:29:02 +0000 (21:29 +0800)] 
HBASE-26478 Update ref guide about the new region replication framework (#3885)

Signed-off-by: Yulin Niu <niuyulin@apache.org>
8 months agoHBASE-26481 Consider rolling upgrading from old region replication framework (#3880)
Duo Zhang [Sat, 27 Nov 2021 04:03:18 +0000 (12:03 +0800)] 
HBASE-26481 Consider rolling upgrading from old region replication framework (#3880)

Signed-off-by: Xin Sun <ddupgs@gmail.com>
Reviewed-by: GeorryHuang <huangzhuoyue@apache.org>
8 months agoHBASE-26417 Remove NoopReplicationQueueStorage (#3882)
林尚泉 [Fri, 26 Nov 2021 15:16:59 +0000 (23:16 +0800)] 
HBASE-26417 Remove NoopReplicationQueueStorage (#3882)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
8 months agoHBASE-26456 Limit the size for one replicating (#3873)
Duo Zhang [Tue, 23 Nov 2021 10:40:21 +0000 (18:40 +0800)] 
HBASE-26456 Limit the size for one replicating (#3873)

Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
8 months agoHBASE-26416 Implement a new method for region replication instead of using replay...
Duo Zhang [Mon, 22 Nov 2021 13:50:02 +0000 (21:50 +0800)] 
HBASE-26416 Implement a new method for region replication instead of using replay (#3864)

Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
8 months agoHBASE-26457 Should not always clear all the failed replicas when getting a flush...
Duo Zhang [Wed, 17 Nov 2021 15:20:22 +0000 (23:20 +0800)] 
HBASE-26457 Should not always clear all the failed replicas when getting a flush all request (#3850)

Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
8 months agoHBASE-26448 Make sure we do not flush a region too frequently (#3847)
Duo Zhang [Mon, 15 Nov 2021 16:06:54 +0000 (00:06 +0800)] 
HBASE-26448 Make sure we do not flush a region too frequently (#3847)

Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
8 months agoHBASE-26449 The way we add or clear failedReplicas may have race (#3846)
Duo Zhang [Sun, 14 Nov 2021 12:52:04 +0000 (20:52 +0800)] 
HBASE-26449 The way we add or clear failedReplicas may have race (#3846)

Signed-off-by: Xin Sun <ddupgs@gmail.com>
8 months agoHBASE-26413 Limit the total size of buffered region replication entries (#3844)
Duo Zhang [Sat, 13 Nov 2021 02:45:54 +0000 (10:45 +0800)] 
HBASE-26413 Limit the total size of buffered region replication entries (#3844)

Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
8 months agoHBASE-26412 Handle sink failure in RegionReplicationSink (#3815)
Duo Zhang [Tue, 9 Nov 2021 13:41:25 +0000 (21:41 +0800)] 
HBASE-26412 Handle sink failure in RegionReplicationSink (#3815)

Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
8 months agoHBASE-26407 Introduce a region replication sink for sinking WAL edits to secondary...
Duo Zhang [Tue, 2 Nov 2021 00:42:29 +0000 (08:42 +0800)] 
HBASE-26407 Introduce a region replication sink for sinking WAL edits to secondary replicas directly (#3807)

Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
8 months agoHBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.1 (#3987)
Duo Zhang [Fri, 31 Dec 2021 04:08:01 +0000 (12:08 +0800)] 
HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.1 (#3987)

Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
8 months agoHBASE-26636 Update the ref guide upgrading section to mention that the master issue...
Duo Zhang [Fri, 31 Dec 2021 04:07:09 +0000 (12:07 +0800)] 
HBASE-26636 Update the ref guide upgrading section to mention that the master issue when upgrading to 2.3 (#3989)

Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
9 months agoHBASE-26347 Support detect and exclude slow DNs in fan-out of WAL (#3800)
Xiaolin Ha [Thu, 30 Dec 2021 09:04:01 +0000 (17:04 +0800)] 
HBASE-26347 Support detect and exclude slow DNs in fan-out of WAL (#3800)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
9 months agoHBASE-26625 ExportSnapshot tool failed to copy data files for tables with merge regio...
meiyi [Thu, 30 Dec 2021 02:40:33 +0000 (10:40 +0800)] 
HBASE-26625 ExportSnapshot tool failed to copy data files for tables with merge region (#3981)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
9 months agoHBASE-26623 Report CallDroppedException in exception metrics (#3980)
Richard Marscher [Wed, 29 Dec 2021 16:02:50 +0000 (11:02 -0500)] 
HBASE-26623 Report CallDroppedException in exception metrics (#3980)

`CallDroppedException` can be thrown with `CallRunner.drop()` by queue implementations that decide to drop calls to groom the RPC call backlog. The LifoCoDel queue does this I believe and with Pluggable queue it's possible for 3rd party queue implementations to be using `drop()` for similar reasons. It would be nice for the server to be tracking these exceptions in metrics since otherwise you might have to do some extra lifting on the client side.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
9 months agoHBASE-26564 Retire the method visitLogEntryBeforeWrite without RegionInfo in WALActio...
Yutong Xiao [Mon, 27 Dec 2021 15:59:13 +0000 (23:59 +0800)] 
HBASE-26564 Retire the method visitLogEntryBeforeWrite without RegionInfo in WALActionListner (#3938)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
9 months agoHBASE-26566 Optimize encodeNumeric in OrderedBytes (#3940)
Yutong Xiao [Mon, 27 Dec 2021 15:57:30 +0000 (23:57 +0800)] 
HBASE-26566 Optimize encodeNumeric in OrderedBytes (#3940)

Signed-off-by: Reid Chan <reidchan@apache.org>
9 months agoHBASE-26626 Update download page for HBase Operator Tools to 1.2.0 (#3982)
Guangxu Cheng [Sat, 25 Dec 2021 06:25:48 +0000 (14:25 +0800)] 
HBASE-26626 Update download page for HBase Operator Tools to 1.2.0 (#3982)

9 months agoHBASE-26628 Update downloads.xml for release 2.4.9
Andrew Purtell [Fri, 24 Dec 2021 22:58:52 +0000 (14:58 -0800)] 
HBASE-26628 Update downloads.xml for release 2.4.9

Signed-off-by: Andrew Purtell <apurtell@apache.org>
9 months agoHBASE-26621 Set version as 3.0.0-alpha-3-SNAPSHOT in master (#3978)
Duo Zhang [Fri, 24 Dec 2021 06:20:32 +0000 (14:20 +0800)] 
HBASE-26621 Set version as 3.0.0-alpha-3-SNAPSHOT in master (#3978)

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
9 months agoHBASE-26620 Add 3.0.0-alpha-2 to download page (#3977)
Duo Zhang [Thu, 23 Dec 2021 14:25:16 +0000 (22:25 +0800)] 
HBASE-26620 Add 3.0.0-alpha-2 to download page (#3977)

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
9 months agoHBASE-26615 Snapshot referenced data files are deleted when delete a table with merge...
meiyi [Thu, 23 Dec 2021 08:45:36 +0000 (16:45 +0800)] 
HBASE-26615 Snapshot referenced data files are deleted when delete a table with merge regions (#3971)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
9 months agoHBASE-26609 Round the size to MB or KB at the end of calculation in HRegionServer...
Duo Zhang [Thu, 23 Dec 2021 02:37:17 +0000 (10:37 +0800)] 
HBASE-26609 Round the size to MB or KB at the end of calculation in HRegionServer.createRegionLoad (#3967)

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
9 months agoHBASE-26598 Fix excessive connections in MajorCompactor (#3961)
Samir Khan [Thu, 23 Dec 2021 02:29:48 +0000 (20:29 -0600)] 
HBASE-26598 Fix excessive connections in MajorCompactor (#3961)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
9 months agoHBASE-26265 Update ref guide to mention the new store file tracker im… (#3942)
Wellington Ramos Chevreuil [Thu, 16 Dec 2021 21:07:38 +0000 (21:07 +0000)] 
HBASE-26265 Update ref guide to mention the new store file tracker im… (#3942)

9 months agoHBASE-26286: Add support for specifying store file tracker when restoring or cloning...
BukrosSzabolcs [Thu, 16 Dec 2021 01:09:03 +0000 (20:09 -0500)] 
HBASE-26286: Add support for specifying store file tracker when restoring or cloning snapshot

Closes #3851

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
9 months agoHBASE-26454 CreateTableProcedure still relies on temp dir and renames… (#3845)
Wellington Ramos Chevreuil [Fri, 19 Nov 2021 12:16:29 +0000 (12:16 +0000)] 
HBASE-26454 CreateTableProcedure still relies on temp dir and renames… (#3845)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
9 months agoHBASE-26271 Cleanup the broken store files under data directory (#3786)
BukrosSzabolcs [Tue, 9 Nov 2021 16:19:00 +0000 (17:19 +0100)] 
HBASE-26271 Cleanup the broken store files under data directory (#3786)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
9 months agoHBASE-26263 [Rolling Upgrading] Persist the StoreFileTracker configurations to TableD...
GeorryHuang [Sat, 6 Nov 2021 14:20:12 +0000 (22:20 +0800)] 
HBASE-26263 [Rolling Upgrading] Persist the StoreFileTracker configurations to TableDescriptor for existing tables (#3700)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
9 months agoHBASE-26328 Clone snapshot doesn't load reference files into FILE SFT impl (#3749)
Wellington Ramos Chevreuil [Fri, 22 Oct 2021 15:56:15 +0000 (16:56 +0100)] 
HBASE-26328 Clone snapshot doesn't load reference files into FILE SFT impl (#3749)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
9 months agoHBASE-26386 Refactor StoreFileTracker implementations to expose the set method (...
Duo Zhang [Thu, 21 Oct 2021 02:27:45 +0000 (10:27 +0800)] 
HBASE-26386 Refactor StoreFileTracker implementations to expose the set method (#3774)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
9 months agoHBASE-26326 CreateTableProcedure fails when FileBasedStoreFileTracker… (#3721)
Wellington Ramos Chevreuil [Wed, 13 Oct 2021 14:48:13 +0000 (15:48 +0100)] 
HBASE-26326 CreateTableProcedure fails when FileBasedStoreFileTracker… (#3721)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
9 months agoHBASE-26280 Use store file tracker when snapshoting (#3685)
Duo Zhang [Fri, 17 Sep 2021 01:40:44 +0000 (09:40 +0800)] 
HBASE-26280 Use store file tracker when snapshoting (#3685)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Reviewed-by: Josh Elser <elserj@apache.org>
9 months agoHBASE-26264 Add more checks to prevent misconfiguration on store file tracker (#3681)
Duo Zhang [Wed, 15 Sep 2021 15:00:03 +0000 (23:00 +0800)] 
HBASE-26264 Add more checks to prevent misconfiguration on store file tracker (#3681)

Signed-off-by: Josh Elser <elserj@apache.org>
9 months agoHBASE-26248 Should find a suitable way to let users specify the store file tracker...
Duo Zhang [Tue, 14 Sep 2021 08:28:21 +0000 (16:28 +0800)] 
HBASE-26248 Should find a suitable way to let users specify the store file tracker implementation (#3665)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
9 months agoHBASE-26246 Persist the StoreFileTracker configurations to TableDescriptor when creat...
Wellington Ramos Chevreuil [Sun, 12 Sep 2021 13:14:03 +0000 (14:14 +0100)] 
HBASE-26246 Persist the StoreFileTracker configurations to TableDescriptor when creating table (#3666)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
9 months agoHBASE-26224 Introduce a MigrationStoreFileTracker to support migrating from different...
Duo Zhang [Thu, 9 Sep 2021 04:11:25 +0000 (12:11 +0800)] 
HBASE-26224 Introduce a MigrationStoreFileTracker to support migrating from different store file tracker implementations (#3656)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
9 months agoHBASE-26079 Use StoreFileTracker when splitting and merging (#3617)
Wellington Ramos Chevreuil [Wed, 8 Sep 2021 09:31:49 +0000 (10:31 +0100)] 
HBASE-26079 Use StoreFileTracker when splitting and merging (#3617)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
9 months agoHBASE-25988 Store the store file list by a file (#3578)
Duo Zhang [Thu, 26 Aug 2021 10:51:12 +0000 (18:51 +0800)] 
HBASE-25988 Store the store file list by a file (#3578)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
9 months agoHBASE-26064 Introduce a StoreFileTracker to abstract the store file tracking logic
Duo Zhang [Thu, 29 Jul 2021 10:35:19 +0000 (18:35 +0800)] 
HBASE-26064 Introduce a StoreFileTracker to abstract the store file tracking logic

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
9 months agoHBASE-26613 The logic of the method incrementIV in Encryption class has problem ...
Yutong Xiao [Wed, 22 Dec 2021 16:00:12 +0000 (00:00 +0800)] 
HBASE-26613 The logic of the method incrementIV in Encryption class has problem (#3968)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
9 months agoHBASE-26606 Upgrade log4j2 to 2.17.0 (#3965) 3.0.0-alpha-2RC2 rel/3.0.0-alpha-2
Duo Zhang [Sun, 19 Dec 2021 08:31:57 +0000 (16:31 +0800)] 
HBASE-26606 Upgrade log4j2 to 2.17.0 (#3965)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
9 months agoHBASE-26580 The message of StoreTooBusy is confused (#3949)
zhengzhuobinzzb [Sat, 18 Dec 2021 15:22:14 +0000 (23:22 +0800)] 
HBASE-26580 The message of StoreTooBusy is confused (#3949)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
9 months agoHBASE-26579 Set storage policy of recovered edits when hbase.wal.storage.type is...
zhengzhuobinzzb [Sat, 18 Dec 2021 15:17:40 +0000 (23:17 +0800)] 
HBASE-26579 Set storage policy of recovered edits when hbase.wal.storage.type is configured (#3948)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
9 months agoHBASE-26488 Memory leak when MemStore retry flushing (#3899)
chenglei [Sat, 18 Dec 2021 04:17:19 +0000 (12:17 +0800)] 
HBASE-26488 Memory leak when MemStore retry flushing (#3899)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
9 months agoHBASE-26340 TableSplit returns false size under 1MB (#3872)
Norbert Kalmar [Sat, 18 Dec 2021 03:58:16 +0000 (04:58 +0100)] 
HBASE-26340 TableSplit returns false size under 1MB (#3872)

Signed-off-by: Peter Somogyi <psomogyi@apache.org
Signed-off-by: Duo Zhang <zhangduo@apache.org>
9 months agoHBASE-26601 maven-gpg-plugin failing with "Inappropriate ioctl for device"
Andrew Purtell [Sat, 18 Dec 2021 01:58:17 +0000 (17:58 -0800)] 
HBASE-26601 maven-gpg-plugin failing with "Inappropriate ioctl for device"

Signed-off-by: Andrew Purtell <apurtell@apache.org>
9 months agoRevert "HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.0 (#3910)"
Duo Zhang [Fri, 17 Dec 2021 04:25:27 +0000 (12:25 +0800)] 
Revert "HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.0 (#3910)"

Need a new 4.0.1 release

This reverts commit 139f08587a56ece62f33eaa028f6534b6129300e.

9 months agoHBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.0 (#3910)
Duo Zhang [Fri, 17 Dec 2021 02:22:48 +0000 (10:22 +0800)] 
HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.0 (#3910)

Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
9 months agoHBASE-26542 Apply a `package` to test protobuf files (addendum)
Nick Dimiduk [Thu, 16 Dec 2021 18:51:55 +0000 (10:51 -0800)] 
HBASE-26542 Apply a `package` to test protobuf files (addendum)

RpcServer identifies the services it hosts by unqualified service name. Thus, use `getName()`
instead of `getFullName()`. See also HBASE-26589.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
9 months agoHBASE-26542 Apply a `package` to test protobuf files
Nick Dimiduk [Mon, 6 Dec 2021 20:14:02 +0000 (12:14 -0800)] 
HBASE-26542 Apply a `package` to test protobuf files

This is needed in a couple places in order to test that traces over the IPC layer carry correct
span names, and it's good hygiene anyway.

Signed-off-by: Duo Zhang <zhangduo@apache.org>