hbase.git
2 years agoHBASE-25081 Up the container nproc uplimit to 30000 (#2439)
Istvan Toth [Tue, 22 Sep 2020 15:53:15 +0000 (17:53 +0200)] 
HBASE-25081 Up the container nproc uplimit to 30000 (#2439)

2 years agoHBASE-25076 fix typo in MasterRegion java doc (#2432)
niuyulin [Mon, 21 Sep 2020 17:00:49 +0000 (01:00 +0800)] 
HBASE-25076 fix typo in MasterRegion java doc (#2432)

Co-authored-by: niuyulin <niuyulin@xiaomi.com>
Signed-off-by: Jan Hentschel <janh@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-25075 Fix typo in ReplicationProtobufUtil (#2431)
niuyulin [Mon, 21 Sep 2020 16:44:47 +0000 (00:44 +0800)] 
HBASE-25075 Fix typo in ReplicationProtobufUtil (#2431)

Co-authored-by: niuyulin <niuyulin@xiaomi.com>
Signed-off-by: Jan Hentschel <janh@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-24976 REST Server failes to start without any error message
lujiefsi [Mon, 21 Sep 2020 00:25:58 +0000 (08:25 +0800)] 
HBASE-24976 REST Server failes to start without any error message

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoRevert "HBASE-24976 Printing the swallowed exception"
Guanghao Zhang [Mon, 21 Sep 2020 00:27:38 +0000 (08:27 +0800)] 
Revert "HBASE-24976 Printing the swallowed exception"

This reverts commit 8efd2509e9f4d44a699f0ad0e50c0b7ca7ad2b2a.

2 years agoHBASE-24976 Printing the swallowed exception
lujiefsi [Mon, 21 Sep 2020 00:25:58 +0000 (08:25 +0800)] 
HBASE-24976 Printing the swallowed exception

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-25072 Remove the unnecessary System.out.println in MasterRegistry (#2429)
niuyulin [Sun, 20 Sep 2020 18:08:43 +0000 (02:08 +0800)] 
HBASE-25072 Remove the unnecessary System.out.println in MasterRegistry (#2429)

Co-authored-by: niuyulin <niuyulin@xiaomi.com>
Signed-off-by: Jan Hentschel <janh@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24896 : Jira number correction in comment (ADDENDUM)
Viraj Jasani [Sun, 20 Sep 2020 09:01:22 +0000 (14:31 +0530)] 
HBASE-24896 : Jira number correction in comment (ADDENDUM)

2 years agoHBASE-24896 'Stuck' in static initialization creating RegionInfo instance
stack [Sun, 20 Sep 2020 08:45:34 +0000 (14:15 +0530)] 
HBASE-24896 'Stuck' in static initialization creating RegionInfo instance

Closes #2422

Untangle RegionInfo, RegionInfoBuilder, and MutableRegionInfo static
initializations some. Move MutableRegionInfo from inner-class of
RegionInfoBuilder to be (package private) standalone. Undo static
initializing references from RI to RIB.

Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-25066 Use FutureUtils.rethrow in AsyncTableResultScanner to better catch the...
Duo Zhang [Sun, 20 Sep 2020 03:25:22 +0000 (11:25 +0800)] 
HBASE-25066 Use FutureUtils.rethrow in AsyncTableResultScanner to better catch the stack trace (#2420)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-25069: Display region name instead of encoded region name in HBCK report page...
Mohammad Arshad [Sun, 20 Sep 2020 01:00:28 +0000 (06:30 +0530)] 
HBASE-25069: Display region name instead of encoded region name in HBCK report page. (#2428)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-24481 REST - Fix incorrect response code of get-regions in rest api
KevinSmile [Sat, 19 Sep 2020 14:15:10 +0000 (19:45 +0530)] 
HBASE-24481 REST - Fix incorrect response code of get-regions in rest api

Closes #2425

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24991 Replace MovedRegionsCleaner with guava cache (#2357)
Joseph295 [Sat, 19 Sep 2020 06:53:13 +0000 (14:53 +0800)] 
HBASE-24991 Replace MovedRegionsCleaner with guava cache (#2357)

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-25057: Fix typo memeber (#2414)
Hyeran Lee [Sat, 19 Sep 2020 06:36:06 +0000 (15:36 +0900)] 
HBASE-25057: Fix typo memeber (#2414)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2 years agoHBASE-24857:Fix several problems when starting webUI (#2245)
GeorryHuang [Sat, 19 Sep 2020 06:34:30 +0000 (14:34 +0800)] 
HBASE-24857:Fix several problems when starting webUI (#2245)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-25061 Update default URL to KEYS file in `hbase-vote.sh` (#2416)
Nick Dimiduk [Fri, 18 Sep 2020 20:20:44 +0000 (13:20 -0700)] 
HBASE-25061 Update default URL to KEYS file in `hbase-vote.sh` (#2416)

Co-authored-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-25054 Do not add non shaded protobuf as dependency in TableMapReduceUtil for...
Duo Zhang [Thu, 17 Sep 2020 06:55:36 +0000 (14:55 +0800)] 
HBASE-25054 Do not add non shaded protobuf as dependency in TableMapReduceUtil for master (#2412)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-25047 WAL split edits number is negative in RegionServerUI (#2408)
Joseph295 [Thu, 17 Sep 2020 01:38:28 +0000 (09:38 +0800)] 
HBASE-25047 WAL split edits number is negative in RegionServerUI (#2408)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-25021 Nightly job should skip hadoop-2 integration test for master (#2409)
Duo Zhang [Thu, 17 Sep 2020 00:48:11 +0000 (08:48 +0800)] 
HBASE-25021 Nightly job should skip hadoop-2 integration test for master (#2409)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-24528 : BalancerDecision queue implementation in HMaster with Admin API
Viraj Jasani [Wed, 16 Sep 2020 15:23:10 +0000 (20:53 +0530)] 
HBASE-24528 : BalancerDecision queue implementation in HMaster with Admin API

* Admin API getLogEntries() for ring buffer use-cases: so far, provides balancerDecision and slowLogResponse
* Refactor RPC call for similar use-cases
* Single RPC API getLogEntries() for both Master.proto and Admin.proto

Closes #2261

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2 years agoHBASE-25037 Lots of thread pool are changed to non daemon after HBASE-24750 which...
Duo Zhang [Wed, 16 Sep 2020 13:11:47 +0000 (21:11 +0800)] 
HBASE-25037 Lots of thread pool are changed to non daemon after HBASE-24750 which causes trouble when shutting down (#2407)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-25035 Add 2.2.6 to download page (#2405)
Guanghao Zhang [Wed, 16 Sep 2020 12:08:39 +0000 (20:08 +0800)] 
HBASE-25035 Add 2.2.6 to download page (#2405)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2 years agoHBASE-25012 HBASE-24359 causes replication missed log of some RemoteException (#2384)
XinSun [Wed, 16 Sep 2020 10:01:55 +0000 (18:01 +0800)] 
HBASE-25012 HBASE-24359 causes replication missed log of some RemoteException (#2384)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-24875 Remove the force param for unassign since it dose not take effect any...
bsglz [Wed, 16 Sep 2020 03:05:03 +0000 (11:05 +0800)] 
HBASE-24875 Remove the force param for unassign since it dose not take effect any more (#2254)

Signed-off-by: Sean Busbey <busbey@apache.org>
2 years agoHBASE-25009: Hbck chore logs wrong message when loading regions from RS (#2379)
Mohammad Arshad [Wed, 16 Sep 2020 01:08:04 +0000 (06:38 +0530)] 
HBASE-25009: Hbck chore logs wrong message when loading regions from RS (#2379)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-25014 ScheduledChore is never triggered when initalDelay > 1.5*period (#2395)
XinSun [Wed, 16 Sep 2020 01:00:21 +0000 (09:00 +0800)] 
HBASE-25014 ScheduledChore is never triggered when initalDelay > 1.5*period (#2395)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-24831 : Addendum for source compatibility
Viraj Jasani [Tue, 15 Sep 2020 14:40:50 +0000 (20:10 +0530)] 
HBASE-24831 : Addendum for source compatibility

Closes #2403

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2 years agoHBASE-25002 Create simple pattern matching query for retrieving metri… (#2370)
ramkrish86 [Mon, 14 Sep 2020 13:37:40 +0000 (19:07 +0530)] 
HBASE-25002 Create simple pattern matching query for retrieving metri… (#2370)

* HBASE-25002 Create simple pattern matching query for retrieving metrics matching the pattern

* Address review comments

* Final set of comments addressed

* Address checkstyle comments

2 years agoHBASE-25022 Remove 'hbase.testing.nocluster' config (#2394)
Duo Zhang [Mon, 14 Sep 2020 12:15:43 +0000 (20:15 +0800)] 
HBASE-25022 Remove 'hbase.testing.nocluster' config (#2394)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-24877 Add option to avoid aborting RS process upon uncaught exc… (#2255)
Wellington Ramos Chevreuil [Mon, 14 Sep 2020 10:13:14 +0000 (11:13 +0100)] 
HBASE-24877 Add option to avoid aborting RS process upon uncaught exc… (#2255)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2 years agoHBASE-25016 addendum: should also close the Table which is returned by calling getMet...
niuyulin [Mon, 14 Sep 2020 06:53:43 +0000 (12:23 +0530)] 
HBASE-25016 addendum: should also close the Table which is returned by calling getMetaHTable

Closes #2393

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-25018 EOM cleanup (#2391)
Sean Busbey [Sun, 13 Sep 2020 03:59:13 +0000 (22:59 -0500)] 
HBASE-25018 EOM cleanup (#2391)

* remove RM for 1.3
* remove EOM releases from hadoop matrix
* add 1.6 column to hadoop matrix that matches previous 1.5 column
* remove Hadoop rows from hadoop matrix that were only present for now EOM hbase release lines
* remove Hadoop notes that were about Hadoop versions that have been removed.
* update Java version table to only refer to maintained HBase release lines

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-25016 Should close ResultScanner in MetaTableAccessor.scanByRegionEncodedName
niuyulin [Sun, 13 Sep 2020 12:02:42 +0000 (17:32 +0530)] 
HBASE-25016 Should close ResultScanner in MetaTableAccessor.scanByRegionEncodedName

Closes #2390

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-25006 Make the cost functions optional for StochastoicBalancer
Clara Xiong [Sun, 13 Sep 2020 08:40:58 +0000 (14:10 +0530)] 
HBASE-25006 Make the cost functions optional for StochastoicBalancer

Closes #2386

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-25008 Add document for "HBASE-24776 [hbtop] Support Batch mode" (#2382)
Toshihiro Suzuki [Fri, 11 Sep 2020 06:38:13 +0000 (15:38 +0900)] 
HBASE-25008 Add document for "HBASE-24776 [hbtop] Support Batch mode" (#2382)

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-23643 Add document for "HBASE-23065 [hbtop] Top-N heavy hitter user and client...
Toshihiro Suzuki [Fri, 11 Sep 2020 06:37:48 +0000 (15:37 +0900)] 
HBASE-23643 Add document for "HBASE-23065 [hbtop] Top-N heavy hitter user and client drill downs" (#2381)

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24764: Add support of adding default peer configs via hbase-site.xml for all...
ankitjain64 [Thu, 10 Sep 2020 17:08:44 +0000 (10:08 -0700)] 
HBASE-24764: Add support of adding default peer configs via hbase-site.xml for all replication peers. (#2284)

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2 years agoHBASE-24958 CompactingMemStore.timeOfOldestEdit error update (#2321)
WenFeiYi [Thu, 10 Sep 2020 16:46:04 +0000 (00:46 +0800)] 
HBASE-24958 CompactingMemStore.timeOfOldestEdit error update (#2321)

2 years agoHBASE-25004 : Log RegionTooBusyException details (#2371)
Viraj Jasani [Thu, 10 Sep 2020 15:52:37 +0000 (21:22 +0530)] 
HBASE-25004 : Log RegionTooBusyException details (#2371)

Signed-off-by: mnpoonia <apoonia@salesforce.com>
Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24776 [hbtop] Support Batch mode (#2291)
Toshihiro Suzuki [Thu, 10 Sep 2020 08:04:57 +0000 (17:04 +0900)] 
HBASE-24776 [hbtop] Support Batch mode (#2291)

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24990 Fix empty value of properties 'hbase.replication.source.maxthreads' in...
Qi Yu [Thu, 10 Sep 2020 04:38:25 +0000 (12:38 +0800)] 
HBASE-24990 Fix empty value of properties 'hbase.replication.source.maxthreads' in hbase-thrift module (#2356)

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-25005 Refactor CatalogJanitor (#2373)
Duo Zhang [Thu, 10 Sep 2020 03:59:15 +0000 (11:59 +0800)] 
HBASE-25005 Refactor CatalogJanitor (#2373)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-24974: Provide a flexibility to print only row key and filter for multiple...
Sandeep Pal [Wed, 9 Sep 2020 17:16:45 +0000 (10:16 -0700)] 
HBASE-24974: Provide a flexibility to print only row key and filter for multiple tables in the WALPrettyPrinter (#2345)

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2 years agoHBASE-25000 Move delete region info related methods to RegionStateStore (#2366)
Duo Zhang [Wed, 9 Sep 2020 15:11:28 +0000 (23:11 +0800)] 
HBASE-25000 Move delete region info related methods to RegionStateStore (#2366)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-24993 Remove OfflineMetaRebuildTestCore (#2359)
niuyulin [Wed, 9 Sep 2020 01:47:15 +0000 (09:47 +0800)] 
HBASE-24993 Remove OfflineMetaRebuildTestCore (#2359)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-24994 Add hedgedReadOpsInCurThread metric (#2365)
Javier Akira Luca de Tena [Wed, 9 Sep 2020 01:45:46 +0000 (10:45 +0900)] 
HBASE-24994 Add hedgedReadOpsInCurThread metric (#2365)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-24995: MetaFixer fails to fix overlaps when multiple tables have overlaps ...
Mohammad Arshad [Tue, 8 Sep 2020 19:00:44 +0000 (00:30 +0530)] 
HBASE-24995: MetaFixer fails to fix overlaps when multiple tables have overlaps (#2361)

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24979 : Client operation timeout test for batch requests
Viraj Jasani [Tue, 8 Sep 2020 12:17:08 +0000 (17:47 +0530)] 
HBASE-24979 : Client operation timeout test for batch requests

Closes #2347

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-24602 Add Increment and Append support to CheckAndMutate (#2228)
Toshihiro Suzuki [Tue, 8 Sep 2020 06:05:47 +0000 (15:05 +0900)] 
HBASE-24602 Add Increment and Append support to CheckAndMutate (#2228)

2 years agoHBASE-24992 log after Generator success when running ITBLL (#2358)
Joseph295 [Tue, 8 Sep 2020 03:46:59 +0000 (11:46 +0800)] 
HBASE-24992 log after Generator success when running ITBLL (#2358)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-24986 Move ReplicationBarrier related methods to a separated class (#2354)
Duo Zhang [Mon, 7 Sep 2020 12:35:27 +0000 (20:35 +0800)] 
HBASE-24986 Move ReplicationBarrier related methods to a separated class (#2354)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-24937 table.rb use LocalDateTime to replace Instant (#2351)
Bo Cui [Fri, 4 Sep 2020 14:50:39 +0000 (22:50 +0800)] 
HBASE-24937 table.rb use LocalDateTime to replace Instant (#2351)

Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2 years agoHBASE-24980 Fix dead links in HBase book (#2349)
neko [Fri, 4 Sep 2020 00:25:27 +0000 (08:25 +0800)] 
HBASE-24980 Fix dead links in HBase book (#2349)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-24759 Refuse to update configuration of default group (#2126)
XinSun [Fri, 4 Sep 2020 00:19:39 +0000 (08:19 +0800)] 
HBASE-24759 Refuse to update configuration of default group (#2126)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years ago HBASE-19352 Port HADOOP-10379: Protect authentication cookies with the HttpOnly...
Esteban Gutierrez [Thu, 3 Sep 2020 18:20:44 +0000 (13:20 -0500)] 
HBASE-19352 Port HADOOP-10379: Protect authentication cookies with the HttpOnly and Secure flags (#2348)

HBASE-19352 Port HADOOP-10379: Protect authentication cookies with the HttpOnly and Secure flags

Signed-off-by: Sean Busbey <busbey@apache.org>
2 years agoHBASE-24940: runCatalogJanitor() API should return -1 to indicate already running...
Mohammad Arshad [Thu, 3 Sep 2020 10:16:10 +0000 (15:46 +0530)] 
HBASE-24940: runCatalogJanitor() API should return -1 to indicate already running status

Closes #2331

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24973 Remove read point parameter in method StoreFlush#performFlush and StoreFl...
Qi Yu [Wed, 2 Sep 2020 09:43:26 +0000 (17:43 +0800)] 
HBASE-24973 Remove read point parameter in method StoreFlush#performFlush and StoreFlush#createScanner (#2337)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24831 Avoid invoke Counter using reflection in SnapshotInputFormat (#2209)
Yechao Chen [Wed, 2 Sep 2020 08:22:44 +0000 (16:22 +0800)] 
HBASE-24831 Avoid invoke Counter using reflection in SnapshotInputFormat (#2209)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-24964 addendum fix TestMetaTableMetrics (#2340)
Duo Zhang [Wed, 2 Sep 2020 02:10:36 +0000 (10:10 +0800)] 
HBASE-24964 addendum fix TestMetaTableMetrics (#2340)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24971 Upgrade JQuery to 3.5.1 (#2336)
Andrew Purtell [Tue, 1 Sep 2020 17:39:12 +0000 (10:39 -0700)] 
HBASE-24971 Upgrade JQuery to 3.5.1 (#2336)

- Update embedded minimized jquery to 3.5.1
- Update embedded minimized jquery.tablesorter to 2.31.3

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24569 Get hostAndWeights in addition using localhost if it is null in local...
Zheng Wang [Tue, 1 Sep 2020 10:21:33 +0000 (15:51 +0530)] 
HBASE-24569 Get hostAndWeights in addition using localhost if it is null in local mode

Closes #1909

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24809 Fix broken Apache Yetus documentation links
Abhey [Mon, 31 Aug 2020 15:22:52 +0000 (20:52 +0530)] 
HBASE-24809 Fix broken Apache Yetus documentation links

Closes #2335

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24913 Refactor TestJMXConnectorServer (#2286)
XinSun [Mon, 31 Aug 2020 02:23:59 +0000 (10:23 +0800)] 
HBASE-24913 Refactor TestJMXConnectorServer (#2286)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-24916: Region hole contains wrong regions pair when hole is cre… (#2304)
Mohammad Arshad [Sun, 30 Aug 2020 17:04:40 +0000 (22:34 +0530)] 
HBASE-24916: Region hole contains wrong regions pair when hole is cre… (#2304)

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24968 : Move META_COMPARATOR to subclass MetaCellComparator
Viraj Jasani [Sun, 30 Aug 2020 16:29:41 +0000 (21:59 +0530)] 
HBASE-24968 : Move META_COMPARATOR to subclass MetaCellComparator

* Break subclass referencing of MetaCellComparator from superclass CellComparatorImpl
  static initializer by moving META_COMPARATOR to subclass MetaCellComparator

Closes #2329

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-24894 [Flakey Test] TestStochasticLoadBalancer.testMoveCostMultiplier
Zheng Wang [Sun, 30 Aug 2020 14:38:28 +0000 (20:08 +0530)] 
HBASE-24894 [Flakey Test] TestStochasticLoadBalancer.testMoveCostMultiplier

Closes #2270

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24964 Remove MetaTableAccessor.tableExists (#2330)
Duo Zhang [Sun, 30 Aug 2020 09:31:26 +0000 (17:31 +0800)] 
HBASE-24964 Remove MetaTableAccessor.tableExists (#2330)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24949 Optimize FSTableDescriptors.get to not always go to fs when cache miss...
Duo Zhang [Sat, 29 Aug 2020 14:26:36 +0000 (22:26 +0800)] 
HBASE-24949 Optimize FSTableDescriptors.get to not always go to fs when cache miss (#2317)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-24760 Add a config hbase.rsgroup.fallback.enable for RSGroup fallback feature...
XinSun [Fri, 28 Aug 2020 08:52:45 +0000 (16:52 +0800)] 
HBASE-24760 Add a config hbase.rsgroup.fallback.enable for RSGroup fallback feature (#2149)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-24898 Addendum to deal with Daylight Saving Time (#2310)
bsglz [Thu, 27 Aug 2020 03:17:23 +0000 (11:17 +0800)] 
HBASE-24898 Addendum to deal with Daylight Saving Time (#2310)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-24892 config 'hbase.hregion.memstore.mslab.indexchunksize' not be used (#2265)
WenFeiYi [Thu, 27 Aug 2020 00:24:40 +0000 (08:24 +0800)] 
HBASE-24892 config 'hbase.hregion.memstore.mslab.indexchunksize' not be used (#2265)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-24765: Dynamic master discovery (#2130)
Bharath Vissapragada [Tue, 25 Aug 2020 22:09:03 +0000 (15:09 -0700)] 
HBASE-24765: Dynamic master discovery (#2130)

This patch adds the ability to discover newly added masters
dynamically on the master registry side. The trigger for the
re-fetch is either periodic (5 mins) or any registry RPC failure.
Master server information is cached in masters to avoid repeated
ZK lookups.

Updates the client side connection metrics to maintain a counter
per RPC type so that clients have visibility into counts grouped
by RPC method name.

I didn't add the method to ZK registry interface since there
is a design discussion going on in splittable meta doc. We can
add it later if needed.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-14847 Add FIFO compaction section to HBase book
ethanhur [Tue, 25 Aug 2020 13:15:21 +0000 (18:45 +0530)] 
HBASE-14847 Add FIFO compaction section to HBase book

Closes #2298

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24945 Remove MetaTableAccessor.getRegionCount (#2303)
Duo Zhang [Tue, 25 Aug 2020 13:15:22 +0000 (21:15 +0800)] 
HBASE-24945 Remove MetaTableAccessor.getRegionCount (#2303)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24944 Remove MetaTableAccessor.getTableRegionsAndLocations in hbase-rest module...
Duo Zhang [Tue, 25 Aug 2020 08:18:42 +0000 (16:18 +0800)] 
HBASE-24944 Remove MetaTableAccessor.getTableRegionsAndLocations in hbase-rest module (#2302)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-24942 MergeTableRegionsProcedure should not call clean merge region (#2301)
Duo Zhang [Tue, 25 Aug 2020 04:19:19 +0000 (12:19 +0800)] 
HBASE-24942 MergeTableRegionsProcedure should not call clean merge region (#2301)

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-23834 HBase fails to run on Hadoop 3.3.0/3.2.2/3.1.4 due to jetty version misma...
Duo Zhang [Tue, 25 Aug 2020 04:05:52 +0000 (12:05 +0800)] 
HBASE-23834 HBase fails to run on Hadoop 3.3.0/3.2.2/3.1.4 due to jetty version mismatch (#2222)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2 years agoHBASE-24885 STUCK RIT by hbck2 assigns (#2283)
Michael Stack [Mon, 24 Aug 2020 16:19:43 +0000 (09:19 -0700)] 
HBASE-24885 STUCK RIT by hbck2 assigns (#2283)

Adds region state check on hbck2 assigns/unassigns. Returns pid of -1
if in inappropriate state with logging explaination which suggests
passing override if operator wants to assign/unassign anyways. Here
is an example of what happens now if hbck2 tries an unassign and
Region already unassigned:

  2020-08-19 11:22:06,926 INFO  [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=50086] assignment.AssignmentManager(820): Failed {ENCODED => d1112e553991e938b6852f87774c91ee, NAME => 'TestHbck,zzzzz,1597861310769.d1112e553991e938b6852f87774c91ee.', STARTKEY => 'zzzzz', ENDKEY => ''} unassign, override=false; set override to by-pass state checks.
  org.apache.hadoop.hbase.client.DoNotRetryRegionException: Unexpected state for state=CLOSED, location=null, table=TestHbck, region=d1112e553991e938b6852f87774c91ee
          at org.apache.hadoop.hbase.master.assignment.AssignmentManager.preTransitCheck(AssignmentManager.java:583)
          at org.apache.hadoop.hbase.master.assignment.AssignmentManager.createOneUnassignProcedure(AssignmentManager.java:812)
          at org.apache.hadoop.hbase.master.MasterRpcServices.unassigns(MasterRpcServices.java:2616)
          at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$HbckService$2.callBlockingMethod(MasterProtos.java)
          at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:397)
          at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:133)
          at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:338)
          at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:318)

Previous it would just create the unassign anyways. Now must pass override
to queue the procedure regardless. Safer.

hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java
 javadoc on assigns/unassigns. Minor refactor in assigns/unassigns to cater to
 case where procedure may come back null (if override not set and fails state checks).

hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
 checkstyle cleanups.
 Clarifying javadoc on how there is no state checking when bulk assigns creating/enabling
 tables.

 createOneAssignProcedure and createOneUnassignProcedure now handle exceptions which now
 can be thrown if no override and region state is not appropriate.

 Aggregation of createAssignProcedure and createUnassignProcedure instances adding in
 region state check invoked if override is NOT set.

hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionStateNode.java
 Change to setProcedure so it returns passed proc as result instead of void

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-24871 Replication may loss data when refresh recovered replication sources...
XinSun [Mon, 24 Aug 2020 13:43:15 +0000 (21:43 +0800)] 
HBASE-24871 Replication may loss data when refresh recovered replication sources (#2249)

Signed-off-by: huaxiangsun <huaxiangsun@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-24928 balanceRSGroup should skip generating balance plan for disabled table...
niuyulin [Mon, 24 Aug 2020 03:52:21 +0000 (22:52 -0500)] 
HBASE-24928 balanceRSGroup should skip generating balance plan for disabled table and splitParent region (#2292)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-24935 Remove 1.3.6 from download page (#2295)
Duo Zhang [Mon, 24 Aug 2020 03:18:08 +0000 (11:18 +0800)] 
HBASE-24935 Remove 1.3.6 from download page (#2295)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24811 Use class access static field or method (#2189)
Yechao Chen [Sun, 23 Aug 2020 03:24:44 +0000 (11:24 +0800)] 
HBASE-24811 Use class access static field or method (#2189)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2 years agoHBASE-24898 Use EnvironmentEdge.currentTime() instead of System.currentTimeMillis...
Zheng Wang [Sat, 22 Aug 2020 09:55:33 +0000 (15:25 +0530)] 
HBASE-24898 Use EnvironmentEdge.currentTime() instead of System.currentTimeMillis() in CurrentHourProvider

Closes #2272

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24890 The command regioninfo is not available (#2263)
bsglz [Sat, 22 Aug 2020 03:47:03 +0000 (11:47 +0800)] 
HBASE-24890 The command regioninfo is not available (#2263)

* HBASE-24890 The command regioninfo is not available

* add ut for command regioninfo

2 years agoHBASE-24915 Improve BlockCache read performance by specifying BlockType (#2288)
1996fanrui [Fri, 21 Aug 2020 16:31:39 +0000 (00:31 +0800)] 
HBASE-24915 Improve BlockCache read performance by specifying BlockType (#2288)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24918 Make RegionInfo#UNDEFINED IA.Private (#2289)
Michael Stack [Fri, 21 Aug 2020 16:25:24 +0000 (09:25 -0700)] 
HBASE-24918 Make RegionInfo#UNDEFINED IA.Private (#2289)

Mark RegionInfo#UNDEFINED IA.Private and deprecated;
it is for internal use only and likely to be removed in hbase4.

Move MutableRegionInfo out of RegionInfoBuilder and have it as a
stanadlone task; a nice-to-have.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-24926 Should call setFailure in MergeTableRegionsProcedure when isMergeable...
Duo Zhang [Fri, 21 Aug 2020 14:01:33 +0000 (22:01 +0800)] 
HBASE-24926 Should call setFailure in MergeTableRegionsProcedure when isMergeable returns false (#2290)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24686 [LOG] Log improvement in Connection#close (#2219)
mokai [Fri, 21 Aug 2020 13:19:02 +0000 (21:19 +0800)] 
HBASE-24686 [LOG] Log improvement in Connection#close (#2219)

Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2 years agoHBASE-24912 Enlarge MemstoreFlusherChore/CompactionChecker period for unit test ...
Guanghao Zhang [Fri, 21 Aug 2020 04:41:20 +0000 (12:41 +0800)] 
HBASE-24912 Enlarge MemstoreFlusherChore/CompactionChecker period for unit test (#2285)

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24914 Remove duplicate code appearing continuously in method ReplicationPeerMan...
XinSun [Thu, 20 Aug 2020 21:44:56 +0000 (05:44 +0800)] 
HBASE-24914 Remove duplicate code appearing continuously in method ReplicationPeerManager.updatePeerConfig (#2287)

Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2 years agoHBASE-24867 Add 2.3.1 to the downloads page
Nick Dimiduk [Wed, 19 Aug 2020 18:33:30 +0000 (11:33 -0700)] 
HBASE-24867 Add 2.3.1 to the downloads page

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-24884 BulkLoadHFilesTool/LoadIncrementalHFiles should accept -D options from...
Toshihiro Suzuki [Wed, 19 Aug 2020 04:36:17 +0000 (13:36 +0900)] 
HBASE-24884 BulkLoadHFilesTool/LoadIncrementalHFiles should accept -D options from command line parameters (#2260)

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2 years agoHBASE-24799 Do not call make_binary_release for hbase-thirdparty in release scripts...
Duo Zhang [Wed, 19 Aug 2020 03:28:33 +0000 (11:28 +0800)] 
HBASE-24799 Do not call make_binary_release for hbase-thirdparty in release scripts (#2177)

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2 years agoHBASE-24886 Remove deprecated methods in RowMutations (#2267)
niuyulin [Wed, 19 Aug 2020 02:31:09 +0000 (21:31 -0500)] 
HBASE-24886 Remove deprecated methods in RowMutations (#2267)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-24806 Small Updates to Functionality of Shell IRB Workspace (#2232)
Elliot [Tue, 18 Aug 2020 20:14:34 +0000 (16:14 -0400)] 
HBASE-24806 Small Updates to Functionality of Shell IRB Workspace (#2232)

* HBASE-24806 Small Updates to Functionality of Shell IRB Workspace

- Move exception handler from Shell::Shell#eval_io to new method,
  Shell::Shell#exception_handler
- Add unit tests for Shell::Shell#exception_handler
- Change Shell::Shell#eval_io to no longer raise SystemExit when any error is
  seen and update unit test
- Update ruby test runner to catch SystemExit and fail to avoid tests that
  cause the test runner to incorrectly exit successfully
- Add Hbase::Loader module to find ruby scripts in the $LOAD_PATH and classpath
  using JRuby's loader.
- In hbase-shell, install IRB commands before exporting HBase commands. The
  HBase commands will override the IRB commands, and no warning will be
  printed.

* Remove unused variables from shell_test

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24874 Fix hbase-shell access to ModifiableTableDescriptor methods (#2268)
Elliot [Tue, 18 Aug 2020 19:58:40 +0000 (15:58 -0400)] 
HBASE-24874 Fix hbase-shell access to ModifiableTableDescriptor methods (#2268)

* HBASE-24874 Fix hbase-shell access to ModifiableTableDescriptor methods

- Fix hbase-shell access in JDK 11 for calls to
  TableDescriptorBuilder.toCoprocessorDescriptor and
  ModifiableTableDescriptor.toStringTableAttributes.
- Allow coprocessors to be specified using a Ruby hash in the hbase-shell alter
  command and replace usage in the help text. The previous String overload of
  the alter command will continue to work and is still covered by a unit test,
  but will no longer be suggested in the alter command help.

* Update patch

- Add warning over toCoprocessorDescriptor noting the usage by hbase-shell
- Add constants to hbase_constants for coprocessor specification
- Document usage of ModifiableTableDescriptor.toStringTableAttributes

* Convert comment over toCoprocessorDescriptor into docstring

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24627 Normalize one table at a time
Nick Dimiduk [Fri, 7 Aug 2020 02:07:46 +0000 (19:07 -0700)] 
HBASE-24627 Normalize one table at a time

Introduce an additional method to our Admin interface that allow an
operator to selectivly run the normalizer. The IPC protocol supports
general table name select via compound filter.

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24872 refactor valueOf PoolType (#2250)
niuyulin [Tue, 18 Aug 2020 16:35:18 +0000 (11:35 -0500)] 
HBASE-24872 refactor valueOf PoolType (#2250)

Signed-off-by: Huaxiang Sun <huaxiangsun@apache.com>
2 years agoHBASE-24880 Remove ReplicationPeerConfigUpgrader
niuyulin [Mon, 17 Aug 2020 13:44:00 +0000 (19:14 +0530)] 
HBASE-24880 Remove ReplicationPeerConfigUpgrader

Closes #2266

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24887 Remove Row.compareTo
Joseph295 [Mon, 17 Aug 2020 11:49:17 +0000 (17:19 +0530)] 
HBASE-24887 Remove Row.compareTo

Closes #2262

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>