hbase.git
2 years agoHBASE-24197 TestHttpServer.testBindAddress failure with latest jetty (#1524)
Istvan Toth [Thu, 16 Apr 2020 09:51:59 +0000 (11:51 +0200)] 
HBASE-24197 TestHttpServer.testBindAddress failure with latest jetty (#1524)

use the findPort logic even if the BindException is wrapped in an IOException

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2 years agoHBASE-24175 [Flakey Tests] TestSecureExportSnapshot FileNotFoundException
stack [Thu, 16 Apr 2020 05:42:09 +0000 (22:42 -0700)] 
HBASE-24175 [Flakey Tests] TestSecureExportSnapshot FileNotFoundException
Addendum #2: The new test fails on origin.hbase.dir written by HTU up on
jenkins... has a 'tmp' in it. Fix.

2 years agoHBASE-24175 [Flakey Tests] TestSecureExportSnapshot FileNotFoundException
stack [Wed, 15 Apr 2020 17:37:55 +0000 (10:37 -0700)] 
HBASE-24175 [Flakey Tests] TestSecureExportSnapshot FileNotFoundException
Addendum: add test to check for '/tmp' references.

2 years agoHBASE-23697 Document new RegionProcedureStore operation and migration
stack [Tue, 14 Apr 2020 23:33:57 +0000 (16:33 -0700)] 
HBASE-23697 Document new RegionProcedureStore operation and migration

2 years agoHBASE-24183 [flakey test] replication.TestAddToSerialReplicationPeer (#1514)
huaxiangsun [Wed, 15 Apr 2020 17:07:57 +0000 (10:07 -0700)] 
HBASE-24183 [flakey test] replication.TestAddToSerialReplicationPeer (#1514)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-23994: Add WebUI to Canary (#1292)
GeorryHuang [Tue, 14 Apr 2020 22:52:22 +0000 (06:52 +0800)] 
HBASE-23994: Add WebUI to Canary (#1292)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2 years agoRevert "HBASE-23994:Add WebUI to Canary (#1292)"
Nick Dimiduk [Tue, 14 Apr 2020 22:55:56 +0000 (15:55 -0700)] 
Revert "HBASE-23994:Add WebUI to Canary (#1292)"

This reverts commit daf79de329c49e2ea9fc6e01bd0995a8a75dd9a9.

2 years agoHBASE-23994:Add WebUI to Canary (#1292)
GeorryHuang [Tue, 14 Apr 2020 22:52:22 +0000 (06:52 +0800)] 
HBASE-23994:Add WebUI to Canary (#1292)

HBASE-23994: Add WebUI to Canary

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2 years agoHBASE-24180 Edit test doc around forkcount and speeding up test runs (#1505)
stack [Tue, 14 Apr 2020 17:47:05 +0000 (10:47 -0700)] 
HBASE-24180 Edit test doc around forkcount and speeding up test runs (#1505)

Addendum: some edits.

2 years agoHBASE-24180 Edit test doc around forkcount and speeding up test runs (#1505)
Michael Stack [Tue, 14 Apr 2020 17:23:53 +0000 (10:23 -0700)] 
HBASE-24180 Edit test doc around forkcount and speeding up test runs (#1505)

Signed-off-by: Jan Hentschel <janh@apache.org>
2 years agoHBASE-24181 Add region info when log meessages in HRegion. (#1506)
binlijin [Tue, 14 Apr 2020 11:36:16 +0000 (19:36 +0800)] 
HBASE-24181 Add region info when log meessages in HRegion. (#1506)

Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2 years agoHBASE-24134 Down forked JVM heap size from 2800m to 2200m for jdk8 and jdk11 (#1451...
Michael Stack [Tue, 14 Apr 2020 04:35:43 +0000 (21:35 -0700)] 
HBASE-24134 Down forked JVM heap size from 2800m to 2200m for jdk8 and jdk11 (#1451) (#1503)

Down jdk8 forked jvm heap from 2800 to 2200 and the jdk11 heap from
3200 to 2200. Down the mvn size from 4G to 3.6G

Change how many puts done by TestMultiRespectsLimits because made
the test run the forked heap over 2.5G in size.

Signed-off-by: Sean Busbey <busbey@apache.org>
2 years agoHBASE-24176 user_permission '.*' command failed to show all table permissions (#1499)
EEPROM [Tue, 14 Apr 2020 02:14:21 +0000 (10:14 +0800)] 
HBASE-24176 user_permission '.*' command failed to show all table permissions (#1499)

* user_permission failed when show table permissions with '.*' argument

Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
2 years agoHBASE-24126 Up the container nproc uplimit from 10000 to 12500 (#1504)
Michael Stack [Mon, 13 Apr 2020 21:59:16 +0000 (14:59 -0700)] 
HBASE-24126 Up the container nproc uplimit from 10000 to 12500 (#1504)

2 years agoHBASE-24132 Upgrade to Apache ZooKeeper 3.5.7 (#1453)
Jianfei Jiang [Mon, 13 Apr 2020 20:46:37 +0000 (04:46 +0800)] 
HBASE-24132 Upgrade to Apache ZooKeeper 3.5.7 (#1453)

* HBASE-24132 Upgrade to Apache ZooKeeper 3.5.7

* HBASE-24132 Upgrade to Apache ZooKeeper 3.5.7

Co-authored-by: 姜建飞 10222269 <jiang.jianfei@zte.com.cn>
Signed-off-by: Mate Szalay-Beko <szalay.beko.mate@gmail.com>
Signed-off-by: Norbert Kalmar <nkalmar@cloudera.com>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangdo@apache.org>
2 years agoHBASE-24150 Allow module tests run in parallel (#1464)
Michael Stack [Thu, 9 Apr 2020 21:41:41 +0000 (14:41 -0700)] 
HBASE-24150 Allow module tests run in parallel (#1464)

Pass --threads=2 to mvn when yetus runs so some parallelism
when dependencies allow.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24158 [Flakey Tests] TestAsyncTableGetMultiThreaded
stack [Thu, 9 Apr 2020 18:03:22 +0000 (11:03 -0700)] 
HBASE-24158 [Flakey Tests] TestAsyncTableGetMultiThreaded

2 years agoHBASE-24167 [Flakey Tests] TestHRegionWithInMemoryFlush#testWritesWhileScanning gets...
stack [Sat, 11 Apr 2020 01:30:08 +0000 (18:30 -0700)] 
HBASE-24167 [Flakey Tests] TestHRegionWithInMemoryFlush#testWritesWhileScanning gets stuck MVCC

2 years agoHBASE-24175 [Flakey Tests] TestSecureExportSnapshot FileNotFoundException
stack [Sun, 12 Apr 2020 04:23:17 +0000 (21:23 -0700)] 
HBASE-24175 [Flakey Tests] TestSecureExportSnapshot FileNotFoundException
Overwrite yarn configs that write /tmp dir by default.

2 years agoHBASE-24112 [RSGroup] Support renaming rsgroup (#1435)
Reid Chan [Mon, 13 Apr 2020 06:04:32 +0000 (14:04 +0800)] 
HBASE-24112 [RSGroup] Support renaming rsgroup (#1435)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-24153 Revert "Revert "Remove unnecessary super() in MultiVersionConcurrencyCont...
stack [Mon, 13 Apr 2020 01:30:38 +0000 (18:30 -0700)] 
HBASE-24153 Revert "Revert "Remove unnecessary super() in MultiVersionConcurrencyControl#MultiVersionConcurrencyControl() (#1468)""
A revert of a revert; i.e. a reapplication to add missing JIRA number

This reverts commit c4026d1bebf2d7cfdb0c3e618b56aed5c5ac672d.

2 years agoRevert "Remove unnecessary super() in MultiVersionConcurrencyControl#MultiVersionConc...
stack [Mon, 13 Apr 2020 01:30:11 +0000 (18:30 -0700)] 
Revert "Remove unnecessary super() in MultiVersionConcurrencyControl#MultiVersionConcurrencyControl() (#1468)"
Forgot to add JIRA number. Reverting to add.

This reverts commit 12a0c1d5fef5479b77ae88dce2197903348f2ac5.

2 years agoRevert "HBASE-24126 Up the container nproc uplimit from 10000 to 12500 (#1450)"
stack [Fri, 10 Apr 2020 23:05:07 +0000 (16:05 -0700)] 
Revert "HBASE-24126 Up the container nproc uplimit from 10000 to 12500 (#1450)"

This reverts commit 14342b6527a3855fd544b6028c0d7539e8e74305.

2 years agoHBASE-24140 : Move CandidateGenerator and their implementors out of StochasticLoadBal...
Viraj Jasani [Sun, 12 Apr 2020 13:43:47 +0000 (19:13 +0530)] 
HBASE-24140 : Move CandidateGenerator and their implementors out of StochasticLoadBalancer (#1458)

Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2 years agoHBASE-23998 Addendum Add sign-offs
Wei-Chiu Chuang [Sun, 12 Apr 2020 08:45:24 +0000 (01:45 -0700)] 
HBASE-23998 Addendum Add sign-offs

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-23998. Update license for jetty-client. (#1297)
Wei-Chiu Chuang [Sun, 12 Apr 2020 08:45:24 +0000 (01:45 -0700)] 
HBASE-23998. Update license for jetty-client. (#1297)

(cherry picked from commit 5be67a5e60182f5f06c7a84dbae6fb365f28682b)

2 years agoHBASE-24126 Up the container nproc uplimit from 10000 to 12500 (#1450)
Michael Stack [Fri, 10 Apr 2020 22:57:47 +0000 (15:57 -0700)] 
HBASE-24126 Up the container nproc uplimit from 10000 to 12500 (#1450)

Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2 years agoRemove unnecessary super() in MultiVersionConcurrencyControl#MultiVersionConcurrencyC...
leosunli [Fri, 10 Apr 2020 22:43:10 +0000 (06:43 +0800)] 
Remove unnecessary super() in MultiVersionConcurrencyControl#MultiVersionConcurrencyControl() (#1468)

Signed-off-by: sunlisheng <lisheng.sun08@gmail.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24160 create-release fails to process x.y.0 version info correctly
Nick Dimiduk [Thu, 9 Apr 2020 22:04:51 +0000 (15:04 -0700)] 
HBASE-24160 create-release fails to process x.y.0 version info correctly

Current code gives me the following; notice default values generated
for `RELEASE_VERSION` and `api_diff_tag`.

```
GIT_BRANCH [branch-2.3]:
Current branch VERSION is 2.3.0-SNAPSHOT.
RELEASE_VERSION [2.3.-1]: 2.3.0
NEXT_VERSION [2.3.0-SNAPSHOT]: 2.3.1-SNAPSHOT
RC_COUNT [0]:
GIT_REF [2.3.0RC0]:
api_diff_tag, [rel/2.2.0)]:
```

With this patch I get

```
GIT_BRANCH [branch-2.3]:
Current branch VERSION is 2.3.0-SNAPSHOT.
RELEASE_VERSION [2.3.0]:
NEXT_VERSION [2.3.1-SNAPSHOT]:
RC_COUNT [0]:
GIT_REF [2.3.0RC0]:
api_diff_tag, [rel/2.2.0]:
```

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2 years agoHBASE-24163 MOB compactor implementations should use format specifiers when calling...
Sean Busbey [Fri, 10 Apr 2020 16:00:53 +0000 (11:00 -0500)] 
HBASE-24163 MOB compactor implementations should use format specifiers when calling String.format (#1479)

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2 years agoHBASE-24161 [flakey test] locking.TestEntityLocks.testEntityLockTimeout (#1477)
huaxiangsun [Fri, 10 Apr 2020 04:13:06 +0000 (21:13 -0700)] 
HBASE-24161 [flakey test] locking.TestEntityLocks.testEntityLockTimeout (#1477)

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24074 ConcurrentModificationException occured in ReplicationSourceManager while...
Pankaj [Thu, 9 Apr 2020 23:40:15 +0000 (05:10 +0530)] 
HBASE-24074 ConcurrentModificationException occured in ReplicationSourceManager while refreshing the peer (#1471)

Signed-off-by: Huaxiang Sun <huaxiangsun@apache.com>
Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24159 [flakey test] regionserver.TestRegionMergeTransactionOnCluster (#1472)
huaxiangsun [Thu, 9 Apr 2020 23:27:19 +0000 (16:27 -0700)] 
HBASE-24159 [flakey test] regionserver.TestRegionMergeTransactionOnCluster (#1472)

Delete tables after each test cases to avoid polluting states.

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24136 Add release branch report to git-jira-release-audit tool
Nick Dimiduk [Wed, 8 Apr 2020 23:04:40 +0000 (16:04 -0700)] 
HBASE-24136 Add release branch report to git-jira-release-audit tool

* enhancements to git_jira_release_audit.py
  * add aforementioned release branch report
  * include default values in help doc output
  * swap default db to a file on disk instead of in memory
  * set logger to match file name
  * add separate sql query log at DEBUG level
* more detailed usage info in README.md, including example audit query
* update entries in fallback_actions.csv

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2 years agoHBASE-24121 [Authorization] ServiceAuthorizationManager isn't dynamically updatable...
Reid Chan [Thu, 9 Apr 2020 08:28:22 +0000 (16:28 +0800)] 
HBASE-24121 [Authorization] ServiceAuthorizationManager isn't dynamically updatable. And it should be (#1439)

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2 years agoHBASE-24131 : TestExportSnapshot.testExportFileSystemState() changes with correct...
Viraj Jasani [Thu, 9 Apr 2020 05:00:02 +0000 (10:30 +0530)] 
HBASE-24131 : TestExportSnapshot.testExportFileSystemState() changes with correct arg (ADDENDUM)

2 years agoHBASE-23723 Ensure MOB compaction works in optimized mode after snapshot clone (...
Sean Busbey [Wed, 8 Apr 2020 19:16:43 +0000 (14:16 -0500)] 
HBASE-23723 Ensure MOB compaction works in optimized mode after snapshot clone (#1446)

* Reorganize MOB compaction tests for more reuse.
* Add tests for mob compaction after snapshot clone operations
* note the original table used to write a given mob hfile and use that to find it later.

Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2 years agoHBASE-24138 log more details about balancer decisions for StochasticLoadBalancer...
Sean Busbey [Wed, 8 Apr 2020 19:03:33 +0000 (14:03 -0500)] 
HBASE-24138 log more details about balancer decisions for StochasticLoadBalancer (#1455)

- at DEBUG log messages about RegionCountSkewCostFunction region/server totals
- at DEBUG log messages about the decision to balance or not with total costs
- at TRACE log messages about region count on each server RegionCountSkewCostFunction sees
- at TRACE log message with the individual cost functions used in the decision to balance or not

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24099 Use a fair ReentrantReadWriteLock for the region close lock (#1407)
Andrew Purtell [Wed, 8 Apr 2020 18:36:48 +0000 (11:36 -0700)] 
HBASE-24099 Use a fair ReentrantReadWriteLock for the region close lock (#1407)

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2 years agoHBASE-23833. The relocated hadoop-thirdparty protobuf breaks HBase asyncwal (#1301)
Wei-Chiu Chuang [Wed, 8 Apr 2020 18:31:51 +0000 (11:31 -0700)] 
HBASE-23833. The relocated hadoop-thirdparty protobuf breaks HBase asyncwal  (#1301)

* Use Reflection to access shaded Hadoop protobuf classes.

(cherry picked from commit a321e536989083ca3620bf2c53f12c07740bf5b0)

* Update to improve the code:

1. Added license.
2. Added more comments.
3. Wrap byte array instead of copy to make a ByteString.
4. Moved all reflection instantiation to static class loading time.

* Use LiteralByteString to wrap byte array instead of copying it.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24131 [Flakey Tests] TestExportSnapshot takes too long; up against 13min max...
Michael Stack [Wed, 8 Apr 2020 17:57:18 +0000 (10:57 -0700)] 
HBASE-24131 [Flakey Tests] TestExportSnapshot takes too long; up against 13min max (#1452)

Split TestExportSnapshot and TestVerifyReplication to two smaller tests
rather than one big one that can take 13minutes+ when contention.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2 years agoHBASE-24120 Flakey Test: TestReplicationAdminWithClusters timeout (#1441)
huaxiangsun [Wed, 8 Apr 2020 16:28:51 +0000 (09:28 -0700)] 
HBASE-24120 Flakey Test: TestReplicationAdminWithClusters timeout (#1441)

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-24062 Add 2.1.10 to download page (#1454)
Duo Zhang [Wed, 8 Apr 2020 11:56:31 +0000 (19:56 +0800)] 
HBASE-24062 Add 2.1.10 to download page (#1454)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2 years agoHBASE-24114 [Flakey Tests] TestSnapshotScannerHDFSAclController (#1433)
huaxiangsun [Wed, 8 Apr 2020 03:36:11 +0000 (20:36 -0700)] 
HBASE-24114 [Flakey Tests] TestSnapshotScannerHDFSAclController (#1433)

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24128 [Flakey Tests] Add retry on thrift cmdline if client fails plus misc...
Michael Stack [Tue, 7 Apr 2020 16:28:05 +0000 (09:28 -0700)] 
HBASE-24128 [Flakey Tests] Add retry on thrift cmdline if client fails plus misc debug (#1442)

hbase-server/src/test/java/org/apache/hadoop/hbase/TestClusterPortAssignment.java
 Saw case where Master failed startup but it came out as an IOE so we
 did not trip the retry logic.

hbase-server/src/test/java/org/apache/hadoop/hbase/TestInfoServers.java
 Add some debug and up timeouts. This test fails frequently for me
 locally.

hbase-server/src/test/java/org/apache/hadoop/hbase/client/locking/TestEntityLocks.java
 Up the wait from 2x 200ms to 10x in case a pause on hardware or GC.
 This test fails locally and up on jenkins.

hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestClearRegionBlockCache.java
 Debug. Have assert say what bad count was.

hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCompactingToCellFlatMapMemStore.java
 Fails on occasion. Found count is off by a few. Tricky to debug. HBASE-24129 to reenable.

hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMergeTransactionOnCluster.java
 Debug. Add wait and check before moving to assert.

hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift/TestThriftHttpServer.java
 Check for null before shutting; can be null if failed start.

hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift/TestThriftServerCmdLine.java
 Add retry if client messes up connection. Fails for me locally.

2 years agoHBASE-24130 rat plugin complains about having an unlicensed file (#1445)
Minwoo Kang [Tue, 7 Apr 2020 16:16:10 +0000 (01:16 +0900)] 
HBASE-24130 rat plugin complains about having an unlicensed file (#1445)

Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2 years agoHBASE-24055 Make AsyncFSWAL can run on EC cluster (#1437)
Duo Zhang [Tue, 7 Apr 2020 15:41:35 +0000 (23:41 +0800)] 
HBASE-24055 Make AsyncFSWAL can run on EC cluster (#1437)

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24077 When encounter RowTooBigException, log the row info. (#1379)
binlijin [Tue, 7 Apr 2020 02:28:35 +0000 (10:28 +0800)] 
HBASE-24077 When encounter RowTooBigException, log the row info. (#1379)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2 years agoHBASE-24081 Provide documentation for running Yetus with HBase
Nick Dimiduk [Mon, 30 Mar 2020 20:46:10 +0000 (13:46 -0700)] 
HBASE-24081 Provide documentation for running Yetus with HBase

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24115 Relocate test-only REST "client" from src/ to test/ and mark Private...
Andrew Purtell [Mon, 6 Apr 2020 23:18:40 +0000 (16:18 -0700)] 
HBASE-24115 Relocate test-only REST "client" from src/ to test/ and mark Private (#1434)

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2 years agoHBASE-24106 Update getting started documentation after HBASE-24086
Nick Dimiduk [Thu, 2 Apr 2020 19:33:36 +0000 (12:33 -0700)] 
HBASE-24106 Update getting started documentation after HBASE-24086

Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2 years agoHBASE-24118 [Flakey Tests] TestCloseRegionWhileRSCrash
stack [Mon, 6 Apr 2020 19:38:02 +0000 (12:38 -0700)] 
HBASE-24118 [Flakey Tests] TestCloseRegionWhileRSCrash
Reapply but as an @Ignore for the flakey test.

2 years agoRevert "HBASE-24118 [Flakey Tests] TestCloseRegionWhileRSCrash"
stack [Mon, 6 Apr 2020 19:35:52 +0000 (12:35 -0700)] 
Revert "HBASE-24118 [Flakey Tests] TestCloseRegionWhileRSCrash"
Reverting in favor of adding an @Ignore on this test until
root cause of flakyness HBASE-24117 is addressed.

This reverts commit 9985c06647ef7169b9940cd3b6b24c2ac6a322fc.

2 years agoHBASE-24122 Change machine ulimit-l to ulimit-a so dumps full ulimit rather than...
stack [Mon, 6 Apr 2020 15:57:00 +0000 (08:57 -0700)] 
HBASE-24122 Change machine ulimit-l to ulimit-a so dumps full ulimit rather than just 'max locked memory'

2 years agoHBASE-24119 Polish the protobuf usage in hbase-examples (#1438)
Duo Zhang [Mon, 6 Apr 2020 14:14:55 +0000 (22:14 +0800)] 
HBASE-24119 Polish the protobuf usage in hbase-examples (#1438)

Move the proto files only used by hbase-examples to hbase-examples, to show users how to make use of shaded hbase protos when implementing coprocessor.

Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24111 Enable CompactionTool executions on non-HDFS filesystems (#1427)
Peter Somogyi [Mon, 6 Apr 2020 09:54:19 +0000 (11:54 +0200)] 
HBASE-24111 Enable CompactionTool executions on non-HDFS filesystems (#1427)

Signed-off-by: Josh Elser <elserj@apache.org>
2 years agoHBASE-24056 Improve the layout of our proto files in hbase-protocol-shaded module...
Semen Komissarov [Mon, 6 Apr 2020 02:22:08 +0000 (05:22 +0300)] 
HBASE-24056 Improve the layout of our proto files in hbase-protocol-shaded module (#1377)

proto files layout:
protobuf/client - client to server messages, client rpc service and protos, used in hbase-client exclusively;
protobuf/rest - hbase-rest messages;
protobuf/rpc - rpc and post-rpc tracing messages;
protobuf/server/coprocessor - coprocessor rpc services;
protobuf/server/coprocessor/example - coprocessors rpc services examples from hbase-examples;
protobuf/server/io - filesystem and hbase-server/io protos;
protobuf/server/maser - master rpc services and messages;
protobuf/server/region - region rpc services and messages (except client rpc service, which is in Client.proto);
protobuf/server/rsgroup - rsgroup protos;
protobuf/server/zookeeper - protos for zookeeper and ones used exclusively in hbase-zookeeper module;
protobuf/server - protos used across other server protos;
protobuf/test - protos used in tests;
protobuf/ - protos used across other protos, exclusive for hbase-mapreduce and hbase-backup, other protos.

Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-24105 [Flakey Test] regionserver.TestRegionReplicas (#1425)
huaxiangsun [Sun, 5 Apr 2020 20:20:23 +0000 (13:20 -0700)] 
HBASE-24105 [Flakey Test] regionserver.TestRegionReplicas (#1425)

Co-authored-by: Huaxiang Sun <huaxiangsun@apache.com>
Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24113 Upgrade the maven we use from 3.5.4 to 3.6.3 in nightlies (#1430)
Michael Stack [Sun, 5 Apr 2020 19:53:44 +0000 (12:53 -0700)] 
HBASE-24113 Upgrade the maven we use from 3.5.4 to 3.6.3 in nightlies (#1430)

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2 years agoHBASE-24118 [Flakey Tests] TestCloseRegionWhileRSCrash
stack [Sun, 5 Apr 2020 00:44:37 +0000 (17:44 -0700)] 
HBASE-24118 [Flakey Tests] TestCloseRegionWhileRSCrash

2 years agoHBASE-24049 use hadoop-2.10.0 for "packaging and integration" check
Nick Dimiduk [Thu, 26 Mar 2020 23:35:28 +0000 (16:35 -0700)] 
HBASE-24049 use hadoop-2.10.0 for "packaging and integration" check

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24086 Disable output stream capability enforcement when running on LocalFileSystem
Nick Dimiduk [Wed, 1 Apr 2020 18:25:39 +0000 (11:25 -0700)] 
HBASE-24086 Disable output stream capability enforcement when running on LocalFileSystem

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-24102 : Remove decommissioned RS from target servers while unlo… (#1417)
Viraj Jasani [Fri, 3 Apr 2020 12:58:49 +0000 (18:28 +0530)] 
HBASE-24102 : Remove decommissioned RS from target servers while unlo… (#1417)

Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2 years agoHBASE-24072 Nightlies reporting OutOfMemoryError: unable to create new native thread
stack [Wed, 1 Apr 2020 23:05:59 +0000 (16:05 -0700)] 
HBASE-24072 Nightlies reporting OutOfMemoryError: unable to create new native thread
Set the forkcount down from 0.5C to 0.25C.

2 years agoHBASE-24107 [Flakey Test] TestThriftServerCmdLine.testRunThriftServer NPEs if InfoSer...
stack [Fri, 3 Apr 2020 03:29:58 +0000 (20:29 -0700)] 
HBASE-24107 [Flakey Test] TestThriftServerCmdLine.testRunThriftServer NPEs if InfoServer port clash

2 years agoHBASE-24080 [flakey test] TestRegionReplicaFailover.testSecondaryRegionKill fails...
huaxiangsun [Thu, 2 Apr 2020 21:55:55 +0000 (14:55 -0700)] 
HBASE-24080 [flakey test] TestRegionReplicaFailover.testSecondaryRegionKill fails. (#1421)

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24103 [Flakey Tests] TestSnapshotScannerHDFSAclController (#1416)
meiyi [Thu, 2 Apr 2020 16:55:47 +0000 (00:55 +0800)] 
HBASE-24103 [Flakey Tests] TestSnapshotScannerHDFSAclController (#1416)

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24084 Fix missing jdk8 dependencies in hbase-assembly/hadoop-two-compat
Nick Dimiduk [Wed, 1 Apr 2020 20:38:55 +0000 (13:38 -0700)] 
HBASE-24084 Fix missing jdk8 dependencies in hbase-assembly/hadoop-two-compat

After HBASE-23986, running on JDK8/Hadoop2 from the binary tarball
results in

```
Exception in thread "main" java.lang.NoClassDefFoundError: com/ctc/wstx/io/InputBootstrapper
        at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:149)
        at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:3062)
Caused by: java.lang.ClassNotFoundException: com.ctc.wstx.io.InputBootstrapper
        at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        ... 2 more
```

The missing class is from `com.fasterxml.woodstox:woodstox-core`. This
and `org.codehaus.woodstox:stax2-api` are explicit dependencies of
`org.apache.hadoop:hadoop-common:jar:2.10.0`. Thus, include them in
the default jars provided under `lib`.

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24073 [flakey test] client.TestAsyncRegionAdminApi messed up compaction state...
huaxiangsun [Thu, 2 Apr 2020 15:16:27 +0000 (08:16 -0700)] 
HBASE-24073 [flakey test] client.TestAsyncRegionAdminApi messed up compaction state. (#1414)

Addendum:
  For major compaction test, set hbase.hstore.compaction.min to a big number to
  avoid kicking in minor compactions, which will pollute compaction state and
  sometimes, cause major compaction cannot happen.

Co-authored-by: Huaxiang Sun <huaxiangsun@apache.com>
Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24021 Fail fast when bulkLoadHFiles method catch some IOException (#1343)
niuyulin [Thu, 2 Apr 2020 15:15:14 +0000 (23:15 +0800)] 
HBASE-24021 Fail fast when bulkLoadHFiles method catch some IOException (#1343)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-23843 Removed deprecated Scan(byte[]) from Scan
Jan Hentschel [Thu, 2 Apr 2020 09:44:34 +0000 (11:44 +0200)] 
HBASE-23843 Removed deprecated Scan(byte[]) from Scan

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years ago HBASE-24100 [Flakey Tests] Add test to check we work properly when port clash settin...
stack [Thu, 2 Apr 2020 00:49:35 +0000 (17:49 -0700)] 
 HBASE-24100 [Flakey Tests] Add test to check we work properly when port clash setting up thriftserver
 Addendum; add missing @ClassRule

2 years agoRevert "HBASE-24051 Allows indirect inheritance to CanUnbuffer (#1406)"
stack [Wed, 1 Apr 2020 22:50:25 +0000 (15:50 -0700)] 
Revert "HBASE-24051 Allows indirect inheritance to CanUnbuffer (#1406)"

This reverts commit ae1f928b13a4d41b208eeecca17932fc9fa0d65e.

2 years agoHBASE-24051 Allows indirect inheritance to CanUnbuffer (#1406)
申胜利 [Wed, 1 Apr 2020 21:39:00 +0000 (05:39 +0800)] 
HBASE-24051 Allows indirect inheritance to CanUnbuffer (#1406)

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24071 [JDK11] Remove `unit` filter from nightly and precommit jobs
Nick Dimiduk [Mon, 30 Mar 2020 16:53:40 +0000 (09:53 -0700)] 
HBASE-24071 [JDK11] Remove `unit` filter from nightly and precommit jobs

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-24100 [Flakey Tests] Add test to check we work properly when port clash setting...
stack [Wed, 1 Apr 2020 19:23:09 +0000 (12:23 -0700)] 
HBASE-24100 [Flakey Tests] Add test to check we work properly when port clash setting up thriftserver

2 years agoHBASE-24092 Fix links to build reports generated by nightly job
Nick Dimiduk [Tue, 31 Mar 2020 16:09:25 +0000 (09:09 -0700)] 
HBASE-24092 Fix links to build reports generated by nightly job

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24097 [Flakey Tests] TestSnapshotScannerHDFSAclController#testRestoreSnapshot...
Michael Stack [Wed, 1 Apr 2020 15:33:44 +0000 (08:33 -0700)] 
HBASE-24097 [Flakey Tests] TestSnapshotScannerHDFSAclController#testRestoreSnapshot (#1405)

hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationTrackerZKImpl.java
 Add debug for when assert fails (it fails on occasion locally)

hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestHDFSAclHelper.java
 Move this inner class out standalone since it used now by two tests.

hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestSnapshotScannerHDFSAclController.java
 Moved out testRestoreSnapshot and made methods in here static so could
 be used by a new adacent test. Also made tablenames unique to methods
 thinking that was root of original issue (wasn't but no harm in doing
 this change) Moved out the inner class TestHDFSAclHelper.

hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestSnapshotScannerHDFSAclController2.java
 New class that sets up same context as
 TestSnapshotScannerHDFSAclController but just to run single
 testRestoreSnapshot method.

hbase-server/src/test/java/org/apache/hadoop/hbase/security/token/TestZKSecretWatcher.java
 Some debug.

Signed-off-by: Yi Mei
2 years agoHBASE-23937 : Documentation for get_largelog_responses command (ADDENDUM)
Viraj Jasani [Wed, 1 Apr 2020 14:41:02 +0000 (20:11 +0530)] 
HBASE-23937 : Documentation for get_largelog_responses command (ADDENDUM)

2 years agoHBASE-23937 : Support Online LargeLogs similar to SlowLogs APIs (#1346)
Viraj Jasani [Wed, 1 Apr 2020 12:52:22 +0000 (18:22 +0530)] 
HBASE-23937 : Support Online LargeLogs similar to SlowLogs APIs (#1346)

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2 years agoHBASE-23842 Removed deprecated Scan(byte[], byte[]) from Scan
Jan Hentschel [Wed, 1 Apr 2020 11:11:21 +0000 (13:11 +0200)] 
HBASE-23842 Removed deprecated Scan(byte[], byte[]) from Scan

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-23678 : Builder API for version management - setVersionsWithTim… (#1381)
Viraj Jasani [Wed, 1 Apr 2020 10:46:40 +0000 (16:16 +0530)] 
HBASE-23678 : Builder API for version management - setVersionsWithTim… (#1381)

Signed-off-by: Xu Cang <xucang@apache.org>
2 years agoHBASE-24096 Fix TestRSGroupsBalance (#1402)
binlijin [Wed, 1 Apr 2020 06:16:57 +0000 (14:16 +0800)] 
HBASE-24096 Fix TestRSGroupsBalance (#1402)

Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-24075: Fix a race between master shutdown and metrics (re)init
Bharath Vissapragada [Tue, 31 Mar 2020 07:16:15 +0000 (00:16 -0700)] 
HBASE-24075: Fix a race between master shutdown and metrics (re)init

JMXCacheBuster resets the metrics state at various points in time. These
events can potentially race with a master shutdown. When the master is
tearing down, metrics initialization can touch a lot of unsafe state,
for example invalidated FS objects. To avoid this, this patch makes
the getMetrics() a no-op when the master is either stopped or in the
process of shutting down. Additionally, getClusterId() when the server
is shutting down is made a no-op.

Simulating a test for this is a bit tricky but with the patch I don't
locally see the long stacktraces from the jira.

Signed-off-by: Michael Stack <stack@apache.org>
2 years agoHBASE-24078 SpotBugs check automatically skip inapplicable modules
Nick Dimiduk [Wed, 25 Mar 2020 22:45:28 +0000 (15:45 -0700)] 
HBASE-24078 SpotBugs check automatically skip inapplicable modules

Without patch, the spotbugs results include warnings for inapplicable
modules:

+---------------------------------------------------------------------------
|      |                |            | Compile Tests
+---------------------------------------------------------------------------
|   0  |        mvndep  |   0m 11s   | Maven dependency ordering
|  +1  |    mvninstall  |   2m 47s   | the source passed
|   0  |      spotbugs  |   0m 11s   | branch/hbase-annotations no spotbugs
|      |                |            | output file (spotbugsXml.xml)
|   0  |      spotbugs  |   0m 14s   | branch/hbase-assembly no spotbugs output
|      |                |            | file (spotbugsXml.xml)
|   0  |      spotbugs  |   0m 07s   |
|      |                |            | branch/hbase-archetypes/hbase-archetype-bu
|      |                |            | ilder no spotbugs output file
|      |                |            | (spotbugsXml.xml)
+---------------------------------------------------------------------------

With patch,

+---------------------------------------------------------------------------
|      |                |            | Compile Tests
+---------------------------------------------------------------------------
|   0  |        mvndep  |   0m 13s   | Maven dependency ordering
|  +1  |    mvninstall  |   3m 09s   | the source passed
|  +1  |      spotbugs  |  17m 09s   | the source passed
+---------------------------------------------------------------------------

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-23846 Removed deprecated setMaxVersions(int) from Scan
Jan Hentschel [Tue, 31 Mar 2020 08:18:27 +0000 (10:18 +0200)] 
HBASE-23846 Removed deprecated setMaxVersions(int) from Scan

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoHBASE-24079 [Flakey Tests] Misc fixes and debug; fix BindException in Thrift tests...
stack [Mon, 30 Mar 2020 16:40:03 +0000 (09:40 -0700)] 
HBASE-24079 [Flakey Tests] Misc fixes and debug; fix BindException in Thrift tests; add waits on quota table to come online; etc.

hbase-client/src/main/java/org/apache/hadoop/hbase/client/ClientAsyncPrefetchScanner.java
 Refactor to avoid NPE timing issue referencing lock during Construction.

hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/BucketCache.java
 Comment

hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/RSProcedureDispatcher.java
 Refactor. Catch NPE during startup and return it instead as failed initialization.

hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CompactSplit.java
 Catch IndexOutOfBounds exception and convert to non-split request.

hbase-server/src/test/java/org/apache/hadoop/hbase/TestCachedClusterId.java
 Make less furious. Make it less flakie.

hbase-server/src/test/java/org/apache/hadoop/hbase/TestServerSideScanMetricsFromClientSide.java
 Debug. Catch exception to log, then rethrow.

hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAsyncRegionAdminApi.java
 Guess that waiting longer on compaction to succeed may help make this
 less flakey.

hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide3.java
 Be explicit about timestamping to avoid concurrent edit landing
 server-side and messing up test expectation.

hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMasterRegistry.java
 Add wait on meta before proceeding w/ test.

hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestScannersFromClientSide.java
 Be explicit that edits are distinct.

hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/bucket/TestBucketCacheRefCnt.java
 Add @Ignore on RAM test... Fails sporadically.

hbase-server/src/test/java/org/apache/hadoop/hbase/master/assignment/TestRegionMoveAndAbandon.java
 Add wait for all RegionServers going down before proceeding; was
 messing up RS accounting.

hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/BalancerTestBase.java
 Make balancer test sloppier; less restrictive; would fail on occasion
 by being just outside test limits.

hbase-server/src/test/java/org/apache/hadoop/hbase/quotas/TestQuotaObserverChoreRegionReports.java
 Add wait on quota table coming up; helps make this less flakie.

hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
 Be explicity about timestamps; see if helps w/ flakie failure.

hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionReplicas.java
 Catch and ignore if issue in shutdown; don't care if after test.

hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReportForDuty.java
 Comment.

hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestAccessController.java
 Add retry to see if helps w/ odd failure; grant hasn't propagated?

hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestCellACLWithMultipleVersions.java
 Explicit w/ timestamps so no accidental overlap of puts.

hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift/TestThriftHttpServer.java
hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift/TestThriftServerCmdLine.java
 Hack to deal w/ BindException on startup.

hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift2/TestThrift2ServerCmdLine.java
 Use loopback.

hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift2/TestThriftHBaseServiceHandler.java
 Disable flakie test.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2 years agoHBASE-24052 Add debug+fix to TestMasterShutdown
stack [Fri, 27 Mar 2020 16:36:05 +0000 (09:36 -0700)] 
HBASE-24052 Add debug+fix to TestMasterShutdown

Add check for stopped server at a few more points in Master startup.
Defend against NPE in RSProcedureDispatcher; log and retun instead.

2 years agoHBASE-24073 [flakey test] client.TestAsyncRegionAdminApi messed up compaction state...
huaxiangsun [Mon, 30 Mar 2020 19:11:26 +0000 (12:11 -0700)] 
HBASE-24073 [flakey test] client.TestAsyncRegionAdminApi messed up compaction state. (#1387)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2 years agoRevert "HBASE-24073 [flakey test] client.TestAsyncRegionAdminApi messed up compaction...
huaxiangsun [Mon, 30 Mar 2020 17:06:13 +0000 (10:06 -0700)] 
Revert "HBASE-24073 [flakey test] client.TestAsyncRegionAdminApi messed up compaction state. (#1378)" (#1386)

This reverts commit d319ce8c6fb94c3433cb363ce0234144cbb18713.

2 years agoHBASE-24007 Get `-PrunLargeTests` passing on JDK11 (#1351)
Nick Dimiduk [Mon, 30 Mar 2020 16:31:10 +0000 (09:31 -0700)] 
HBASE-24007 Get `-PrunLargeTests` passing on JDK11 (#1351)

Minor tweaks required to get passing runs of `-PrunLargeTests`.
* Minimum Hadoop version is 3.2.0 due to
  [HADOOP-12760](https://issues.apache.org/jira/browse/HADOOP-12760).
* JDK11 looks like it consumes more memory than JDK8, so failures due
  to OOME see more common here. Bumping heap allocated to surefire
  forks allows better pass rate.

Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2 years agoHBASE-24073 [flakey test] client.TestAsyncRegionAdminApi messed up compaction state...
huaxiangsun [Mon, 30 Mar 2020 16:29:18 +0000 (09:29 -0700)] 
HBASE-24073 [flakey test] client.TestAsyncRegionAdminApi messed up compaction state. (#1378)

Co-authored-by: Huaxiang Sun <huaxiangsun@apache.com>
2 years agoHBASE-23798 Remove hbase-prototcol module (#1360)
Duo Zhang [Mon, 30 Mar 2020 01:54:59 +0000 (09:54 +0800)] 
HBASE-23798 Remove hbase-prototcol module (#1360)

Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-23845 Removed deprecated setMaxVersions from Scan (#1208)
Jan Hentschel [Sun, 29 Mar 2020 09:46:49 +0000 (11:46 +0200)] 
HBASE-23845 Removed deprecated setMaxVersions from Scan (#1208)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-24057 Add modules to mapreduce job classpaths (#1359)
Peter Somogyi [Fri, 27 Mar 2020 10:14:37 +0000 (11:14 +0100)] 
HBASE-24057 Add modules to mapreduce job classpaths (#1359)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2 years agoHBASE-24040 WALFactory.Providers.multiwal causes StackOverflowError (#1338)
WenFeiYi [Fri, 27 Mar 2020 02:04:52 +0000 (10:04 +0800)] 
HBASE-24040 WALFactory.Providers.multiwal causes StackOverflowError (#1338)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2 years agoHBASE-23381 Ensure Netty client receives at least one response before considering...
Josh Elser [Mon, 9 Mar 2020 20:50:36 +0000 (16:50 -0400)] 
HBASE-23381 Ensure Netty client receives at least one response before considering SASL negotiation complete

The PLAIN mechanism test added in the Shade authentication example has
different semantics than GSSAPI mechanism -- the client reports that the
handshake is done after the original challenge is computed. The javadoc
on SaslClient, however, tells us that we need to wait for a response
from the server before proceeding.

The client, best as I can see, does not receive any data from HBase;
however the application semantics (e.g. throw an exception on auth'n
error) do not work as we intend as a result of this bug.

Extra trace logging was also added to debug this, should a similar error
ever happen again with some other mechanism.

Closes #1260

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2 years agoHBASE-23853 [Flakey Test] TestBlockEvictionFromClient#testBlockRefCountAfterSplits...
huaxiangsun [Thu, 26 Mar 2020 21:06:34 +0000 (14:06 -0700)] 
HBASE-23853 [Flakey Test] TestBlockEvictionFromClient#testBlockRefCountAfterSplits (#1363)

Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: <stack@apache.org>
2 years agoHBASE-24045 Support setting `-Dhadoop.profile` in adhoc_run_tests.sh ADDENDUM
Nick Dimiduk [Thu, 26 Mar 2020 00:19:15 +0000 (17:19 -0700)] 
HBASE-24045 Support setting `-Dhadoop.profile` in adhoc_run_tests.sh ADDENDUM

* Correctly handle the hadoop2 profile.
* Create the output directory if it doesn't exist

2 years agoHBASE-23975 make hbase-rest use shaded protobuf (#1325)
Semen Komissarov [Thu, 26 Mar 2020 13:35:36 +0000 (16:35 +0300)] 
HBASE-23975 make hbase-rest use shaded protobuf (#1325)

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>