3 years agoHBASE-23018 - [HBCK2] Add useful messages when report/fixing missing regions in meta...
Dice [Fri, 13 Sep 2019 07:03:24 +0000 (16:03 +0900)] 
HBASE-23018 - [HBCK2] Add useful messages when report/fixing missing regions in meta (#31)

Signed-off-by: Michael Stack <stack@apache.org>
3 years agoHBASE-22999 Fix non-varargs compile warnings (#27)
Wellington Ramos Chevreuil [Tue, 10 Sep 2019 14:57:11 +0000 (16:57 +0200)] 
HBASE-22999 Fix non-varargs compile warnings (#27)

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
3 years agoHBASE-22997 Move to SLF4J (#25)
Peter Somogyi [Tue, 10 Sep 2019 06:34:52 +0000 (08:34 +0200)] 
HBASE-22997 Move to SLF4J (#25)

Signed-off-by: Michael Stack <stack@apache.org>
3 years agoHBASE-22998 Fix NOTICE and LICENSE (#26)
Peter Somogyi [Mon, 9 Sep 2019 16:55:25 +0000 (18:55 +0200)] 
HBASE-22998 Fix NOTICE and LICENSE (#26)

Signed-off-by: Sean Busbey <busbey@apache.org>
3 years agoHBASE-22567 [HBCK2] Add new methods for dealing with missing regions in META while...
Wellington Chevreuil [Fri, 6 Sep 2019 14:23:00 +0000 (15:23 +0100)] 
HBASE-22567 [HBCK2] Add new methods for dealing with missing regions in META while Master is online

Signed-off-by: stack <stack@apache.org>
3 years agoHBASE-22984 [HBCK2] HBCKMetaTableAccessor.deleteFromMetaTable throwing java.lang...
Wellington Ramos Chevreuil [Fri, 6 Sep 2019 16:51:03 +0000 (17:51 +0100)] 
HBASE-22984 [HBCK2] HBCKMetaTableAccessor.deleteFromMetaTable throwing java.lang.UnsupportedOperationException at runtime (#24)

Signed-off-by: Sean Busbey <busbey@apache.org>
3 years agoHBASE-22825 addendum Fix invalid function call (from usage to showErrorMessage) ...
Fabrice [Fri, 6 Sep 2019 05:01:04 +0000 (22:01 -0700)] 
HBASE-22825 addendum Fix invalid function call (from usage to showErrorMessage) (#23)

Signed-off-by: Sean Busbey <busbey@apache.org>
3 years agoHBASE-22859 [HBCK2] Fix the orphan regions on filesystem
stack [Thu, 5 Sep 2019 22:28:58 +0000 (15:28 -0700)] 
HBASE-22859 [HBCK2] Fix the orphan regions on filesystem

An edit to remove --internal-classpath recommendation (it doesn't
work) and to point at the new doc on how to fix orphan regions
using the bulkloadcomplet tool over in the refguide.

3 years agoHBASE-22825 [HBCK2] Add a client-side to hbase-operator-tools that can exploit fixMet...
Sakthi [Thu, 5 Sep 2019 22:41:36 +0000 (15:41 -0700)] 
HBASE-22825 [HBCK2] Add a client-side to hbase-operator-tools that can exploit fixMeta added in server side Fix review comments - Put FixMeta alphabetically Signed-off-by: Sean Busbey <busbey@apache.org> Signed-off-by: stack <stack@apache.org>

3 years agoHBASE-22951 [HBCK2] hbase hbck throws IOE "No FileSystem for scheme: hdfs" (#22)
Michael Stack [Wed, 4 Sep 2019 04:38:44 +0000 (21:38 -0700)] 
HBASE-22951 [HBCK2] hbase hbck throws IOE "No FileSystem for scheme: hdfs" (#22)

Add note on how to add hdfs jars when running filesystem command.
Make note of new 'HBCK Report'. Did general edit.

3 years agoHBASE-22952 HBCK2 replication command is incompatible with 2.0.x (#20)
Peter Somogyi [Mon, 2 Sep 2019 07:54:05 +0000 (09:54 +0200)] 
HBASE-22952 HBCK2 replication command is incompatible with 2.0.x (#20)

Signed-off-by: Michael Stack <stack@apache.org>
3 years agoHBASE-22957 [HBCK2] reference file check fails if compiled with old v… (#21)
Michael Stack [Sun, 1 Sep 2019 05:02:09 +0000 (22:02 -0700)] 
HBASE-22957 [HBCK2] reference file check fails if compiled with old v… (#21)

* HBASE-22957 [HBCK2] reference file check fails if compiled with old version but check against new

Move local methods from FSUtils that are used only by hbck1 AND
whose signature was changed in hbase2 minor versions causing
breakage if compiled w/ old version and run w/ a newer hbase
(or vice versa).

* Fix checkstyle complaint

3 years agoHBASE-22949 [HBCK2] Add lang3 as explicit dependency (#19)
Michael Stack [Thu, 29 Aug 2019 23:04:57 +0000 (16:04 -0700)] 
HBASE-22949 [HBCK2] Add lang3 as explicit dependency (#19)

3 years agoHBASE-22906 Clean up checkstyle complaints in hbase-operator-tools (#17)
Sean Busbey [Fri, 23 Aug 2019 14:47:08 +0000 (09:47 -0500)] 
HBASE-22906 Clean up checkstyle complaints in hbase-operator-tools (#17)

Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
3 years agoHBASE-22691 Moved Checkstyle suppression file to a different location
Jan Hentschel [Sun, 14 Jul 2019 16:24:52 +0000 (18:24 +0200)] 
HBASE-22691 Moved Checkstyle suppression file to a different location

Signed-off-by: Sean Busbey <busbey@apache.org>
3 years agoHBASE-22865 [HBCK2] shows the whole help/usage message after the error message (#15)
Sakthi [Tue, 20 Aug 2019 21:21:47 +0000 (14:21 -0700)] 
HBASE-22865 [HBCK2] shows the whole help/usage message after the error message (#15)

Signed-off-by: Sean Busbey <busbey@apache.org>
3 years agoHBASE-22843 [HBCK2] Add HBCKMetaTableAccessor for hbck2
Sakthi [Thu, 15 Aug 2019 20:00:47 +0000 (13:00 -0700)] 
HBASE-22843 [HBCK2] Add HBCKMetaTableAccessor for hbck2

- A fix after HBASE-22777 & HBASE-22758

Signed-off-by: Stack <stack@apache.org>
3 years agoHBASE-22717 [HBCK2] Expose replication fixes from hbck1 (#13)
Michael Stack [Fri, 19 Jul 2019 22:44:02 +0000 (15:44 -0700)] 
HBASE-22717 [HBCK2] Expose replication fixes from hbck1 (#13)

* HBASE-22717 [HBCK2] Expose replication fixes from hbck1

Finds undeleted queues and replication barriers. Removes
them if --fix is passed.

3 years agoHBASE-22713 [HBCK2] Add hdfs integrity report to 'filesystem' command (#12)
Michael Stack [Fri, 19 Jul 2019 00:14:32 +0000 (17:14 -0700)] 
HBASE-22713 [HBCK2] Add hdfs integrity report to 'filesystem' command (#12)

Add check of hdfs 'integrity'. Produces report.

Fix a bug where we'd not run filesystem command.

Cleanup filesystem output to be more explicit
about what it does.

3 years agoHBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService (#11)
Michael Stack [Thu, 18 Jul 2019 15:26:40 +0000 (08:26 -0700)] 
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService (#11)

* HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService

Adds server version check so we fail fast and complain if remote
server does not support feature.

Refactor so we test server version before we use feature/command.

Named feature scheduleRecoveries

Add a new Version class that has Version math and check in it.

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
3 years agoHBASE-22688 [HBCK2] Add filesystem fixup to hbck2 (#10)
Michael Stack [Tue, 16 Jul 2019 18:39:32 +0000 (11:39 -0700)] 
HBASE-22688 [HBCK2] Add filesystem fixup to hbck2 (#10)

* HBASE-22688 [HBCK2] Add filesystem fixup to hbck2

Adds a general filesystem check command to the HBCK2 list.
Runs just the offline filesystem checks from the old hbck1
HBaseFsck tool. Checks hfile validity, if references and
hfile links are wholesome, and whether the hbase.version
file is present. Pass '--fix' to do fixup.

Depends on hbck1 HBaseFsck being present in hbck2
(HBASE-22680 adds it so this could go in after it)

Does NOT do regiondir or tabledir fixup or fixing of
orphans in hdfs or plugging holes in hdfs.

A hbase-hbck2/src/main/java/org/apache/hbase/FileSystemFsck.java
 Adds a file to handle filesystem fsck checking and fixing.

M hbase-hbck2/src/main/java/org/apache/hbase/hbck1/HFileCorruptionChecker.java
 Formatting fixes and filling out the MOB report so like the hfile

Signed-off-by: Sean Busbey <busbey@apache.org>
* Fix checkstyle

* More checkstyle fixes

3 years agoHBASE-22680 [HBCK2] OfflineMetaRepair for hbase2/hbck2 (#6)
Michael Stack [Tue, 16 Jul 2019 17:06:41 +0000 (10:06 -0700)] 
HBASE-22680 [HBCK2] OfflineMetaRepair for hbase2/hbck2 (#6)

This commit checks-in hbck1 code with modifications under
a new package. Changes included here allow rebuild of meta
from filesystem meta data so the rebuilt hbase:meta works
for hbase2. This facility is exposed via the OfflineMetaRepair
tool with rebuild receipe outlined in the README documentation.
More of hbck1 to be exposed (or removed) in future commits to
address list of wants in parent issue HBASE-21745.

 Updated usage. Edit of aspects. Added section on end on how
 to rebuild meta offline.

M pom.xml
 Use hbase testing utility code instead of repro in
 hbck as hbck1 used to do.

M hbase-hbck2/src/main/java/org/apache/hbase/HBCK2.java
 Updated the usage.

A hbase-hbck2/src/main/java/org/apache/hbase/hbck1/HBaseFsck.java
 Remove main from hbck1 fsck so HBaseFsck not directly accessible.
A hbase-hbck2/src/main/java/org/apache/hbase/hbck1/HBaseFsckRepair.java
 Copied from hbck1 and updated to work against hbase2.
 Most goes unused. Subsequent commits will amend/expose/purge
 this class. For now the rebuild meta function is all that is
 used. Some new code added to make it work with hbase2.
 Some code removed and hbasetestingutility equivalents used

A hbase-hbck2/src/main/java/org/apache/hbase/hbck1/HFileCorruptionChecker.java
A hbase-hbck2/src/main/java/org/apache/hbase/hbck1/ReplicationChecker.java
A hbase-hbck2/src/main/java/org/apache/hbase/hbck1/TableIntegrityErrorHandler.java
A hbase-hbck2/src/main/java/org/apache/hbase/hbck1/TableIntegrityErrorHandlerImpl.java
 Unmodified except for repackaging.

A hbase-hbck2/src/main/java/org/apache/hbase/hbck1/OfflineMetaRepair.java
 Tool that exposes meta fixup. Some cleanup from original.

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
3 years agoHBASE-22675 Use the commons-cli from hbase-thirdparty
Josh Elser [Wed, 10 Jul 2019 15:09:23 +0000 (11:09 -0400)] 
HBASE-22675 Use the commons-cli from hbase-thirdparty

Should work with any hbase-thirdparty >=2.1.0 and increases
compatibility scope for HBCK2 to more HBase releases.

Closes #4

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: stack <stack@apache.org>
3 years agoHBASE-22687 Added HBase Checkstyle configuration to the project
Jan Hentschel [Sun, 14 Jul 2019 16:10:35 +0000 (18:10 +0200)] 
HBASE-22687 Added HBase Checkstyle configuration to the project

Signed-off-by: stack <stack@apache.org>
3 years agoHBASE-22674 precommit docker image installs JRE over JDK (#7)
Sean Busbey [Fri, 12 Jul 2019 05:24:07 +0000 (00:24 -0500)] 
HBASE-22674 precommit docker image installs JRE over JDK (#7)

* remove findbugs because it pulls in a JRE
* remove bats because we don't use it.

3 years agoHBASE-22183 [hbck2] Update hbck2 README to explain new setRegionState method.
Wellington Chevreuil [Mon, 10 Jun 2019 09:43:40 +0000 (10:43 +0100)] 
HBASE-22183 [hbck2] Update hbck2 README to explain new setRegionState method.

3 years agoHBASE-21763 [HBCK2] hbck2 options does not work and throws exceptions
Syeda [Thu, 7 Mar 2019 11:09:27 +0000 (16:39 +0530)] 
HBASE-21763 [HBCK2] hbck2 options does not work and throws exceptions

Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
3 years agoHBASE-22143 - HBCK2 setRegionState command
Wellington Chevreuil [Mon, 1 Apr 2019 14:49:39 +0000 (15:49 +0100)] 
HBASE-22143 - HBCK2 setRegionState command

Signed-off-by: Josh Elser <elserj@apache.org>
3 years agoHBASE-21433 Add Apache Yetus integration for hbase-operator-tools repository
Peter Somogyi [Thu, 28 Feb 2019 19:34:23 +0000 (20:34 +0100)] 
HBASE-21433 Add Apache Yetus integration for hbase-operator-tools repository

3 years agoHBASE-21484 [hbck2] hbck2 should default to a released hbase version
Sean Busbey [Thu, 15 Nov 2018 22:47:32 +0000 (16:47 -0600)] 
HBASE-21484 [hbck2] hbck2 should default to a released hbase version

3 years agoHBASE-21483 [hbck2] version string checking should look for exactly the version we...
Sean Busbey [Thu, 15 Nov 2018 22:45:13 +0000 (16:45 -0600)] 
HBASE-21483 [hbck2] version string checking should look for exactly the version we know doesn't work

3 years agoHBASE-21378 [hbck2] checkHBCKSupport blocks assigning hbase:meta or hbase:namespace...
tianjingyun [Sat, 27 Oct 2018 05:33:40 +0000 (13:33 +0800)] 
HBASE-21378 [hbck2] checkHBCKSupport blocks assigning hbase:meta or hbase:namespace when master is not initialized

3 years agoFix formatting error.
Michael Stack [Wed, 24 Oct 2018 21:27:37 +0000 (14:27 -0700)] 
Fix formatting error.

3 years agoAdd a building section.
Michael Stack [Wed, 24 Oct 2018 21:26:31 +0000 (14:26 -0700)] 
Add a building section.

3 years agoRemoved docs dirs. Don't seem to work in spite of INFRA-17171.
Michael Stack [Wed, 24 Oct 2018 00:48:13 +0000 (17:48 -0700)] 
Removed docs dirs. Don't seem to work in spite of INFRA-17171.

3 years agoPlaying w/ docs dir
Michael Stack [Wed, 24 Oct 2018 00:45:03 +0000 (17:45 -0700)] 
Playing w/ docs dir

3 years agoHBASE-21353 TestHBCKCommandLineParsing#testCommandWithOptions
Michael Stack [Tue, 23 Oct 2018 22:18:12 +0000 (15:18 -0700)] 
HBASE-21353 TestHBCKCommandLineParsing#testCommandWithOptions
hangs on call to HBCK2#checkHBCKSupport

3 years agoFormatting
Michael Stack [Tue, 23 Oct 2018 17:23:41 +0000 (10:23 -0700)] 

3 years agoFormatting
Michael Stack [Tue, 23 Oct 2018 17:20:55 +0000 (10:20 -0700)] 

3 years agoFormatting
Michael Stack [Tue, 23 Oct 2018 17:19:34 +0000 (10:19 -0700)] 

3 years agoMore doc on fixing
Michael Stack [Tue, 23 Oct 2018 17:17:46 +0000 (10:17 -0700)] 
More doc on fixing

3 years agoMore playing w/ gh-pages
Michael Stack [Tue, 23 Oct 2018 15:56:06 +0000 (08:56 -0700)] 
More playing w/ gh-pages

3 years agoPlaying w/ gh-pages
Michael Stack [Tue, 23 Oct 2018 15:52:08 +0000 (08:52 -0700)] 
Playing w/ gh-pages

3 years agoFix URLs; had wrong format
Michael Stack [Tue, 23 Oct 2018 06:31:34 +0000 (23:31 -0700)] 
Fix URLs; had wrong format

3 years agoAdd first cut at doc for hbck2
Michael Stack [Tue, 23 Oct 2018 06:25:56 +0000 (23:25 -0700)] 
Add first cut at doc for hbck2

3 years agoHBASE-21335 Change the default wait time of HBCK2 tool
jingyuntian [Thu, 18 Oct 2018 08:58:32 +0000 (16:58 +0800)] 
HBASE-21335 Change the default wait time of HBCK2 tool

Signed-off-by: Michael Stack <stack@apache.org>
3 years agoHBASE-21317 [hbck2] Add version, version handling, and
Michael Stack [Mon, 15 Oct 2018 14:35:50 +0000 (09:35 -0500)] 
HBASE-21317 [hbck2] Add version, version handling, and
misc override to assigns/unassigns

M hbase-hbck2/pom.xml
 Add handling of a hbck.properties file that gets bundle
 up in the jar. During build, interpolation adds version
 and git info via git-commit-id-plugin and filtering.

M hbase-hbck2/src/main/java/org/apache/hbase/HBCK2.java
 Add version emission. Add fail when we go against an hbase
 that does not support hbck2.

 Add assigns/unassigns override. Change 'force' on bypass
 to match. Add a recursive to bypass so if passed a parent
 it will find children and bypass them.

4 years agoHBASE-21210 Add bypassProcedure() API to HBCK2
Michael Stack [Thu, 20 Sep 2018 16:06:20 +0000 (09:06 -0700)] 
HBASE-21210 Add bypassProcedure() API to HBCK2

Amendment 2: Move where setTableState is listed in usage output.
Keep it alphabetical.

4 years agoHBASE-21210 Add bypassProcedure() API to HBCK2
Michael Stack [Thu, 20 Sep 2018 00:37:39 +0000 (17:37 -0700)] 
HBASE-21210 Add bypassProcedure() API to HBCK2

Addendum. Fix parse errors.

4 years agoHBASE-21210 Add bypassProcedure() API to HBCK2
Michael Stack [Wed, 19 Sep 2018 21:56:53 +0000 (14:56 -0700)] 
HBASE-21210 Add bypassProcedure() API to HBCK2

Adds a 'bypass' command that takes --force and
--waitTime options. First command that itself
has options.

4 years agoAdd assigns/unassigns operations. Add tests.
Michael Stack [Tue, 18 Sep 2018 21:37:26 +0000 (14:37 -0700)] 
Add assigns/unassigns operations. Add tests.

4 years agoAdd assigns/unassigns commands.
Michael Stack [Mon, 17 Sep 2018 21:29:32 +0000 (14:29 -0700)] 
Add assigns/unassigns commands.

Tests are disabled for the moment while figure issue with shaded client.

4 years agoFill out setTableStatus. Works against local cluster at least. Edit on poms
Michael Stack [Fri, 14 Sep 2018 22:26:11 +0000 (15:26 -0700)] 
Fill out setTableStatus. Works against local cluster at least. Edit on poms

4 years agoFront the hbck1 naming
Michael Stack [Fri, 14 Sep 2018 17:04:22 +0000 (10:04 -0700)] 
Front the hbck1 naming

4 years agoFix URL to subproject HBCK2
Michael Stack [Fri, 14 Sep 2018 17:00:58 +0000 (10:00 -0700)] 
Fix URL to subproject HBCK2

4 years agoAdd A.K.A hbck1 to hbck mention.
Michael Stack [Fri, 14 Sep 2018 16:59:05 +0000 (09:59 -0700)] 
Add A.K.A hbck1 to hbck mention.

4 years agoAdd pointer down to hbck2 sub-project. Add license and readme to hbck2
Michael Stack [Fri, 14 Sep 2018 16:57:37 +0000 (09:57 -0700)] 
Add pointer down to hbck2 sub-project. Add license and readme to hbck2

4 years agoAdd an HBCK2 tool. Add command-line processing for the one
Michael Stack [Fri, 14 Sep 2018 05:21:20 +0000 (22:21 -0700)] 
Add an HBCK2 tool. Add command-line processing for the one
call that is available in Hbck Service Interface currently.
More to come.

4 years agoFirst push: LICENSE, README, hbase-hbck2 module
Michael Stack [Fri, 3 Aug 2018 00:11:28 +0000 (17:11 -0700)] 
First push: LICENSE, README, hbase-hbck2 module