hbase-operator-tools.git
2 years agoRevert "HBCK takes one or more files for assigns (#62)" revert-62-HBASE-23927-no-format 63/head
huaxiangsun [Tue, 9 Jun 2020 22:19:37 +0000 (15:19 -0700)] 
Revert "HBCK takes one or more files for assigns (#62)"

This reverts commit aab25033ea6657a990b73bbc06ffe949c4a6282d.

2 years agoHBCK takes one or more files for assigns (#62)
clarax [Tue, 9 Jun 2020 16:27:07 +0000 (09:27 -0700)] 
HBCK takes one or more files for assigns (#62)

* HBCK takes one or more files for assigns

* include input file option commandline parsinging in test

* update test for assigns

Co-authored-by: Man Xiong <manxiong@MacBook-Pro.local>
2 years agoHBASE-24398 [hbase-operator-tools] Fix RegionsMerger ConcurrentModificationException #60
ChenKai [Tue, 19 May 2020 08:42:56 +0000 (16:42 +0800)] 
HBASE-24398 [hbase-operator-tools] Fix RegionsMerger ConcurrentModificationException #60

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2 years agoHBASE-24397 [hbase-operator-tools] Tool to Report on row sizes and column counts
stack [Mon, 18 May 2020 19:28:28 +0000 (12:28 -0700)] 
HBASE-24397 [hbase-operator-tools] Tool to Report on row sizes and column counts

Add tool that reads a table and produces histogram/quantiles of row size
and column count.

2 years agoHBASE-24261: Initial version of ASF infra integration configuration
Bharath Vissapragada [Wed, 6 May 2020 00:13:52 +0000 (17:13 -0700)] 
HBASE-24261: Initial version of ASF infra integration configuration

This is an initial version of the yaml config for ASF infra
integration. We might have some hiccups in the beginning but we
can iteratively improve until the old (desired) setup is back
in place.

2 years agoHBASE-24222 [HBCK2] Remove FSUtils.checkAccess and replace with FileSystem.access...
niuyulin [Fri, 1 May 2020 19:12:16 +0000 (14:12 -0500)] 
HBASE-24222 [HBCK2] Remove FSUtils.checkAccess and replace with FileSystem.access in hbase-operator-tools (#58)

Signed-off-by: niuyulin <niuyulin@xiaomi.com>
Signed-off-by: Sakthi <sakthi@apache.org>
2 years agoRevert "HBASE-24222 Remove FSUtils.checkAccess and replace with FileSystem.access...
Sakthi [Fri, 1 May 2020 19:25:14 +0000 (12:25 -0700)] 
Revert "HBASE-24222 Remove FSUtils.checkAccess and replace with FileSystem.access in hbase-operator-tools (#58)"

This reverts commit e6e54aa568271c68f03f6833bed1776c80fcc0cd.

2 years agoHBASE-24222 Remove FSUtils.checkAccess and replace with FileSystem.access in hbase...
niuyulin [Fri, 1 May 2020 19:12:16 +0000 (14:12 -0500)] 
HBASE-24222 Remove FSUtils.checkAccess and replace with FileSystem.access in hbase-operator-tools (#58)

Signed-off-by: niuyulin <niuyulin@xiaomi.com>
Signed-off-by: Sakthi <sakthi@apache.org>
2 years agoHBASE-24239 [HBCK2] Remove removeExtraRegionsFromMeta from README (#59)
Dice [Thu, 23 Apr 2020 10:30:38 +0000 (19:30 +0900)] 
HBASE-24239 [HBCK2] Remove removeExtraRegionsFromMeta from README (#59)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2 years agoRevert "Remove removeExtraRegionsFromMeta from README (#59)"
Wellington Chevreuil [Thu, 23 Apr 2020 10:32:19 +0000 (11:32 +0100)] 
Revert "Remove removeExtraRegionsFromMeta from README (#59)"

This reverts commit d92c16ae5cc94392c6076c750a62c47fe3d4efb5.

2 years agoRemove removeExtraRegionsFromMeta from README (#59)
Dice [Thu, 23 Apr 2020 10:30:38 +0000 (19:30 +0900)] 
Remove removeExtraRegionsFromMeta from README (#59)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2 years agoHBASE-24039 HBCK2 feature negotiation to check what commands are supported (#55)
richardantal [Thu, 16 Apr 2020 09:26:35 +0000 (11:26 +0200)] 
HBASE-24039 HBCK2 feature negotiation to check what commands are supported (#55)

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2 years agoHBASE-23562 [operator tools] Add a RegionsMerge tool that allows for merging multiple...
Wellington Chevreuil [Wed, 11 Dec 2019 14:33:13 +0000 (14:33 +0000)] 
HBASE-23562 [operator tools] Add a RegionsMerge tool that allows for merging multiple adjacent regions until a desired number of regions is reached.

Co-authored-by: BukrosSzabolcs <bukros.szabolcs@gmail.com>
Closes #56

Signed-off-by: Josh Elser <elserj@apache.org>
2 years agoHBASE-24116 Updated Apache POM to version 23 (#57)
Jan Hentschel [Mon, 6 Apr 2020 08:53:02 +0000 (10:53 +0200)] 
HBASE-24116 Updated Apache POM to version 23 (#57)

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2 years agoHBASE-23934 [operator tools] Add forbiddennapis plugin to pom.xml so that we can...
Wellington Ramos Chevreuil [Fri, 6 Mar 2020 10:27:40 +0000 (10:27 +0000)] 
HBASE-23934 [operator tools] Add forbiddennapis plugin to pom.xml so that we can permanently ban references to hbase I.A. private classes from hbck2 (#54)

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2 years agoHBASE-23791 [operator tools] Remove reference to I.A. Private interfa… (#53)
Wellington Ramos Chevreuil [Wed, 4 Mar 2020 16:28:25 +0000 (16:28 +0000)] 
HBASE-23791 [operator tools] Remove reference to I.A. Private interfa… (#53)

Signed-off-by: Josh Elser <elserj@apache.org>
2 years agoHBASE-23180 hbck2 testing tool (#47)
Sakthi [Tue, 28 Jan 2020 21:41:06 +0000 (13:41 -0800)] 
HBASE-23180 hbck2 testing tool (#47)

HBASE-23180 hbck2 testing tool

This adds a new tool that spins up a hbase on hadoop minicluster and
mimicks actions of hbck2 to verify it's functionalities

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2 years agoHBASE-23714 Updated to version 22 of the Apache parent POM
Jan Hentschel [Mon, 27 Jan 2020 12:02:05 +0000 (13:02 +0100)] 
HBASE-23714 Updated to version 22 of the Apache parent POM

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2 years agoHBASE-23371 [HBCK2] Provide client side method for removing ghost regions in meta...
Wellington Ramos Chevreuil [Mon, 27 Jan 2020 11:16:51 +0000 (11:16 +0000)] 
HBASE-23371 [HBCK2] Provide client side method for removing ghost regions in meta. (#45)

Signed-off-by: Josh Elser elserj@apache.org
2 years agoHBASE-23641 Use ReplicationPeerConfig.needToReplicate in HBaseFsck (#51)
Peter Somogyi [Wed, 8 Jan 2020 12:31:42 +0000 (13:31 +0100)] 
HBASE-23641 Use ReplicationPeerConfig.needToReplicate in HBaseFsck (#51)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2 years agoHBASE-23610 Updated Apache POM to version 21
Jan Hentschel [Tue, 24 Dec 2019 08:38:45 +0000 (09:38 +0100)] 
HBASE-23610 Updated Apache POM to version 21

https://github.com/apache/maven-apache-parent/compare/apache-18...apache-21

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-23609 Cleaned up tests
Jan Hentschel [Tue, 24 Dec 2019 08:32:28 +0000 (09:32 +0100)] 
HBASE-23609 Cleaned up tests

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-23611 Set version of maven-enforcer-plugin via property (#50)
Jan Hentschel [Mon, 23 Dec 2019 15:11:19 +0000 (16:11 +0100)] 
HBASE-23611 Set version of maven-enforcer-plugin via property (#50)

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2 years agoHBASE-23577 Bump checkstyle from 8.11 to 8.18
dependabot[bot] [Sat, 14 Dec 2019 19:17:36 +0000 (20:17 +0100)] 
HBASE-23577 Bump checkstyle from 8.11 to 8.18

Bumps [checkstyle](https://github.com/checkstyle/checkstyle) from 8.11 to 8.18.
- [Release notes](https://github.com/checkstyle/checkstyle/releases)
- [Commits](https://github.com/checkstyle/checkstyle/compare/checkstyle-8.11...checkstyle-8.18)

Signed-off-by: Jan Hentschel <janh@apache.org>
Signed-off-by: dependabot[bot] <support@github.com>
2 years agoHBASE-23256 fix hbck2 assigns/unassigns usage (#44)
YeChao Chen [Wed, 6 Nov 2019 10:10:10 +0000 (18:10 +0800)] 
HBASE-23256 fix hbck2 assigns/unassigns usage (#44)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2 years agoHBASE-23112 [hbase-operator-tools] fixMeta in hbck2 is porcelain, in hbck1 it was...
Michael Stack [Wed, 9 Oct 2019 15:53:17 +0000 (08:53 -0700)] 
HBASE-23112 [hbase-operator-tools] fixMeta in hbck2 is porcelain, in hbck1 it was plumbing; fix (#40)

Removed 'porcelain vs plubming' analogy. Its fine when we are talking
amongst ourselves but it confuses describing hbck2, a jumble of tools
doing various things.

Signed-off-by: Daisuke Kobayashi <poleon.kd@gmail.com>
2 years agoHBASE-23124 Remove commons-lang3 dependency (#41)
Peter Somogyi [Mon, 7 Oct 2019 06:18:53 +0000 (08:18 +0200)] 
HBASE-23124 Remove commons-lang3 dependency (#41)

Signed-off-by: Michael Stack <stack@apache.org>
2 years agoHBASE-23031 Upgrade Yetus version in RM scripts
Frederick Ayala [Sun, 6 Oct 2019 08:29:46 +0000 (11:29 +0300)] 
HBASE-23031 Upgrade Yetus version in RM scripts

2 years agoHBASE-23109 Fix checkstyle issues (#39)
Peter Somogyi [Wed, 2 Oct 2019 19:10:36 +0000 (21:10 +0200)] 
HBASE-23109 Fix checkstyle issues (#39)

Signed-off-by: Sean Busbey <busbey@apache.org>
2 years agoMove version to 1.1.0-SNAPSHOT (#38)
Peter Somogyi [Wed, 25 Sep 2019 12:52:52 +0000 (14:52 +0200)] 
Move version to 1.1.0-SNAPSHOT (#38)

2 years agoPreparing development version 1.0.0-SNAPSHOT
Peter Somogyi [Fri, 20 Sep 2019 14:50:58 +0000 (14:50 +0000)] 
Preparing development version 1.0.0-SNAPSHOT

2 years agoPreparing hbase-operator-tools release 1.0.0RC1; tagging and updates to CHANGES.md... 1.0.0RC1 rel/1.0.0
Peter Somogyi [Fri, 20 Sep 2019 14:50:53 +0000 (14:50 +0000)] 
Preparing hbase-operator-tools release 1.0.0RC1; tagging and updates to CHANGES.md and RELEASENOTES.md

2 years agoHBASE-23057 Add commons-lang3 dependency to HBCK2 (#37)
Peter Somogyi [Fri, 20 Sep 2019 10:04:47 +0000 (12:04 +0200)] 
HBASE-23057 Add commons-lang3 dependency to HBCK2 (#37)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2 years agoHBASE-23039 HBCK2 bypass -r command does not work
meiyi [Wed, 18 Sep 2019 01:41:47 +0000 (09:41 +0800)] 
HBASE-23039 HBCK2 bypass -r command does not work

2 years agoPreparing development version 1.0.0-SNAPSHOT
Peter Somogyi [Mon, 16 Sep 2019 17:59:14 +0000 (17:59 +0000)] 
Preparing development version 1.0.0-SNAPSHOT

2 years agoPreparing hbase-operator-tools release 1.0.0RC0; tagging and updates to CHANGES.md... 1.0.0RC0
Peter Somogyi [Mon, 16 Sep 2019 17:59:09 +0000 (17:59 +0000)] 
Preparing hbase-operator-tools release 1.0.0RC0; tagging and updates to CHANGES.md and RELEASENOTES.md

2 years agoHBASE-23033 Do not run git-commit-id-plugin when .git is missing (#36)
Peter Somogyi [Mon, 16 Sep 2019 17:31:42 +0000 (19:31 +0200)] 
HBASE-23033 Do not run git-commit-id-plugin when .git is missing (#36)

Signed-off-by: Michael Stack <stack@apache.org>
2 years agoPreparing development version 1.0.0-SNAPSHOT
Peter Somogyi [Mon, 16 Sep 2019 15:38:32 +0000 (15:38 +0000)] 
Preparing development version 1.0.0-SNAPSHOT

2 years agoPreparing hbase-operator-tools release 1.0.0RC0; tagging and updates to CHANGES.md...
Peter Somogyi [Mon, 16 Sep 2019 15:38:27 +0000 (15:38 +0000)] 
Preparing hbase-operator-tools release 1.0.0RC0; tagging and updates to CHANGES.md and RELEASENOTES.md

2 years agoHBASE-23029 Handle hbase-operator-tools releasenotes in release making script (#35)
Peter Somogyi [Mon, 16 Sep 2019 13:50:32 +0000 (15:50 +0200)] 
HBASE-23029 Handle hbase-operator-tools releasenotes in release making script (#35)

Remove duplicated entries from currently available RELEASENOTES.md

Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
2 years agoHBASE-23026 docker run command should not quote JAVA_VOL (#34)
Peter Somogyi [Mon, 16 Sep 2019 13:49:49 +0000 (15:49 +0200)] 
HBASE-23026 docker run command should not quote JAVA_VOL (#34)

Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
2 years agoHBASE-23025 Do not quote GPG command (#33)
Peter Somogyi [Sun, 15 Sep 2019 19:17:03 +0000 (21:17 +0200)] 
HBASE-23025 Do not quote GPG command (#33)

Signed-off-by: Sean Busbey <busbey@apache.org>
2 years agoHBASE-23021 [hbase-operator-tools] README edits in prep for release
stack [Fri, 13 Sep 2019 16:01:37 +0000 (09:01 -0700)] 
HBASE-23021 [hbase-operator-tools] README edits in prep for release

Main changes:

 * Underline how hbck1 differs from hbck2 and hbck2 philosophy.
 * Make entry and section transitions ore palatable.
 * Try to talk up repair process. Explain fix hbase:meta first and then
 everything else. Bulk up general rules.

2 years agoHBASE-23003 [HBCK2/hbase-operator-tools] Release-making scripts
stack [Fri, 13 Sep 2019 16:23:43 +0000 (09:23 -0700)] 
HBASE-23003 [HBCK2/hbase-operator-tools] Release-making scripts

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2 years agoHBASE-23002 [HBCK2/hbase-operator-tools] Create an assembly that builds an hbase...
Michael Stack [Fri, 13 Sep 2019 16:02:42 +0000 (09:02 -0700)] 
HBASE-23002 [HBCK2/hbase-operator-tools] Create an assembly that builds an hbase-operator-tools tgz (#30)

Add an hbase-assembly that is just for creating assemblies.
Also changed groupid from org.apache.hbase to
org.apache.hbase.operator.tools so lands into a different area in
repository -- less crowded, easier to differentiate from core
hbase.

Creates a bin assembly (src is made elsewhere in release script).
Adds a first-cut at RELEASENOTES and CHANGES (release script will
fix up what is here based off what is in JIRA to make it suit
the 1.0.0RC0)

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2 years agoHBASE-23018 - [HBCK2] Add useful messages when report/fixing missing regions in meta...
Dice [Fri, 13 Sep 2019 07:03:24 +0000 (16:03 +0900)] 
HBASE-23018 - [HBCK2] Add useful messages when report/fixing missing regions in meta (#31)

Signed-off-by: Michael Stack <stack@apache.org>
2 years agoHBASE-22999 Fix non-varargs compile warnings (#27)
Wellington Ramos Chevreuil [Tue, 10 Sep 2019 14:57:11 +0000 (16:57 +0200)] 
HBASE-22999 Fix non-varargs compile warnings (#27)

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2 years agoHBASE-22997 Move to SLF4J (#25)
Peter Somogyi [Tue, 10 Sep 2019 06:34:52 +0000 (08:34 +0200)] 
HBASE-22997 Move to SLF4J (#25)

Signed-off-by: Michael Stack <stack@apache.org>
2 years agoHBASE-22998 Fix NOTICE and LICENSE (#26)
Peter Somogyi [Mon, 9 Sep 2019 16:55:25 +0000 (18:55 +0200)] 
HBASE-22998 Fix NOTICE and LICENSE (#26)

Signed-off-by: Sean Busbey <busbey@apache.org>
2 years agoHBASE-22567 [HBCK2] Add new methods for dealing with missing regions in META while...
Wellington Chevreuil [Fri, 6 Sep 2019 14:23:00 +0000 (15:23 +0100)] 
HBASE-22567 [HBCK2] Add new methods for dealing with missing regions in META while Master is online

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-22984 [HBCK2] HBCKMetaTableAccessor.deleteFromMetaTable throwing java.lang...
Wellington Ramos Chevreuil [Fri, 6 Sep 2019 16:51:03 +0000 (17:51 +0100)] 
HBASE-22984 [HBCK2] HBCKMetaTableAccessor.deleteFromMetaTable throwing java.lang.UnsupportedOperationException at runtime (#24)

Signed-off-by: Sean Busbey <busbey@apache.org>
2 years agoHBASE-22825 addendum Fix invalid function call (from usage to showErrorMessage) ...
Fabrice [Fri, 6 Sep 2019 05:01:04 +0000 (22:01 -0700)] 
HBASE-22825 addendum Fix invalid function call (from usage to showErrorMessage) (#23)

Signed-off-by: Sean Busbey <busbey@apache.org>
2 years agoHBASE-22859 [HBCK2] Fix the orphan regions on filesystem
stack [Thu, 5 Sep 2019 22:28:58 +0000 (15:28 -0700)] 
HBASE-22859 [HBCK2] Fix the orphan regions on filesystem

An edit to remove --internal-classpath recommendation (it doesn't
work) and to point at the new doc on how to fix orphan regions
using the bulkloadcomplet tool over in the refguide.

2 years agoHBASE-22825 [HBCK2] Add a client-side to hbase-operator-tools that can exploit fixMet...
Sakthi [Thu, 5 Sep 2019 22:41:36 +0000 (15:41 -0700)] 
HBASE-22825 [HBCK2] Add a client-side to hbase-operator-tools that can exploit fixMeta added in server side Fix review comments - Put FixMeta alphabetically Signed-off-by: Sean Busbey <busbey@apache.org> Signed-off-by: stack <stack@apache.org>

2 years agoHBASE-22951 [HBCK2] hbase hbck throws IOE "No FileSystem for scheme: hdfs" (#22)
Michael Stack [Wed, 4 Sep 2019 04:38:44 +0000 (21:38 -0700)] 
HBASE-22951 [HBCK2] hbase hbck throws IOE "No FileSystem for scheme: hdfs" (#22)

Add note on how to add hdfs jars when running filesystem command.
Make note of new 'HBCK Report'. Did general edit.

2 years agoHBASE-22952 HBCK2 replication command is incompatible with 2.0.x (#20)
Peter Somogyi [Mon, 2 Sep 2019 07:54:05 +0000 (09:54 +0200)] 
HBASE-22952 HBCK2 replication command is incompatible with 2.0.x (#20)

Signed-off-by: Michael Stack <stack@apache.org>
2 years agoHBASE-22957 [HBCK2] reference file check fails if compiled with old v… (#21)
Michael Stack [Sun, 1 Sep 2019 05:02:09 +0000 (22:02 -0700)] 
HBASE-22957 [HBCK2] reference file check fails if compiled with old v… (#21)

* HBASE-22957 [HBCK2] reference file check fails if compiled with old version but check against new

Move local methods from FSUtils that are used only by hbck1 AND
whose signature was changed in hbase2 minor versions causing
breakage if compiled w/ old version and run w/ a newer hbase
(or vice versa).

* Fix checkstyle complaint

2 years agoHBASE-22949 [HBCK2] Add lang3 as explicit dependency (#19)
Michael Stack [Thu, 29 Aug 2019 23:04:57 +0000 (16:04 -0700)] 
HBASE-22949 [HBCK2] Add lang3 as explicit dependency (#19)

2 years agoHBASE-22906 Clean up checkstyle complaints in hbase-operator-tools (#17)
Sean Busbey [Fri, 23 Aug 2019 14:47:08 +0000 (09:47 -0500)] 
HBASE-22906 Clean up checkstyle complaints in hbase-operator-tools (#17)

Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2 years agoHBASE-22691 Moved Checkstyle suppression file to a different location
Jan Hentschel [Sun, 14 Jul 2019 16:24:52 +0000 (18:24 +0200)] 
HBASE-22691 Moved Checkstyle suppression file to a different location

Signed-off-by: Sean Busbey <busbey@apache.org>
2 years agoHBASE-22865 [HBCK2] shows the whole help/usage message after the error message (#15)
Sakthi [Tue, 20 Aug 2019 21:21:47 +0000 (14:21 -0700)] 
HBASE-22865 [HBCK2] shows the whole help/usage message after the error message (#15)

Signed-off-by: Sean Busbey <busbey@apache.org>
2 years agoHBASE-22843 [HBCK2] Add HBCKMetaTableAccessor for hbck2
Sakthi [Thu, 15 Aug 2019 20:00:47 +0000 (13:00 -0700)] 
HBASE-22843 [HBCK2] Add HBCKMetaTableAccessor for hbck2

- A fix after HBASE-22777 & HBASE-22758

Signed-off-by: Stack <stack@apache.org>
2 years agoHBASE-22717 [HBCK2] Expose replication fixes from hbck1 (#13)
Michael Stack [Fri, 19 Jul 2019 22:44:02 +0000 (15:44 -0700)] 
HBASE-22717 [HBCK2] Expose replication fixes from hbck1 (#13)

* HBASE-22717 [HBCK2] Expose replication fixes from hbck1

Finds undeleted queues and replication barriers. Removes
them if --fix is passed.

2 years agoHBASE-22713 [HBCK2] Add hdfs integrity report to 'filesystem' command (#12)
Michael Stack [Fri, 19 Jul 2019 00:14:32 +0000 (17:14 -0700)] 
HBASE-22713 [HBCK2] Add hdfs integrity report to 'filesystem' command (#12)

Add check of hdfs 'integrity'. Produces report.

Fix a bug where we'd not run filesystem command.

Cleanup filesystem output to be more explicit
about what it does.

2 years agoHBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService (#11)
Michael Stack [Thu, 18 Jul 2019 15:26:40 +0000 (08:26 -0700)] 
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService (#11)

* HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService

Adds server version check so we fail fast and complain if remote
server does not support feature.

Refactor so we test server version before we use feature/command.

Named feature scheduleRecoveries

Add a new Version class that has Version math and check in it.

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2 years agoHBASE-22688 [HBCK2] Add filesystem fixup to hbck2 (#10)
Michael Stack [Tue, 16 Jul 2019 18:39:32 +0000 (11:39 -0700)] 
HBASE-22688 [HBCK2] Add filesystem fixup to hbck2 (#10)

* HBASE-22688 [HBCK2] Add filesystem fixup to hbck2

Adds a general filesystem check command to the HBCK2 list.
Runs just the offline filesystem checks from the old hbck1
HBaseFsck tool. Checks hfile validity, if references and
hfile links are wholesome, and whether the hbase.version
file is present. Pass '--fix' to do fixup.

Depends on hbck1 HBaseFsck being present in hbck2
(HBASE-22680 adds it so this could go in after it)

Does NOT do regiondir or tabledir fixup or fixing of
orphans in hdfs or plugging holes in hdfs.

A hbase-hbck2/src/main/java/org/apache/hbase/FileSystemFsck.java
 Adds a file to handle filesystem fsck checking and fixing.

M hbase-hbck2/src/main/java/org/apache/hbase/hbck1/HFileCorruptionChecker.java
 Formatting fixes and filling out the MOB report so like the hfile
 report.

Signed-off-by: Sean Busbey <busbey@apache.org>
* Fix checkstyle

* More checkstyle fixes

2 years agoHBASE-22680 [HBCK2] OfflineMetaRepair for hbase2/hbck2 (#6)
Michael Stack [Tue, 16 Jul 2019 17:06:41 +0000 (10:06 -0700)] 
HBASE-22680 [HBCK2] OfflineMetaRepair for hbase2/hbck2 (#6)

This commit checks-in hbck1 code with modifications under
a new package. Changes included here allow rebuild of meta
from filesystem meta data so the rebuilt hbase:meta works
for hbase2. This facility is exposed via the OfflineMetaRepair
tool with rebuild receipe outlined in the README documentation.
More of hbck1 to be exposed (or removed) in future commits to
address list of wants in parent issue HBASE-21745.

M README.md
 Updated usage. Edit of aspects. Added section on end on how
 to rebuild meta offline.

M pom.xml
 Use hbase testing utility code instead of repro in
 hbck as hbck1 used to do.

M hbase-hbck2/src/main/java/org/apache/hbase/HBCK2.java
 Updated the usage.

A hbase-hbck2/src/main/java/org/apache/hbase/hbck1/HBaseFsck.java
 Remove main from hbck1 fsck so HBaseFsck not directly accessible.
A hbase-hbck2/src/main/java/org/apache/hbase/hbck1/HBaseFsckRepair.java
 Copied from hbck1 and updated to work against hbase2.
 Most goes unused. Subsequent commits will amend/expose/purge
 this class. For now the rebuild meta function is all that is
 used. Some new code added to make it work with hbase2.
 Some code removed and hbasetestingutility equivalents used
 instead.

A hbase-hbck2/src/main/java/org/apache/hbase/hbck1/HFileCorruptionChecker.java
A hbase-hbck2/src/main/java/org/apache/hbase/hbck1/ReplicationChecker.java
A hbase-hbck2/src/main/java/org/apache/hbase/hbck1/TableIntegrityErrorHandler.java
A hbase-hbck2/src/main/java/org/apache/hbase/hbck1/TableIntegrityErrorHandlerImpl.java
 Unmodified except for repackaging.

A hbase-hbck2/src/main/java/org/apache/hbase/hbck1/OfflineMetaRepair.java
 Tool that exposes meta fixup. Some cleanup from original.

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2 years agoHBASE-22675 Use the commons-cli from hbase-thirdparty
Josh Elser [Wed, 10 Jul 2019 15:09:23 +0000 (11:09 -0400)] 
HBASE-22675 Use the commons-cli from hbase-thirdparty

Should work with any hbase-thirdparty >=2.1.0 and increases
compatibility scope for HBCK2 to more HBase releases.

Closes #4

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-22687 Added HBase Checkstyle configuration to the project
Jan Hentschel [Sun, 14 Jul 2019 16:10:35 +0000 (18:10 +0200)] 
HBASE-22687 Added HBase Checkstyle configuration to the project

Signed-off-by: stack <stack@apache.org>
2 years agoHBASE-22674 precommit docker image installs JRE over JDK (#7)
Sean Busbey [Fri, 12 Jul 2019 05:24:07 +0000 (00:24 -0500)] 
HBASE-22674 precommit docker image installs JRE over JDK (#7)

* remove findbugs because it pulls in a JRE
* remove bats because we don't use it.

3 years agoHBASE-22183 [hbck2] Update hbck2 README to explain new setRegionState method.
Wellington Chevreuil [Mon, 10 Jun 2019 09:43:40 +0000 (10:43 +0100)] 
HBASE-22183 [hbck2] Update hbck2 README to explain new setRegionState method.

3 years agoHBASE-21763 [HBCK2] hbck2 options does not work and throws exceptions
Syeda [Thu, 7 Mar 2019 11:09:27 +0000 (16:39 +0530)] 
HBASE-21763 [HBCK2] hbck2 options does not work and throws exceptions

Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
3 years agoHBASE-22143 - HBCK2 setRegionState command
Wellington Chevreuil [Mon, 1 Apr 2019 14:49:39 +0000 (15:49 +0100)] 
HBASE-22143 - HBCK2 setRegionState command

Signed-off-by: Josh Elser <elserj@apache.org>
3 years agoHBASE-21433 Add Apache Yetus integration for hbase-operator-tools repository
Peter Somogyi [Thu, 28 Feb 2019 19:34:23 +0000 (20:34 +0100)] 
HBASE-21433 Add Apache Yetus integration for hbase-operator-tools repository

3 years agoHBASE-21484 [hbck2] hbck2 should default to a released hbase version
Sean Busbey [Thu, 15 Nov 2018 22:47:32 +0000 (16:47 -0600)] 
HBASE-21484 [hbck2] hbck2 should default to a released hbase version

3 years agoHBASE-21483 [hbck2] version string checking should look for exactly the version we...
Sean Busbey [Thu, 15 Nov 2018 22:45:13 +0000 (16:45 -0600)] 
HBASE-21483 [hbck2] version string checking should look for exactly the version we know doesn't work

3 years agoHBASE-21378 [hbck2] checkHBCKSupport blocks assigning hbase:meta or hbase:namespace...
tianjingyun [Sat, 27 Oct 2018 05:33:40 +0000 (13:33 +0800)] 
HBASE-21378 [hbck2] checkHBCKSupport blocks assigning hbase:meta or hbase:namespace when master is not initialized

3 years agoFix formatting error.
Michael Stack [Wed, 24 Oct 2018 21:27:37 +0000 (14:27 -0700)] 
Fix formatting error.

3 years agoAdd a building section.
Michael Stack [Wed, 24 Oct 2018 21:26:31 +0000 (14:26 -0700)] 
Add a building section.

3 years agoRemoved docs dirs. Don't seem to work in spite of INFRA-17171.
Michael Stack [Wed, 24 Oct 2018 00:48:13 +0000 (17:48 -0700)] 
Removed docs dirs. Don't seem to work in spite of INFRA-17171.

3 years agoPlaying w/ docs dir
Michael Stack [Wed, 24 Oct 2018 00:45:03 +0000 (17:45 -0700)] 
Playing w/ docs dir

3 years agoHBASE-21353 TestHBCKCommandLineParsing#testCommandWithOptions
Michael Stack [Tue, 23 Oct 2018 22:18:12 +0000 (15:18 -0700)] 
HBASE-21353 TestHBCKCommandLineParsing#testCommandWithOptions
hangs on call to HBCK2#checkHBCKSupport

3 years agoFormatting
Michael Stack [Tue, 23 Oct 2018 17:23:41 +0000 (10:23 -0700)] 
Formatting

3 years agoFormatting
Michael Stack [Tue, 23 Oct 2018 17:20:55 +0000 (10:20 -0700)] 
Formatting

3 years agoFormatting
Michael Stack [Tue, 23 Oct 2018 17:19:34 +0000 (10:19 -0700)] 
Formatting

3 years agoMore doc on fixing
Michael Stack [Tue, 23 Oct 2018 17:17:46 +0000 (10:17 -0700)] 
More doc on fixing

3 years agoMore playing w/ gh-pages
Michael Stack [Tue, 23 Oct 2018 15:56:06 +0000 (08:56 -0700)] 
More playing w/ gh-pages

3 years agoPlaying w/ gh-pages
Michael Stack [Tue, 23 Oct 2018 15:52:08 +0000 (08:52 -0700)] 
Playing w/ gh-pages

3 years agoFix URLs; had wrong format
Michael Stack [Tue, 23 Oct 2018 06:31:34 +0000 (23:31 -0700)] 
Fix URLs; had wrong format

3 years agoAdd first cut at doc for hbck2
Michael Stack [Tue, 23 Oct 2018 06:25:56 +0000 (23:25 -0700)] 
Add first cut at doc for hbck2

3 years agoHBASE-21335 Change the default wait time of HBCK2 tool
jingyuntian [Thu, 18 Oct 2018 08:58:32 +0000 (16:58 +0800)] 
HBASE-21335 Change the default wait time of HBCK2 tool

Signed-off-by: Michael Stack <stack@apache.org>
3 years agoHBASE-21317 [hbck2] Add version, version handling, and
Michael Stack [Mon, 15 Oct 2018 14:35:50 +0000 (09:35 -0500)] 
HBASE-21317 [hbck2] Add version, version handling, and
misc override to assigns/unassigns

M hbase-hbck2/pom.xml
 Add handling of a hbck.properties file that gets bundle
 up in the jar. During build, interpolation adds version
 and git info via git-commit-id-plugin and filtering.

M hbase-hbck2/src/main/java/org/apache/hbase/HBCK2.java
 Add version emission. Add fail when we go against an hbase
 that does not support hbck2.

 Add assigns/unassigns override. Change 'force' on bypass
 to match. Add a recursive to bypass so if passed a parent
 it will find children and bypass them.

3 years agoHBASE-21210 Add bypassProcedure() API to HBCK2
Michael Stack [Thu, 20 Sep 2018 16:06:20 +0000 (09:06 -0700)] 
HBASE-21210 Add bypassProcedure() API to HBCK2

Amendment 2: Move where setTableState is listed in usage output.
Keep it alphabetical.

3 years agoHBASE-21210 Add bypassProcedure() API to HBCK2
Michael Stack [Thu, 20 Sep 2018 00:37:39 +0000 (17:37 -0700)] 
HBASE-21210 Add bypassProcedure() API to HBCK2

Addendum. Fix parse errors.

3 years agoHBASE-21210 Add bypassProcedure() API to HBCK2
Michael Stack [Wed, 19 Sep 2018 21:56:53 +0000 (14:56 -0700)] 
HBASE-21210 Add bypassProcedure() API to HBCK2

Adds a 'bypass' command that takes --force and
--waitTime options. First command that itself
has options.

3 years agoAdd assigns/unassigns operations. Add tests.
Michael Stack [Tue, 18 Sep 2018 21:37:26 +0000 (14:37 -0700)] 
Add assigns/unassigns operations. Add tests.

3 years agoAdd assigns/unassigns commands.
Michael Stack [Mon, 17 Sep 2018 21:29:32 +0000 (14:29 -0700)] 
Add assigns/unassigns commands.

Tests are disabled for the moment while figure issue with shaded client.

3 years agoFill out setTableStatus. Works against local cluster at least. Edit on poms
Michael Stack [Fri, 14 Sep 2018 22:26:11 +0000 (15:26 -0700)] 
Fill out setTableStatus. Works against local cluster at least. Edit on poms

3 years agoFront the hbck1 naming
Michael Stack [Fri, 14 Sep 2018 17:04:22 +0000 (10:04 -0700)] 
Front the hbck1 naming

3 years agoFix URL to subproject HBCK2
Michael Stack [Fri, 14 Sep 2018 17:00:58 +0000 (10:00 -0700)] 
Fix URL to subproject HBCK2