accumulo.git
5 years ago[maven-release-plugin] prepare release rel/1.8.0 rel/1.8.0
Michael Wall [Fri, 2 Sep 2016 16:48:57 +0000 (16:48 +0000)] 
[maven-release-plugin] prepare release rel/1.8.0

5 years agoACCUMULO-4443 Make PerformanceTests group consistent
Christopher Tubbs [Thu, 1 Sep 2016 21:45:50 +0000 (17:45 -0400)] 
ACCUMULO-4443 Make PerformanceTests group consistent

Make PerformanceTests JUnit test category consistent with other test
categories. This includes execution by default with `mvn verify`.
Updated TESTING.md documentation to reflect the change.

5 years agoACCUMULO-4445 Fix broken bin/accumulo script
Christopher Tubbs [Thu, 1 Sep 2016 20:22:15 +0000 (16:22 -0400)] 
ACCUMULO-4445 Fix broken bin/accumulo script

More strictly check that the first argument is a tserver-NNNN pattern
before setting up INSTANCE_OPTS for multiple tablet servers. This fixes
breakage of other commands which simply include a dash(-) character.

5 years agoMerge branch '1.7' into 1.8
Christopher Tubbs [Thu, 1 Sep 2016 18:46:40 +0000 (14:46 -0400)] 
Merge branch '1.7' into 1.8

5 years agoACCUMULO-4437 Annotate remaining ITs
Christopher Tubbs [Wed, 31 Aug 2016 23:13:24 +0000 (19:13 -0400)] 
ACCUMULO-4437 Annotate remaining ITs

* Annotate CyclicReplcationIT and AccumuloOutputFormatIT as
  MiniClusterOnlyTests
* Rename test categories to reflect explicit intentions, based on
  conversation in JIRA
* Minor grammatical change: make category names plural (the category
  describes a set of tests)

5 years agoACCUMULO-4440 Fix JUnit 4.12 deprecation warning
Christopher Tubbs [Wed, 31 Aug 2016 23:12:18 +0000 (19:12 -0400)] 
ACCUMULO-4440 Fix JUnit 4.12 deprecation warning

Use TimeUnit-based constructor instead of implicit millis for Timeout
rule.

5 years agoACCUMULO-4439 Create SunnyDayTest category
Christopher Tubbs [Wed, 31 Aug 2016 23:10:38 +0000 (19:10 -0400)] 
ACCUMULO-4439 Create SunnyDayTest category

5 years agoACCUMULO-4423 Simplify use of JUnit categories
Christopher Tubbs [Wed, 31 Aug 2016 22:04:32 +0000 (18:04 -0400)] 
ACCUMULO-4423 Simplify use of JUnit categories

* Create surefire.groups, surefire.excludedGroups, failsafe.groups, and
  failsafe.excludedGroups to control categories, based on feedback from
  Maven developers about what to expect these property names to be in
  maven-surefire-plugin and maven-failsafe-plugin version 3.0
* Remove intermediate property names, which added unneeded level of
  property indirection (under assumption that we'll keep these
  categories stable over time, in order to keep the docs valid)
* Remove unneeded profiles
* Update documentation

5 years agoACCUMULO-4438 Skip failsafe groups in maven-plugin
Christopher Tubbs [Wed, 31 Aug 2016 22:03:30 +0000 (18:03 -0400)] 
ACCUMULO-4438 Skip failsafe groups in maven-plugin

In the accumulo-maven-plugin's own IT, override the parent POM
maven-failsafe-plugin configuration to explicitly skip the
groups/excludeGroups properties. This forces the accumulo-maven-plugin
IT to run at the integration-tests phase, since it doesn't use JUnit
categories.

5 years agoACCUMULO-4434 Reduce stringency on success condition for CompactionRateLimitingIT
Josh Elser [Wed, 31 Aug 2016 22:46:49 +0000 (18:46 -0400)] 
ACCUMULO-4434 Reduce stringency on success condition for CompactionRateLimitingIT

The guava RateLimiter implementation is bursty and causes
this test to fail.

5 years agoMerge branch '1.7' into 1.8
Josh Elser [Wed, 31 Aug 2016 21:13:16 +0000 (17:13 -0400)] 
Merge branch '1.7' into 1.8

5 years agoACCUMULO-4436 Make sure that all processes get tagged for cleanup that are executed...
Josh Elser [Wed, 31 Aug 2016 17:45:21 +0000 (13:45 -0400)] 
ACCUMULO-4436 Make sure that all processes get tagged for cleanup that are executed via MAC

5 years agoMerge branch '1.7' into 1.8
Josh Elser [Wed, 31 Aug 2016 19:22:20 +0000 (15:22 -0400)] 
Merge branch '1.7' into 1.8

5 years agoACCUMULO-4428 Stabilize the new GarbageCollectorIT
Josh Elser [Wed, 31 Aug 2016 19:13:23 +0000 (15:13 -0400)] 
ACCUMULO-4428 Stabilize the new GarbageCollectorIT

Use the clusterControl on MAC to alter the state. Make
the verification based on the filesystem instead of log
messages from the GC.

5 years agoACCUMULO-4428 Fix state of GC firstSeenDead map
Adam J. Shook [Wed, 31 Aug 2016 17:45:59 +0000 (13:45 -0400)] 
ACCUMULO-4428 Fix state of GC firstSeenDead map

The GC's map of host->timestamp is used to track when it has first seen
a dead tserver, however a new instance of GarbageCollectWriteAheadLogs
is used during each cycle of the GC.  The state information is lost.
The state is now managed by SimpleGarbageCollector, passing this state
into each cycle of the GCWriteAheadLogs class.

Closes apache/accumulo#143

Signed-off-by: Josh Elser <elserj@apache.org>
5 years agoMerge branch '1.7' into 1.8
Josh Elser [Wed, 31 Aug 2016 04:00:44 +0000 (00:00 -0400)] 
Merge branch '1.7' into 1.8

5 years agoACCUMULO-4423 Annotate integration tests with categories
Josh Elser [Tue, 30 Aug 2016 20:23:48 +0000 (16:23 -0400)] 
ACCUMULO-4423 Annotate integration tests with categories

Differentiates tests which always use a minicluster and those
which can use a minicluster or a standalone cluster. Out-of-the-box
test invocation should not have changed.

Includes updated documentation to TESTING.md as well.

Closes apache/accumulo#144

5 years agoACCUMULO-4425 Fix VolumeIT.testDirtyReplaceVolumes
Christopher Tubbs [Fri, 26 Aug 2016 23:22:42 +0000 (19:22 -0400)] 
ACCUMULO-4425 Fix VolumeIT.testDirtyReplaceVolumes

Retry checking WAL state information in ZooKeeper until it stabilizes,
or until the test times out. Handle the case where the ZK node is
removed underneath the WalStateManager and the case where the state
hasn't yet been updated by the time the test checks it.

Closes apache/accumulo#142

Signed-off-by: Josh Elser <elserj@apache.org>
5 years agoMerge branch '1.7' into 1.8
Sean Busbey [Sat, 27 Aug 2016 00:23:13 +0000 (19:23 -0500)] 
Merge branch '1.7' into 1.8

5 years agoACCUMULO-4421 Ensure that TraceServer launches the Kerberos ticket renewal thread
Josh Elser [Fri, 26 Aug 2016 21:33:42 +0000 (17:33 -0400)] 
ACCUMULO-4421 Ensure that TraceServer launches the Kerberos ticket renewal thread

The previous method that TraceServer was using on SecurityUtil
only performed the login and was relying on incorrect functionality
in Hadoop's UGI to launch a renewal thread. This logic is incorrect.
Refactored SecurityUtil a little to prevent other callers from
making the same mistake in the future.

Signed-off-by: Sean Busbey <busbey@cloudera.com>
5 years agoACCUMULO-4421 Check if the Trace User is expected to use Kerberos before attempting...
Sean Busbey [Thu, 25 Aug 2016 19:47:38 +0000 (14:47 -0500)] 
ACCUMULO-4421 Check if the Trace User is expected to use Kerberos before attempting to login to Kerberos as the trace user.

Signed-off-by: Josh Elser <elserj@apache.org>
5 years agoACCUMULO-4013 Remove new trivial warnings
Christopher Tubbs [Fri, 26 Aug 2016 20:25:49 +0000 (16:25 -0400)] 
ACCUMULO-4013 Remove new trivial warnings

Remove some redundant type args

5 years agoMerge branch 'pr-141' into 1.8
Christopher Tubbs [Fri, 26 Aug 2016 18:28:39 +0000 (14:28 -0400)] 
Merge branch 'pr-141' into 1.8

5 years agoACCUMULO-3948 Prevent test jar from being deployed
Christopher Tubbs [Fri, 26 Aug 2016 18:20:45 +0000 (14:20 -0400)] 
ACCUMULO-3948 Prevent test jar from being deployed

Use maven-assembly-plugin to create test jar instead of
maven-jar-plugin, which attaches the jar for deployment.

Moves creation of the plugin to earlier phase of the build
(ACCUMULO-4058).

Prefer the use of the maven build directory over the system temp
directory for temporary files.

5 years agoMerge branch '1.7' into 1.8
Josh Elser [Fri, 26 Aug 2016 17:24:39 +0000 (13:24 -0400)] 
Merge branch '1.7' into 1.8

5 years agoACCUMULO-4426 Lift MR-IT instructions to TESTING.md
Josh Elser [Fri, 26 Aug 2016 15:03:23 +0000 (11:03 -0400)] 
ACCUMULO-4426 Lift MR-IT instructions to TESTING.md

5 years agoMerge remote-tracking branch 'origin/1.7' into 1.8
Josh Elser [Fri, 26 Aug 2016 14:54:16 +0000 (10:54 -0400)] 
Merge remote-tracking branch 'origin/1.7' into 1.8

5 years agoACCUMULO-1055: changes for DFM to read TABLE_MINC_MAX_MERGE_FILE_SIZE in reserve... 141/head
Mike Miller [Thu, 25 Aug 2016 19:39:53 +0000 (15:39 -0400)] 
ACCUMULO-1055: changes for DFM to read TABLE_MINC_MAX_MERGE_FILE_SIZE in reserve method

5 years agoACCUMULO-4414 Decrease log level on vestigal debug information
Josh Elser [Thu, 25 Aug 2016 18:12:49 +0000 (14:12 -0400)] 
ACCUMULO-4414 Decrease log level on vestigal debug information

5 years agoACCUMULO-1055: made default for max MINC merge file size 0
milleruntime [Wed, 24 Aug 2016 17:53:48 +0000 (13:53 -0400)] 
ACCUMULO-1055: made default for max MINC merge file size 0

5 years agoMerge branch '1.6' into 1.7
Sean Busbey [Wed, 24 Aug 2016 15:22:25 +0000 (10:22 -0500)] 
Merge branch '1.6' into 1.7

 Conflicts:
server/gc/src/main/java/org/apache/accumulo/gc/SimpleGarbageCollector.java
server/master/src/main/java/org/apache/accumulo/master/Master.java
server/monitor/src/main/java/org/apache/accumulo/monitor/Monitor.java
server/tracer/src/main/java/org/apache/accumulo/tracer/TraceServer.java
server/tserver/src/main/java/org/apache/accumulo/tserver/TabletServer.java

5 years agoACCUMULO-4422 Initialize logging as first step in server initialization.
Sean Busbey [Wed, 24 Aug 2016 15:04:01 +0000 (10:04 -0500)] 
ACCUMULO-4422 Initialize logging as first step in server initialization.

5 years agoACCUMULO-1055: created TABLE_MINC_MAX_MERGE_FILE_SIZE and DatafileManagerTest
milleruntime [Thu, 18 Aug 2016 12:19:21 +0000 (08:19 -0400)] 
ACCUMULO-1055: created TABLE_MINC_MAX_MERGE_FILE_SIZE and DatafileManagerTest

5 years agoMerge branch '1.7' into 1.8
Dave Marion [Tue, 23 Aug 2016 13:57:07 +0000 (09:57 -0400)] 
Merge branch '1.7' into 1.8

5 years agoMerge branch '1.6' into 1.7
Dave Marion [Tue, 23 Aug 2016 13:56:35 +0000 (09:56 -0400)] 
Merge branch '1.6' into 1.7

5 years agoACCUMULO-4163: change exception handling
Dave Marion [Mon, 22 Aug 2016 22:42:56 +0000 (18:42 -0400)] 
ACCUMULO-4163: change exception handling

5 years agoACCUMULO-2971 Fix missing final keyword
Christopher Tubbs [Thu, 18 Aug 2016 23:21:05 +0000 (19:21 -0400)] 
ACCUMULO-2971 Fix missing final keyword

5 years agoACCUMULO-2971: multiple improvements for ChangeSecret tool
Mike Miller [Thu, 21 Jul 2016 21:13:01 +0000 (17:13 -0400)] 
ACCUMULO-2971: multiple improvements for ChangeSecret tool

5 years agoMerge branch '1.7' into 1.8
Josh Elser [Wed, 17 Aug 2016 20:20:37 +0000 (16:20 -0400)] 
Merge branch '1.7' into 1.8

5 years agoACCUMULO-4412 Check proxy process when client fails to connect
Josh Elser [Wed, 17 Aug 2016 20:19:53 +0000 (16:19 -0400)] 
ACCUMULO-4412 Check proxy process when client fails to connect

5 years agoMerge branch '1.7' into 1.8
Christopher Tubbs [Wed, 17 Aug 2016 00:17:48 +0000 (20:17 -0400)] 
Merge branch '1.7' into 1.8

5 years agoMerge branch '1.6' into 1.7
Christopher Tubbs [Wed, 17 Aug 2016 00:17:24 +0000 (20:17 -0400)] 
Merge branch '1.6' into 1.7

5 years agoACCUMULO-4315 Remove confusing log message
Christopher Tubbs [Wed, 17 Aug 2016 00:12:24 +0000 (20:12 -0400)] 
ACCUMULO-4315 Remove confusing log message

Remove an unnecessarily confusing log message, about using a volume
which is not contained in instance.volumes. There's no reason to warn
about this, because it's not a problem. Further, it is expected in some
cases, such as bulk import, when files are imported from outside an
Accumulo "Volume".

5 years agoMerge branch '1.7' into 1.8
Dave Marion [Tue, 16 Aug 2016 17:03:05 +0000 (13:03 -0400)] 
Merge branch '1.7' into 1.8

5 years agoMerge branch '1.6' into 1.7
Dave Marion [Tue, 16 Aug 2016 17:02:20 +0000 (13:02 -0400)] 
Merge branch '1.6' into 1.7

5 years agoACCUMULO-4379: Make it clear as to which native library is missing
Dave Marion [Tue, 16 Aug 2016 17:00:52 +0000 (13:00 -0400)] 
ACCUMULO-4379: Make it clear as to which native library is missing

5 years agoACCUMULO-4406 Addendum to Dave's fixes on log naming
Josh Elser [Mon, 15 Aug 2016 21:25:15 +0000 (17:25 -0400)] 
ACCUMULO-4406 Addendum to Dave's fixes on log naming

* Use a system property (since global) that points to Accumulo using it
* Update generic_logger.properties template
* Only set system property when instance for service is provided
* Default to "1" when NUM_TSERVERS isn't defined (instead of erroring)
* Restore original log names when single tserver is used
* Avoid duplicative numbers in log file names (e.g. tserver-1_1_fqdn...)

Closes #139

5 years agoACCUMULO-4406: Add instance number to .out and .err files
Dave Marion [Mon, 15 Aug 2016 16:51:33 +0000 (12:51 -0400)] 
ACCUMULO-4406: Add instance number to .out and .err files

Rotate the logfiles with the instance numbers and only add numbered .out and .err files when we have multiple tservers

Closes #138

5 years agoMerge branch '1.7' into 1.8
Josh Elser [Mon, 15 Aug 2016 18:14:11 +0000 (14:14 -0400)] 
Merge branch '1.7' into 1.8

5 years agoACCUMULO-4405 Prevent ThriftScanner from waiting Long.MAX_VALUE millis
Josh Elser [Mon, 15 Aug 2016 17:04:45 +0000 (13:04 -0400)] 
ACCUMULO-4405 Prevent ThriftScanner from waiting Long.MAX_VALUE millis

5 years agoACCUMULO-4403 Use FQDN and all hostname aliases
Josh Elser [Sun, 14 Aug 2016 03:01:15 +0000 (23:01 -0400)] 
ACCUMULO-4403 Use FQDN and all hostname aliases

If there are multiple aliases for a host, stop-here.sh would
fail to handle them. Also, fix some related shellcheck
warnings in the same file.

5 years agoACCUMULO-4013 Remove assignment in condition
Christopher Tubbs [Sun, 14 Aug 2016 02:16:44 +0000 (22:16 -0400)] 
ACCUMULO-4013 Remove assignment in condition

Fix compiler warning about boolean assignment in condition.
Move assignment outside of condition to be more explicit that both
values matter.

5 years agoACCUMULO-4401 Restore original conditional to avoid infinite loop
Josh Elser [Sun, 14 Aug 2016 01:06:48 +0000 (21:06 -0400)] 
ACCUMULO-4401 Restore original conditional to avoid infinite loop

5 years agoMerge branch '1.7' into 1.8
Christopher Tubbs [Fri, 12 Aug 2016 01:24:56 +0000 (21:24 -0400)] 
Merge branch '1.7' into 1.8

5 years agoMerge branch '1.6' into 1.7
Christopher Tubbs [Fri, 12 Aug 2016 01:24:49 +0000 (21:24 -0400)] 
Merge branch '1.6' into 1.7

5 years agoACCUMULO-4400 Best effort to reset gpg-agent cache
Christopher Tubbs [Fri, 12 Aug 2016 01:12:15 +0000 (21:12 -0400)] 
ACCUMULO-4400 Best effort to reset gpg-agent cache

Make a best effort to reset gpg-agent cache, so that the signing key
will stay cached throughout the full duration of the release candidate
build, when created using build.sh

Limitations:
  1. This will force the password to be input at the beginning of the
     build.sh script, unless the user is using some persistent cache
     like gnome-keyring-daemon to manage one's key.
  2. If the user pauses at the prompts later in the script, for a long
     period of time, the cache could still expire during execution, even
     if the cache is reset at the start of the script.
  3. The build.sh script still presumes that gpg-agent is configured
     with a sufficiently large enough default-cache-ttl and
     max-cache-ttl values, so that the cache won't expire during the
     creation of the release candidate.

5 years agoMerge branch '1.7' into 1.8
Christopher Tubbs [Wed, 10 Aug 2016 21:49:28 +0000 (17:49 -0400)] 
Merge branch '1.7' into 1.8

5 years agoMerge branch '1.6' into 1.7
Christopher Tubbs [Wed, 10 Aug 2016 21:49:20 +0000 (17:49 -0400)] 
Merge branch '1.6' into 1.7

5 years agoACCUMULO-4399 Escape OUTPUT_DIR target in Makefile
Christopher Tubbs [Wed, 10 Aug 2016 21:48:07 +0000 (17:48 -0400)] 
ACCUMULO-4399 Escape OUTPUT_DIR target in Makefile

Escape spaces and parens in the OUTPUT_DIR make parameter when set.

5 years agoMerge branch '1.7' into 1.8
Christopher Tubbs [Wed, 10 Aug 2016 20:09:38 +0000 (16:09 -0400)] 
Merge branch '1.7' into 1.8

5 years agoMerge branch '1.6' into 1.7
Christopher Tubbs [Wed, 10 Aug 2016 20:08:44 +0000 (16:08 -0400)] 
Merge branch '1.6' into 1.7

Conflicts:
server/native/src/main/resources/Makefile

5 years agoACCUMULO-4399 Handle files w/ spaces in Makefile
Christopher Tubbs [Wed, 10 Aug 2016 19:54:32 +0000 (15:54 -0400)] 
ACCUMULO-4399 Handle files w/ spaces in Makefile

Add quotes and escaping, as needed, to ensure paths with spaces and
parentheses are handled properly.

5 years agoACCUMULO-4362 Fix TabletStateChangeIteratorIT
Christopher Tubbs [Tue, 9 Aug 2016 21:21:32 +0000 (17:21 -0400)] 
ACCUMULO-4362 Fix TabletStateChangeIteratorIT

Ensure MetadataTableUtil.createCloneScanner uses the correct metadata
table.

Ensure TabletStateChangeIteratorIT waits until tablets are stable before
proceeding with the test.

5 years agoACCUMULO-4397 Fix FastBulkImporIT timeout
Christopher Tubbs [Tue, 9 Aug 2016 19:37:49 +0000 (15:37 -0400)] 
ACCUMULO-4397 Fix FastBulkImporIT timeout

Increase timeout to 120 seconds. 60 was too small for this test.

5 years agoMerge branch '4110-WAL-test' into 1.8
Michael Wall [Tue, 2 Aug 2016 23:07:39 +0000 (19:07 -0400)] 
Merge branch '4110-WAL-test' into 1.8

5 years agoMerge branch '1.7' into 1.8
Josh Elser [Mon, 1 Aug 2016 20:55:25 +0000 (16:55 -0400)] 
Merge branch '1.7' into 1.8

5 years agoMerge branch '1.6' into 1.7
Josh Elser [Mon, 1 Aug 2016 20:43:35 +0000 (16:43 -0400)] 
Merge branch '1.6' into 1.7

5 years agoACCUMULO-4394 Fix up ShellServerIT#addauths
Josh Elser [Mon, 1 Aug 2016 20:20:16 +0000 (16:20 -0400)] 
ACCUMULO-4394 Fix up ShellServerIT#addauths

The first loop did not set success=true upon success and would
always iterate 9 times. We don't have to limit the number of attempts,
instead rely on the junit timeout rule and run for as long as allowed.

5 years agoACCUMULO-4353 Avoid fallthrough compiler warning
Christopher Tubbs [Mon, 25 Jul 2016 20:21:04 +0000 (16:21 -0400)] 
ACCUMULO-4353 Avoid fallthrough compiler warning

Avoid a newly introduced switch case fallthrough warning from the Java
compiler with an explicit method call for the common functionality.

5 years agoMerge branch '1.7' into 1.8
Christopher Tubbs [Mon, 25 Jul 2016 19:43:28 +0000 (15:43 -0400)] 
Merge branch '1.7' into 1.8

5 years agoACCUMULO-4390 Remove directory assembly profile
Christopher Tubbs [Mon, 25 Jul 2016 19:07:08 +0000 (15:07 -0400)] 
ACCUMULO-4390 Remove directory assembly profile

* Remove another unneeded profile, assembly property.
* Fixup source-release tarball profile so that it gets properly detached
  and renamed with only the apache-release profile activated.
* Fix warnings from native directory assembly about being unable to
  attach.

5 years agoMerge branch '1.7' into 1.8
Christopher Tubbs [Fri, 22 Jul 2016 23:30:50 +0000 (19:30 -0400)] 
Merge branch '1.7' into 1.8

Conflicts:
assemble/pom.xml
test/pom.xml

5 years agoACCUMULO-4390 Remove unnecessary build profiles
Christopher Tubbs [Fri, 22 Jul 2016 22:29:27 +0000 (18:29 -0400)] 
ACCUMULO-4390 Remove unnecessary build profiles

* Remove docs and assemble profiles (always run their tasks)
* Trigger attaching src.tar.gz when created with apache-release profile
* Remove unused vestigial shared-mini-for-it profile
* Ensure dependencies for non-jars are optional, so they don't get
  included transitively

5 years agoACCUMULO-4381 Removed unused variable
Christopher Tubbs [Fri, 22 Jul 2016 21:01:56 +0000 (17:01 -0400)] 
ACCUMULO-4381 Removed unused variable

5 years agoACCUMULO-4324 Fixed issues found while attempting to run upgrade test
Keith Turner [Tue, 12 Jul 2016 21:24:24 +0000 (17:24 -0400)] 
ACCUMULO-4324 Fixed issues found while attempting to run upgrade test

With these fixes was able to run the update test script going from 1.7.1 and
1.6.5 to 1.8.0-SNAP.  Ran script with clean and dirty shutdown.

Also removed option to upgrade from 1.5 and ealier since this was not tested.

Closes apache/accumulo#120, apache/accumulo#121

5 years agoACCUMULO-4324 update data version
Michael Wall [Tue, 21 Jun 2016 18:50:52 +0000 (14:50 -0400)] 
ACCUMULO-4324 update data version

5 years agoMerge branch '1.7' into 1.8
Josh Elser [Fri, 22 Jul 2016 19:09:00 +0000 (15:09 -0400)] 
Merge branch '1.7' into 1.8

5 years agoACCUMULO-4388: Move location to obtain zoo session.
phrocker [Fri, 22 Jul 2016 16:42:18 +0000 (12:42 -0400)] 
ACCUMULO-4388: Move location to obtain zoo session.

Change the location of obtaining the zoo session. Tests within ZooCacheTest
appeared to cover these changes to ensure it did not break functionality; however
if there are ideas I'll be glad to provide additional tests.

Adding comments to make clear the reasoning behind pulling call
to getZooKeepers into run(), so that future developers will follow
the same plan when implementing ZooRunnable.

Closes apache/accumulo#133

Signed-off-by: Josh Elser <elserj@apache.org>
5 years agoACCUMULO-4387 fix javadoc issue
Keith Turner [Fri, 22 Jul 2016 15:52:35 +0000 (11:52 -0400)] 
ACCUMULO-4387 fix javadoc issue

5 years agoACCUMULO-4386 Fix trivial compiler warnings
Christopher Tubbs [Fri, 22 Jul 2016 02:52:24 +0000 (22:52 -0400)] 
ACCUMULO-4386 Fix trivial compiler warnings

Fix extra import and use generic method for emptyMap() instead of
EMPTY_MAP constant.

5 years agoMerge branch '1.7' into 1.8
Christopher Tubbs [Fri, 22 Jul 2016 02:46:58 +0000 (22:46 -0400)] 
Merge branch '1.7' into 1.8

5 years agoMerge branch '1.6' into 1.7
Christopher Tubbs [Fri, 22 Jul 2016 02:32:41 +0000 (22:32 -0400)] 
Merge branch '1.6' into 1.7

5 years agoACCUMULO-4386 Fix trivial compiler warnings
Christopher Tubbs [Fri, 22 Jul 2016 02:21:32 +0000 (22:21 -0400)] 
ACCUMULO-4386 Fix trivial compiler warnings

Fixes a few trivial compiler warnings when building with JDK8

* Unnecessary cast
* Misuse of auxillary class (use of wrong class in logger)
* Use explicit casts for generic arrays, to highlight lack of type
  safety in generic parameters, and avoid warning about missing generic
  parameters

5 years agoACCUMULO-4385 Fix type safety warning
Christopher Tubbs [Fri, 22 Jul 2016 01:51:05 +0000 (21:51 -0400)] 
ACCUMULO-4385 Fix type safety warning

Suppress unavoidable type safety warning about overriding a generic
method.

5 years agoMerge branch '1.7' into 1.8
Christopher Tubbs [Fri, 22 Jul 2016 00:00:07 +0000 (20:00 -0400)] 
Merge branch '1.7' into 1.8

5 years agoACCUMULO-4383 Update animal sniffer for Java 7
Christopher Tubbs [Thu, 21 Jul 2016 23:59:47 +0000 (19:59 -0400)] 
ACCUMULO-4383 Update animal sniffer for Java 7

5 years agoMerge branch '1.6' into 1.7
Christopher Tubbs [Thu, 21 Jul 2016 23:56:09 +0000 (19:56 -0400)] 
Merge branch '1.6' into 1.7

5 years agoACCUMULO-4383 Use animal-sniffer-enforcer-rule
Christopher Tubbs [Thu, 21 Jul 2016 23:54:05 +0000 (19:54 -0400)] 
ACCUMULO-4383 Use animal-sniffer-enforcer-rule

Use animal-sniffer to detect and fail on use of newer Java APIs than the
target version.

5 years agoMerge branch '1.7' into 1.8
Christopher Tubbs [Thu, 21 Jul 2016 22:43:29 +0000 (18:43 -0400)] 
Merge branch '1.7' into 1.8

5 years agoMerge branch '1.6' into 1.7
Christopher Tubbs [Thu, 21 Jul 2016 22:22:25 +0000 (18:22 -0400)] 
Merge branch '1.6' into 1.7

5 years agoACCUMULO-4384 Simplify rat excludes 130/head
Christopher Tubbs [Thu, 21 Jul 2016 21:39:43 +0000 (17:39 -0400)] 
ACCUMULO-4384 Simplify rat excludes

Use wildcards and parent pom inheritance to simplify apache-rat-plugin
excludes. Renames (with a move) the bin-LICENSE and bin-NOTICE files so
rat will exclude them by default to further simplify configuration.

5 years agoACCUMULO-4382 Clean up license/notice files
Christopher Tubbs [Thu, 21 Jul 2016 21:00:26 +0000 (17:00 -0400)] 
ACCUMULO-4382 Clean up license/notice files

Remove unnecessary contents.
Converge on a consistent formatting.

5 years agoACCUMULO-4374: Changes to Shell to fix ChangeSecret tool
milleruntime [Fri, 15 Jul 2016 19:42:00 +0000 (15:42 -0400)] 
ACCUMULO-4374: Changes to Shell to fix ChangeSecret tool

Closes apache/accumulo#126, apache/accumulo#129

Signed-off-by: Josh Elser <elserj@apache.org>
5 years agoMerge branch '1.7' into 1.8-up
Josh Elser [Thu, 21 Jul 2016 20:33:14 +0000 (16:33 -0400)] 
Merge branch '1.7' into 1.8-up

5 years agoACCUMULO-4374: Changes to Shell to fix ChangeSecret tool
milleruntime [Fri, 15 Jul 2016 19:42:00 +0000 (15:42 -0400)] 
ACCUMULO-4374: Changes to Shell to fix ChangeSecret tool

Signed-off-by: Josh Elser <elserj@apache.org>
5 years agoACCUMULO-4381 Cease use of Process#isAlive()
Josh Elser [Wed, 20 Jul 2016 21:32:09 +0000 (17:32 -0400)] 
ACCUMULO-4381 Cease use of Process#isAlive()

This method only exists in JDK8. We cannot use it in Accumulo 1.8

5 years agoACCUMULO-4353: Stabilize tablet assignment during transient failure
Shawn Walker [Wed, 13 Jul 2016 14:40:52 +0000 (10:40 -0400)] 
ACCUMULO-4353: Stabilize tablet assignment during transient failure

Squashed the following commits, cherry picked them from master to 1.8 and then resolved conflicts.

commit 2e30d9178ec4352eaa724d2a9d5ea033f90e7d67
Author: Shawn Walker <accumulo@shawn-walker.net>
Date:   Mon Jul 11 12:15:57 2016 -0400

    ACCUMULO-4353: Added short blurb in user manual on rolling restarts and `table.suspend.duration`

commit 24223c6ada605250c1d5b7b1da7abfd57e105085
Author: Shawn Walker <accumulo@shawn-walker.net>
Date:   Mon Jul 11 11:24:13 2016 -0400

    ACCUMULO-4353: Refactored SuspendedTabletsIT to test for suspension upon both (a) clean tserver shutdown and (b) tserver crash

commit 35fcdd09a542680fc012860fc33151b7933cda02
Author: Shawn Walker <accumulo@shawn-walker.net>
Date:   Fri Jul 8 12:40:03 2016 -0400

    ACCUMULO-4353: Fixed time unit mismatch in recent change to TabletServer

commit fc861c2b84773567d2fdb2c3e863eeffd5fb701c
Author: Shawn Walker <accumulo@shawn-walker.net>
Date:   Tue Jul 5 14:22:37 2016 -0400

    ACCUMULO-4353: TServers undergoing "clean" shutdown will suspend their tablets now, too.  `master.metadata.suspendable` is now checked more often than just at startu
p

commit 96e3ddd742ced7010596f994d912662448743a0a
Author: Shawn Walker <accumulo@shawn-walker.net>
Date:   Wed Jun 29 13:18:58 2016 -0400

    ACCUMULO-4353: Rewrote `TabletLocationState.getState()` to better account for concurrent change

commit e0e1523b96b83ee289dbae5ec785ca9b7d3761e7
Author: Shawn Walker <accumulo@shawn-walker.net>
Date:   Tue Jun 28 13:27:57 2016 -0400

    ACCUMULO-4353: Now block balancing until live tservers settles to avoid balance/suspend race

commit 8d097c5f4388be83e90325e5b6d674ad21a6121b
Author: Shawn Walker <accumulo@shawn-walker.net>
Date:   Tue Jun 21 13:34:34 2016 -0400

    ACCUMULO-4353: Stabilize tablet assignment during transient failure.

    Added configuration property `table.suspend.duration` (default 0s): When a tablet server dies, instead of immediately placing its tablets in the TabletState.UNASSIGNED state, they are instead moved to the new TabletState.SUSPENDED state.  A suspended tablet will only be reassigned if (a) table.suspend.duration has passed since the tablet was suspended, or (b) the tablet server most recently hosting the tablet has come back online.  In the latter case, the tablet will be assigned back to its previous host.

    Added configuration property `master.metadata.suspendable` (default false): The above functionality is really meant to be used only on user tablets.  Suspending metadata tablets can lead to much more significant loss of availability.  Despite this, it is possible to set `table.suspend.duration` on `accumulo.metadata`.  If one really wishes to allow metadata tablets to be suspended as well, one must also set the `master.metadata.suspendable` to true.

    I chose not to implement suspension of the root tablet.

    Implementation outline:
    * `master.MasterTime` maintains an approximately monotonic clock; this is used by suspension to determine how much time has passed since a tablet was suspended.  `MasterTime` periodically writes its time base to ZooKeeper for persistence.
    * The `server.master.state.TabletState` now has a `TabletState.SUSPENDED` state.  `TabletLocationState`, `MetaDataStateStore` were updated to properly read and write suspensions.
    * `server.master.state.TabletStateStore` now features a `suspend(...)` method, for suspending a tablet, with implementations in `MetaDataStateStore`.  `suspend(...)` acts just as `unassign(...)`, except that it writes additional metadata indicating when each tablet was suspended, and which tablet server it was suspended from.
    * `master.TabletServerWatcher` updated to properly transition to/from `TabletState.SUSPENDED`.
    * `master.Master` updated to avoid balancing while any tablets remain suspended.

5 years agoACCUMULO-4110 clean up the WALSunnyDayIT 128/head
Michael Wall [Fri, 15 Jul 2016 01:55:17 +0000 (21:55 -0400)] 
ACCUMULO-4110 clean up the WALSunnyDayIT

5 years agoACCUMULO-4378 Add @since 1.8.0 to new Key constructors
Mario Pastorelli [Mon, 18 Jul 2016 21:12:42 +0000 (23:12 +0200)] 
ACCUMULO-4378 Add @since 1.8.0 to new Key constructors

Closes apache/accumulo#127

Signed-off-by: Josh Elser <elserj@apache.org>
5 years agoACCUMULO-4375 Add missing byte[]-based Key constructors
Mario Pastorelli [Sat, 16 Jul 2016 23:01:31 +0000 (01:01 +0200)] 
ACCUMULO-4375 Add missing byte[]-based Key constructors

Closes apache/accumulo#125

Signed-off-by: Josh Elser <elserj@apache.org>