Christopher Tubbs [Thu, 11 Oct 2018 23:04:13 +0000 (19:04 -0400)]
[maven-release-plugin] prepare release rel/2.0.0-alpha-1
Christopher Tubbs [Thu, 11 Oct 2018 22:54:30 +0000 (18:54 -0400)]
Set version to 2.0.0-alpha-1-SNAPSHOT
Christopher Tubbs [Thu, 11 Oct 2018 18:52:44 +0000 (14:52 -0400)]
Cleanup deprecation stuffs (#689)
* Add missing since information for deprecations, including properties
* Fix various javadoc syntax
* Remove deprecated import statements and suppress deprecations in
tests, to limit spam from compiler warnings
Christopher Tubbs [Wed, 10 Oct 2018 05:25:35 +0000 (01:25 -0400)]
Fix #633 use annotations for spotbugs (#687)
Triage all spotbugs excludes from the exclude-filter.xml files and
either implement a fix or document a justification with annotations.
Also add travis-ci task to build with the sec-bugs profile to check for
future security-related issues found by spotbugs.
Christopher Tubbs [Wed, 10 Oct 2018 00:52:27 +0000 (20:52 -0400)]
Clean up unnecessary plugin configuration in POM
Remove unnecessary m2e plugin lifecycle configuration. Due to the phase
of the plugin execution, some plugins do not trigger in the portion of
the lifecycle handled by m2e, so do not need actions specified in the
configuration. Other plugins have actions specified by default in their
plugin metadata, and don't need to be specified here.
Christopher Tubbs [Tue, 9 Oct 2018 22:35:25 +0000 (18:35 -0400)]
Fix #684 Move accumulo-maven-plugin from build (#686)
This removes accumulo-maven-plugin from this main accumulo repo. The
corresponding addition can be found in the new repo named
accumulo-maven-plugin.
Mike Miller [Tue, 9 Oct 2018 20:12:34 +0000 (16:12 -0400)]
Rename link on Monitor to REST (#685)
Christopher Tubbs [Tue, 9 Oct 2018 14:24:44 +0000 (10:24 -0400)]
Revert "Work around compilation bug in Eclipse Oxygen"
Fixes #485; workaround not needed in latest version of Eclipse Photon
This reverts commit
b49865d08f3edb425306c3e48689c8836d947ad5.
Joseph Koshakow [Sun, 7 Oct 2018 06:36:58 +0000 (02:36 -0400)]
Fixed dead link for developers guide in CONTRIBUTING.md (#682)
This fixes #681
Mike Miller [Fri, 5 Oct 2018 19:35:21 +0000 (15:35 -0400)]
Add methods to set props in Rfile summaries. Fixes #612 (#679)
Keith Turner [Thu, 4 Oct 2018 22:26:40 +0000 (18:26 -0400)]
Make Connector same as it is in 1.9 (#678)
Christopher Tubbs [Thu, 4 Oct 2018 22:07:51 +0000 (18:07 -0400)]
Make accumulo-maven-plugin work with older mvn
(Fixes broken build with most common versions of Maven)
Partially revert #670 to restore minimum requirement for
accumulo-maven-plugin to 3.2.5, instead of requiring 3.5.4
(Partial revert of
23fb8b393d745f8ec5c12ed24de637addb0b62b8)
Mike Miller [Thu, 4 Oct 2018 17:51:12 +0000 (13:51 -0400)]
Set props path in ConfigOpts. Fixes #676 (#677)
Mike Miller [Thu, 4 Oct 2018 17:46:59 +0000 (13:46 -0400)]
Format
Keith Turner [Thu, 4 Oct 2018 16:12:32 +0000 (12:12 -0400)]
Make shell script commmand backwards compat (#671)
Keith Turner [Thu, 4 Oct 2018 15:09:26 +0000 (11:09 -0400)]
Merge pull request #675 from keith-turner/fix-native
Christopher Tubbs [Thu, 4 Oct 2018 00:02:24 +0000 (20:02 -0400)]
Fix accumulo-util script
* Fix variable name typo for native_tarballs
* Fix issues identified by shellcheck
Christopher Tubbs [Wed, 3 Oct 2018 23:33:47 +0000 (19:33 -0400)]
Update travis-ci settings (#672)
* Remove IRC notifications (nobody lurks in IRC anymore, so this isn't useful)
* Unset _JAVA_OPTIONS to restore default Java options, so plugins don't
run out of memory and cause the container to get killed
* Remove forking for unit tests; the container doesn't have a lot of CPU
to fork anyway, and removing this helps with excessive memory utilization
* Use openjdk8
* Use sudo-enabled containers for travis-ci
Mike Miller [Wed, 3 Oct 2018 21:36:39 +0000 (17:36 -0400)]
Clarify RFile withTableProps javadoc. Fixes #611
Mike Miller [Wed, 3 Oct 2018 21:13:59 +0000 (17:13 -0400)]
Clarify RFile withTableProps javadoc. Fixes #611 (#674)
Keith Turner [Wed, 3 Oct 2018 20:12:17 +0000 (16:12 -0400)]
Removed uneeded code
Keith Turner [Wed, 3 Oct 2018 20:08:26 +0000 (16:08 -0400)]
Fix script to build native libs
Christopher McTague [Wed, 3 Oct 2018 17:16:51 +0000 (13:16 -0400)]
Fixes #561 - Be explicit about aliases in shell (#673)
- Explicitly state that deletetable and droptable are the same
Mike Miller [Wed, 3 Oct 2018 16:26:55 +0000 (12:26 -0400)]
Merge branch '1.9'
Conflicts:
core/src/main/java/org/apache/accumulo/core/data/Mutation.java
Mike Miller [Tue, 2 Oct 2018 15:03:05 +0000 (11:03 -0400)]
Use optimized writeV methods in Mutations (#669)
* Moved optimized writeVLong and writeVInt to UnsynchronizedBuffer
to replace use of WriteableUtils methods. Each optimized method will
only make one write call to the underlying outputstream.
Christopher McTague [Wed, 3 Oct 2018 14:58:20 +0000 (10:58 -0400)]
Fixes #421 Organize Fate Operations (#663)
* Clean up tableOps directory to be organized by Fate operation.
Mike Walch [Tue, 2 Oct 2018 19:28:48 +0000 (15:28 -0400)]
Fixes #622 - Include version in Jar filenames of Accumulo deps (#667)
Mike Walch [Tue, 2 Oct 2018 19:06:26 +0000 (15:06 -0400)]
Update Accumulo dependencies (#670)
* Also have TravisCI compile with older versions of
Hadoop & Zookeeper
alerman [Tue, 2 Oct 2018 14:49:38 +0000 (10:49 -0400)]
Add space aware volume chooser (#645)
Christopher McTague [Tue, 2 Oct 2018 14:47:40 +0000 (10:47 -0400)]
Sort Modifiers for consistency. (#665)
Mike Walch [Wed, 26 Sep 2018 21:41:48 +0000 (17:41 -0400)]
Refactored AccumuloClient variable names (#664)
* Removed unused code
Mike Walch [Tue, 25 Sep 2018 20:22:57 +0000 (16:22 -0400)]
Removed redundant modifiers on AccumuloClient interface (#661)
* Removed redundant use of public and abstract
Keith Turner [Tue, 25 Sep 2018 18:07:13 +0000 (14:07 -0400)]
Link to API definition on website (#660)
Sean Busbey [Tue, 25 Sep 2018 17:10:34 +0000 (10:10 -0700)]
Merge branch '1.9'
Sean Busbey [Tue, 25 Sep 2018 17:08:15 +0000 (12:08 -0500)]
Update commons-configuration to latest 1.x (#659)
* Update to configuration-commons 1.10
* Add deprecation notice for newly inherited method on ClientConfiguration
Josh Elser [Mon, 24 Sep 2018 21:54:34 +0000 (17:54 -0400)]
Merge branch '1.9'
Josh Elser [Fri, 21 Sep 2018 20:09:26 +0000 (16:09 -0400)]
Introduce a property for a key password for the Monitor keystore file
Java keystores can have a keystore password as well as a password on the private key contained inside of that keystore
(when that keystore may contain multiple keys). Usually, but not always, the "key password" is the same as the
keystore password. This commit introduces a new property to allow this configuration.
Josh Elser [Fri, 21 Sep 2018 18:17:51 +0000 (14:17 -0400)]
Revert "Do not require a password on the truststore JKS"
This reverts commit
1213c9a9d179e7202e56bbd171303e9dacb3e223.
Mike Walch [Mon, 24 Sep 2018 15:01:04 +0000 (11:01 -0400)]
Updates for standalone cluster (#657)
Christopher Tubbs [Sat, 22 Sep 2018 03:04:52 +0000 (23:04 -0400)]
Merge branch '1.9'
Christopher Tubbs [Sat, 22 Sep 2018 00:38:31 +0000 (20:38 -0400)]
Roll back maven-invoker-plugin 3.1.0->3.0.1
A bug exists in maven-invoker-plugin 3.1.0 which causes the maven-plugin
module to fail to build, due to missing SNAPSHOT dependencies copied
into the PluginIT's local repository from sibling modules. This is
because transitive dependencies fail to be copied, as they were in 3.0.1
of the plugin.
See https://issues.apache.org/jira/browse/MINVOKER-243
Keith Turner [Fri, 21 Sep 2018 21:54:53 +0000 (17:54 -0400)]
Merge branch 'document-api' closes #656
Keith Turner [Thu, 20 Sep 2018 22:51:46 +0000 (18:51 -0400)]
Move public API docs to Accumulo.java (#656)
Keith Turner [Thu, 20 Sep 2018 20:04:07 +0000 (16:04 -0400)]
Move Accumulo class to API package (#656)
Sean Busbey [Fri, 21 Sep 2018 16:08:17 +0000 (11:08 -0500)]
Addendum to #636 that I had staged by not committed.
Sean Busbey [Fri, 21 Sep 2018 14:58:06 +0000 (09:58 -0500)]
Addendum to #636 to fix maven-plugin's IT.
Sean Busbey [Fri, 21 Sep 2018 14:13:59 +0000 (09:13 -0500)]
Merge branch '1.9'
Conflicts:
core/pom.xml
examples/simple/pom.xml
pom.xml
Sean Busbey [Fri, 21 Sep 2018 14:06:31 +0000 (09:06 -0500)]
Remove httpclient dependency. (#655)
* was present for Hadoop 1, which we don't support anymore
* was present for ThreadSafe note on our maven-plugin mojo, but that annotation is gone in current releases
Tested via running ITs locally and against a standalone hadoop 2 cluster
Sean Busbey [Thu, 20 Sep 2018 18:58:44 +0000 (13:58 -0500)]
Merge branch '1.9'
Sean Busbey [Thu, 20 Sep 2018 18:34:30 +0000 (13:34 -0500)]
AccumuloFileOutputFormatITs need to look on local filesystem for results written into JUnit provided temp dir. (#654)
Before this change the {mapred,mapreduce}.AccumuloFileOutputFormatITs would work against a minicluster backed by
Hadoop's LocalFileSystem, but fail if one followed the instructions for testing against a stand alone cluster.
The failure is because in the cluster case the FileSystem we get is for the HDFS instance underlying the
Accumulo cluster, which can't find the folder JUnit created for our test.
Mike Miller [Thu, 20 Sep 2018 17:51:37 +0000 (13:51 -0400)]
Fix performance of crypto (#652)
* Remove use of DiscardCloseOutputStream from WAL encryption
* Override inefficient write method in DiscardCloseOutputStream and NoFlushOutputStream
* Changed NoFlushOutputStream to extend FilterOutputStream, which doesn't have synchronized methods like DataOutputStream does
Mike Miller [Thu, 20 Sep 2018 17:47:10 +0000 (13:47 -0400)]
Merge branch 'accumulo-client' Closes #636
Mike Miller [Tue, 11 Sep 2018 18:54:57 +0000 (14:54 -0400)]
Updates from pull request #636
Mike Miller [Tue, 11 Sep 2018 18:03:21 +0000 (14:03 -0400)]
Replace getConnector() with getClient() #636
Mike Miller [Fri, 7 Sep 2018 15:34:24 +0000 (11:34 -0400)]
Replace AccumuloClient.builder() with Accumulo.newClient() #636
Mike Miller [Fri, 7 Sep 2018 15:34:02 +0000 (11:34 -0400)]
Create Accumulo class as main entry point #636
Mike Miller [Thu, 6 Sep 2018 21:02:25 +0000 (17:02 -0400)]
Fix javadoc #636
Mike Miller [Thu, 6 Sep 2018 20:38:29 +0000 (16:38 -0400)]
Replaced uses of Connector with AccumuloClient #636
Mike Miller [Thu, 6 Sep 2018 20:36:55 +0000 (16:36 -0400)]
Deprecate Connector #636
* Created Connector.from() as a bridge between it and AccumuloClient
* Moved new builder API to AccumuloClient
Mike Miller [Thu, 6 Sep 2018 20:32:08 +0000 (16:32 -0400)]
Created AccumuloClient from Connector #636
Sean Busbey [Tue, 18 Sep 2018 18:19:04 +0000 (13:19 -0500)]
Merge branch '1.9'
Norbert Kalmar [Tue, 18 Sep 2018 18:10:12 +0000 (13:10 -0500)]
Correct how Continuous Ingest specifies the debug log file (#651)
Josh Elser [Fri, 14 Sep 2018 20:01:02 +0000 (16:01 -0400)]
TServerUtilsTest fails on master and OSX
A couple of tests fail in this class because the test binds to localhost:<port>
but then TServerSocket (via TServerUtils) binds to `0.0.0.0` which doesn't
cause an exception to be thrown (testing for the port collision).
Closes #649
Signed-Off-By: Christopher Tubbs <ctubbsii@apache.org>
Signed-Off-By: Keith Turner <keith@deenlo.com>
Mike Miller [Fri, 14 Sep 2018 22:25:10 +0000 (18:25 -0400)]
Rename new Bulk import API (#648)
* Also added an example for importDirectory fluent API
Christopher Tubbs [Fri, 14 Sep 2018 20:47:22 +0000 (16:47 -0400)]
Merge branch '1.9'
Romil Choksi [Wed, 12 Sep 2018 19:07:20 +0000 (15:07 -0400)]
Do not require a password on the truststore JKS
A password on a truststore provides no security value, only validation
that the JKS is the JKS that the user expects. Log a warning when the
truststore is empty.
Closes #646
Signed-off-by: Josh Elser <elserj@apache.org>
Romil Choksi [Wed, 12 Sep 2018 19:07:20 +0000 (15:07 -0400)]
Do not require a password on the truststore JKS
A password on a truststore provides no security value, only validation
that the JKS is the JKS that the user expects. Log a warning when the
truststore is empty.
Closes #646
Signed-off-by: Josh Elser <elserj@apache.org>
Christopher Tubbs [Fri, 14 Sep 2018 04:14:11 +0000 (00:14 -0400)]
Fix LoadPlanTest failure
Fix failure due to apparent rename of RangeType enums during
development, without accompanying rename in test.
Also, clean up the punctuation and fix a typo in the javadoc for
RangeType enum values.
Christopher Tubbs [Fri, 14 Sep 2018 02:43:21 +0000 (22:43 -0400)]
Fix checkstyle failures
Use static import for Assert.* methods
Christopher Tubbs [Fri, 14 Sep 2018 02:42:25 +0000 (22:42 -0400)]
Merge branch '1.9'
Christopher Tubbs [Fri, 14 Sep 2018 02:40:21 +0000 (22:40 -0400)]
Fix javadoc doclint settings
Use new doclint option for maven-javadoc-plugin 3.0.0 and later; this
is necessary to suppress unimportant javadoc warnings that were
previously suppressed differently. The previous method no longer works
in the current version of the plugin.
Also fix warning about javadocVersion by being more specific.
Keith Turner [Thu, 13 Sep 2018 22:00:40 +0000 (18:00 -0400)]
ACCUMULO-4813 Add ability to provide a load plan for bulk import (#607)
Keith Turner [Thu, 13 Sep 2018 20:30:01 +0000 (16:30 -0400)]
Fix plugin build with skipQA profile (#643)
The command 'mvn install -PskipQA' allows quick install for
testing. However the accumulo maven plugin built by this
command was not working. This change fixes that.
Mike Miller [Wed, 12 Sep 2018 21:12:13 +0000 (17:12 -0400)]
Add experimental props to doc gen (#644)
* Printed the experimental properties inline with all properties
* Removed inner classes cluttering up ConfigurationDocGen
Mike Miller [Tue, 11 Sep 2018 19:10:10 +0000 (15:10 -0400)]
Fix crypto tests writing to /tmp (#641)
Mike Miller [Mon, 10 Sep 2018 22:42:00 +0000 (18:42 -0400)]
Rename some Crypto terms for easier configuration (#640)
* Changed instance.crypto.opts.kekId to instance.crypto.opts.key.location
* Changed instance.crypto.opts.keyManager to instance.crypto.opts.key.provider
Christopher Tubbs [Mon, 10 Sep 2018 02:42:26 +0000 (22:42 -0400)]
Update travis config: drop hadoop profile
Accumulo master branch (2.0.0-SNAPSHOT) only supports Hadoop 3, so we
don't need to build twice in Travis, one for Hadoop 3 and one for the
default Hadoop profile, like we do in the 1.9 maintenance branch.
Christopher Tubbs [Mon, 10 Sep 2018 00:51:38 +0000 (20:51 -0400)]
Merge branch 'pom-update-626'
Mike Miller [Tue, 28 Aug 2018 04:01:08 +0000 (00:01 -0400)]
Upgrade findbugs to spotbugs for 1.9
(Backport of #615 to the 1.9 branch with some updates)
* Upgrade findbugs to spotbugs 3.1.6
* Rename all findbugs to spotbugs (with various capitalizations)
* Remove README.spotbugs/README.findbugs (contains incorrect info and not useful)
Christopher Tubbs [Thu, 6 Sep 2018 23:06:49 +0000 (19:06 -0400)]
Fix #626 Update to apache-21 parent POM
* Update parent POM to apache-21
* Update build plugin configuration obsoleted by POM update
* Update other build plugins
* Build with JDK8 to use plugins which aren't out-of-date
This change requires Java 8 for building the project, because the
updates to Maven plugins are getting harder
Christopher Tubbs [Sun, 9 Sep 2018 09:17:41 +0000 (05:17 -0400)]
Fix PrintInfo command and VolumeChooserIT
* Fix PrintInfo's incorrect use of "-site" instead of "-props" (I think
this one may have been causing ReadWriteIT to blow up in some cases, but
I only saw this locally, and never on Jenkins, so I'm not certain)
* Fix ChooseDir implementation to correctly pass the master's
ServerContext, so that creating new tablets didn't break for volume
choosers which needed access to the server configuration; this fixed a
test failure with VolumeChooserIT; also removed constructors exposed
only for testing, because they were too easily misused for non-tests
Christopher Tubbs [Sun, 9 Sep 2018 08:05:14 +0000 (04:05 -0400)]
Merge branch '1.9'
Christopher Tubbs [Sun, 9 Sep 2018 06:06:14 +0000 (02:06 -0400)]
Fix #639 Update JUnit usage
* Use JUnit4 annotations instead of TestCase
* Use static imports for Assert methods, for consistency
* Enforce with checkstyle rules
Christopher Tubbs [Sun, 9 Sep 2018 02:14:48 +0000 (22:14 -0400)]
Merge branch '1.9'
Christopher Tubbs [Sun, 9 Sep 2018 02:14:21 +0000 (22:14 -0400)]
Use slf4j syntax for key in log message
Mike Walch [Sat, 8 Sep 2018 05:24:52 +0000 (01:24 -0400)]
Upgrade httpclient to 4.5.6 (#638)
* Removed use of @ThreadSafe annotation as it was
dropped in 4.5.6
Mike Miller [Fri, 7 Sep 2018 20:44:40 +0000 (16:44 -0400)]
Fix ITs broken by SecureRandom
Mark Owens [Fri, 7 Sep 2018 20:03:47 +0000 (16:03 -0400)]
Merged in changes for 573 into code correcting compiler errors due to
changes in master since PR was initially opened.
Mark Owens [Fri, 7 Sep 2018 19:43:50 +0000 (15:43 -0400)]
#573 Merged in changes from GH-573
Mike Miller [Fri, 7 Sep 2018 15:56:02 +0000 (11:56 -0400)]
Put stacktrace back in visibility exceptions
Christopher Tubbs [Thu, 6 Sep 2018 21:00:17 +0000 (17:00 -0400)]
Fix warnings from dependency updates (#629)
* Fix warnings from dependencies updated in #614
* Use UTF_8 static imports consistently
* Fix null checks in HostAndPort class instead of excluding from spotbugs
* Fix additional minor compiler warnings from maven command line
Keith Turner [Thu, 6 Sep 2018 14:59:10 +0000 (10:59 -0400)]
Restore deprecated instance methods removed in
0ba6c49 (#635)
Restoring these for following reasons :
* Any project that implemented Instance still had to implement deprecated
methods.
* Multiple projects currently have code that call these methods.
* All of Instance is now deprecated.
* Use of Java 8 default methods makes restoration trivial with single line
implementations that have negligible maintenance burden.
Mike Miller [Thu, 6 Sep 2018 14:49:42 +0000 (10:49 -0400)]
Add sec-bugs plugin. Closes #618 (#628)
* Created build profile for sec-bugs
* Replaced Math.Random with SecureRandom
* Sanitize user input in log messages to prevent potential CRLF injection
* Use SHA-256 instead of MD5 or SHA-1
* Remove unused method in CryptoUtils
* Replace vulnerable regex in Monitor param validation
Mike Walch [Wed, 5 Sep 2018 18:40:41 +0000 (14:40 -0400)]
Remove usage of site file/config terminology (#632)
Mike Walch [Wed, 5 Sep 2018 18:40:09 +0000 (14:40 -0400)]
Switched to using HADOOP_HOME for Hadoop 3.x (#630)
Mike Walch [Tue, 4 Sep 2018 21:23:47 +0000 (17:23 -0400)]
Improved error message if accumulo-site.xml found (#627)
Ivan Bella [Sun, 26 Aug 2018 01:07:44 +0000 (21:07 -0400)]
ACCUMULO-4854 : DfsLogger exceptions (#616)
Removed translation of ClosedChannelException to a LogClosedException in the write method as that is done by callers of the method.
Mike Walch [Tue, 4 Sep 2018 15:08:07 +0000 (11:08 -0400)]
Stop sending error message in bean validation response (#625)
Mike Walch [Fri, 31 Aug 2018 15:40:54 +0000 (11:40 -0400)]
Fixes build after it was broken by #614
* Due to API change from commons-configuration 1.6 to 1.10
Mike Walch [Fri, 31 Aug 2018 15:19:48 +0000 (11:19 -0400)]
Updated Accumulo dependencies and classpath (#614)
* Limited the number of dependencies from Hadoop
* Upgraded several dependencies including ZooKeeper,
Jetty, Guava, Gson, Jersey, Bouncy Castle, ClassMate,
FreeMarker, Caffeine, commons-cli, commons-codec,
commons-configuration, commons-io, commons-lang,
commons-logging, javax.ws-rs-api, HK2