Christopher Tubbs [Wed, 23 Dec 2020 21:30:57 +0000 (16:30 -0500)]
Update Accumulo 2.0.x classpath for newer ZKs (#265)
Update class path for all versions of Accumulo 2.0, rather than just
2.0.0, to support newer ZooKeeper versions (3.5 and later)
Christopher Tubbs [Wed, 23 Dec 2020 18:58:35 +0000 (13:58 -0500)]
Improve handling of downloads (#264)
* Add color output in the checksum matching to make it easier to read
* Bypass download step if file already exists with matching checksum
* Remove old hashes, keeping only the latest in each release line
* Use only SHA-512
* Use ZK 3.6.2 by default
* Support a default environment value for the DOWNLOADS directory
Dom G [Mon, 14 Dec 2020 18:16:13 +0000 (13:16 -0500)]
Fixes #262 - 'uno status' shows shell as "secret(pid)" instead of "shell(pid)" (#263)
* converted to pgrep
* altered script to display correct process name
Mike Miller [Mon, 7 Dec 2020 19:53:18 +0000 (14:53 -0500)]
Add properties for running multiple tservers (#261)
Mark Owens [Wed, 14 Oct 2020 20:53:25 +0000 (16:53 -0400)]
Allow use of Hadoop 3.x with Accumulo 1.10.x in uno.conf (#260)
Update version sanity check to allow Hadoop 3.x to be used with Accumulo
versions 1.10 and greater.
Mark Owens [Tue, 13 Oct 2020 16:49:36 +0000 (12:49 -0400)]
Add ZooKeeper 3.5.8 hash to conf/checksums file. (#259)
Christopher Tubbs [Mon, 5 Oct 2020 21:52:23 +0000 (17:52 -0400)]
Add .asf.yaml (#258)
Mark Owens [Mon, 28 Sep 2020 21:27:17 +0000 (17:27 -0400)]
Update uno.conf to properly handle ZooKeeper paths (#257)
Zookeeper changed naming and directory structure between versions 3.4
and 3.5. This update addresses changes in the ZOOKEEPER_TARBALL and
ZOOKEEPER_HOME export definitions depending on version of ZK being used.
Use regex pattern for version check.
Co-authored-by: Christopher Tubbs <ctubbsii@apache.org>
Arvind Shyamsundar [Wed, 16 Sep 2020 19:11:31 +0000 (12:11 -0700)]
Add recent checksums (#255)
* Accumulo 1.10.0
* Hadoop 3.1.4
* Zookeeper 3.6.2
* Spark 3.0.1, 2.4.7
Christopher Tubbs [Wed, 26 Aug 2020 12:40:16 +0000 (08:40 -0400)]
Do more with ShellCheck (#254)
* Fix numerous issues to make ShellCheck pass across `bin/*` and
`conf/uno.conf`
* Add GitHub Actions and CI script for automated ShellCheck testing
* Add missing checksum for latest Hadoops still supported by Accumulo
* Fix parameter passing for `--no-deps` flag
* Build SNAPSHOT version with correct version of Guava for Hadoop 3.1
and later
* Make some long if statements into more concise `&&` syntax for
readability
* Remove some unnecessary quoting
* Rely on return code for pgrep for many statements that were previously
relying on its output unnecessarily
* Fix zk dir pattern
* Fix return codes and make rm safer
* Fix ZK capitalization
* Overhaul some of the scripts:
Consolidate some of the scripts into a commands.sh file and use return
statements instead of exit statements, as appropriate, for more reliable
exit behavior for functions.
Christopher Tubbs [Wed, 19 Aug 2020 22:06:08 +0000 (18:06 -0400)]
Show Maven version and stack traces (#252)
Show Maven version on tasks that execute `mvn`, and show stack traces,
if there are any, if `mvn` fails.
Christopher Tubbs [Wed, 19 Aug 2020 17:53:38 +0000 (13:53 -0400)]
Add Hadoop 3.0.3 checksum (#253)
Adds checksum for latest 3.0 version, because it is still supported by
Accumulo, so it'd be useful to test with that version.
Christopher Tubbs [Fri, 14 Aug 2020 11:54:55 +0000 (07:54 -0400)]
Update links to point to main branch (#251)
Christopher Tubbs [Mon, 3 Aug 2020 17:06:01 +0000 (13:06 -0400)]
Remove unneeded step for Hadoop 3.3 and later (#250)
Prevent unnecessary javax.activation-api step for Hadoop 3.3 and later,
where it is already included in the Hadoop binary.
ben [Thu, 30 Jul 2020 21:32:35 +0000 (22:32 +0100)]
updated Hadoop Version to 3.3.0 (#249)
Signed-off-by: ben <git@benjamin.ie>
Christopher Tubbs [Sat, 30 May 2020 18:48:54 +0000 (14:48 -0400)]
Use ZooKeeper 3.6.1 (#247)
Keith Turner [Thu, 28 May 2020 17:11:55 +0000 (13:11 -0400)]
Update ubuntu 18.04 instructions to install snappy (#248)
If someone configures accumulo to use snappy, its nice if ubuntu already has it installed
Mike Miller [Wed, 22 Apr 2020 13:40:44 +0000 (09:40 -0400)]
Fix install for Accumulo 1.9. Fixes #246
* Make install script update 1.9 scripts to work with zookeeper 3.5+
Christopher Tubbs [Mon, 6 Apr 2020 18:13:30 +0000 (14:13 -0400)]
Update default zoo.cfg for ZooKeeper 3.5 (#245)
Add useful four-letter-word commands by default to ZooKeeper's
config file (zoo.cfg) and disable the built-in Admin Server,
which listens by default on port 8080.
EdColeman [Wed, 1 Apr 2020 21:31:41 +0000 (21:31 +0000)]
Update hadoop doc link to current (#244)
* Update hadoop doc link to current
The linked r2.7.2 section on passwordless ssh has outdated instructions using dsa.
Current docs show using rsa.
* address review comment - use specific version (r3.2.1)
Co-authored-by: Ed Coleman etcoleman <edcoleman@apache.org>
Christopher Tubbs [Wed, 18 Mar 2020 03:17:20 +0000 (23:17 -0400)]
Fix #240 Add ZK lib dir to Accumulo class path (#242)
Add ZooKeeper 3.5.7's lib directory to Accumulo 2.0.0's class path in
conf/accumulo-env.sh
Christopher Tubbs [Wed, 11 Mar 2020 16:10:10 +0000 (12:10 -0400)]
Update to ZK 3.5.7 (#239)
Mike Walch [Tue, 17 Dec 2019 14:16:09 +0000 (09:16 -0500)]
Fixes #237 - Create 'accumulo-proxy' plugin (#238)
* The plugin makes it easy to run the Accumulo Proxy
Mandar Inamdar [Wed, 20 Nov 2019 02:28:25 +0000 (18:28 -0800)]
Fix #235 skip checksum check for snapshot version (#236)
Allows Uno to start Accumulo for SNAPSHOT builds
Jeffrey Manno [Fri, 8 Nov 2019 12:22:31 +0000 (07:22 -0500)]
Update docs for Java 11 (#234)
* Updated these docs for Java 11
* Add docs for 18.04
Keith Turner [Mon, 4 Nov 2019 16:43:13 +0000 (11:43 -0500)]
Only update deprecated Fluo config if it exists (#233)
This Uno change is needed after apache/fluo#1078
Jeffrey Manno [Tue, 8 Oct 2019 14:48:27 +0000 (10:48 -0400)]
updating to use new version of hadoop (#232)
Christopher Tubbs [Thu, 19 Sep 2019 20:13:21 +0000 (13:13 -0700)]
Recommend sourcing uno env instead of using eval (#231)
Mike Miller [Thu, 19 Sep 2019 19:46:43 +0000 (15:46 -0400)]
Redirect message to prevent bash ERROR (#230)
Keith Turner [Mon, 5 Aug 2019 19:52:40 +0000 (15:52 -0400)]
Add Accumulo 2.0.0 checksum (#229)
Christopher Tubbs [Wed, 31 Jul 2019 18:09:41 +0000 (14:09 -0400)]
Fix #228 Specify version of maven-dependency-plugin
Use a specific version of maven-dependency-plugin for its copy goal,
because older versions would only execute this goal within the context
of a POM project. Version 3.1.1 does not have this requirement.
Christopher Tubbs [Wed, 19 Jun 2019 18:36:40 +0000 (14:36 -0400)]
Add javax.activation-api to Hadoop 3 class path (#227)
Add missing javax.activation:javax.activation-api:1.2.0 to Hadoop 3's
runtime class path so that YARN starts correctly using Java 11.
Russell Carter [Wed, 12 Jun 2019 14:25:32 +0000 (10:25 -0400)]
Fixes:#195 Added command to check uno status (#226)
Mike Miller [Wed, 5 Jun 2019 16:43:47 +0000 (12:43 -0400)]
Add zk command for zk cli (#218)
Christopher Tubbs [Thu, 30 May 2019 21:21:52 +0000 (17:21 -0400)]
Make directory to avoid error in plugin script
Mike Miller [Wed, 22 May 2019 17:44:11 +0000 (13:44 -0400)]
Update accumulo-it.properties (#223)
Jeffrey Manno [Fri, 26 Apr 2019 14:56:54 +0000 (10:56 -0400)]
Updated checksum and default zookeeper version (#222)
Keith Turner [Tue, 23 Apr 2019 19:03:19 +0000 (15:03 -0400)]
Added Accumulo 1.9.3 checksum (#221)
Keith Turner [Wed, 17 Apr 2019 22:34:31 +0000 (18:34 -0400)]
Made scripts print info about failing commands (#220)
Kenneth Paul McFarland [Tue, 19 Mar 2019 00:08:01 +0000 (17:08 -0700)]
Grammar check for README.md (#217)
Fixes #216
Mike Walch [Fri, 8 Feb 2019 18:51:39 +0000 (13:51 -0500)]
Update default versions and checksums (#215)
Keith Turner [Thu, 7 Feb 2019 17:00:03 +0000 (12:00 -0500)]
add accumulo 2.0.0-alpha-2 checksum (#214)
Jeffrey Zeiberg [Thu, 10 Jan 2019 15:52:44 +0000 (10:52 -0500)]
Added instruction in the docs/centos7.md file (#213)
Added instructions to make the authorized_keys file read/write for user so ssh to localhost will work. It is set 664 by default with the instructions we give. This will cause ssh localhost to prompt for passphase. If you don't check the ssh setup setup after running the commands in centos.md and go right to the Quickstart commands ssh won't work. The command uno setup accumulo will let you think everything went well but it did not.
Mike Walch [Wed, 2 Jan 2019 21:15:52 +0000 (16:15 -0500)]
Update copyright date (#211)
Mike Miller [Wed, 19 Dec 2018 19:51:31 +0000 (14:51 -0500)]
Update package for crypto service plugin (#209)
Keith Turner [Sat, 17 Nov 2018 21:53:24 +0000 (16:53 -0500)]
Fixes for Hadoop 3 mapreduce (#208)
Mike Walch [Mon, 22 Oct 2018 17:57:56 +0000 (13:57 -0400)]
Upgrade Apache Spark to 2.3.2 (#206)
Mike Walch [Thu, 18 Oct 2018 20:22:11 +0000 (16:22 -0400)]
Separated setup into install & run command (#205)
* Created plugin system
* Updated source code headers for Apache
Mike Walch [Tue, 16 Oct 2018 19:42:58 +0000 (15:42 -0400)]
Updated default Accumulo & Hadoop versions (#204)
* Accumulo is 2.0.0-alpha-1
* Hadoop is 3.1.1
* Remove deprecated property
* Remove tserver.server.threads.minimum as default is OK
Mike Walch [Thu, 4 Oct 2018 20:18:06 +0000 (16:18 -0400)]
Organized Accumulo & Hadoop config by version (#203)
Mike Walch [Thu, 4 Oct 2018 18:18:26 +0000 (14:18 -0400)]
Fixed bug with Accumulo encrypt (#202)
* accumulo.properties needs to contain correct key location
Mike Walch [Thu, 4 Oct 2018 15:02:27 +0000 (11:02 -0400)]
Updates for Hadoop 3 (#200)
Nick Felts [Thu, 4 Oct 2018 14:34:50 +0000 (10:34 -0400)]
Added option to enable encryption (#201)
Mike Walch [Mon, 24 Sep 2018 15:01:52 +0000 (11:01 -0400)]
Fixes #196 Autogenerate the properties needed by Accumulo ITs (#199)
Keith Turner [Fri, 21 Sep 2018 17:12:23 +0000 (13:12 -0400)]
Added Accumulo and Hadoop compat checks (#198)
Sean Busbey [Thu, 20 Sep 2018 17:53:30 +0000 (12:53 -0500)]
When using ACCUMULO_REPO, build with the appropriate Hadoop profile. (#197)
* when HADOOP_VERSION is 3.y.z, build Accumulo with hadoop.profile=3
* otherwise don't specify a hadoop.profile
Sean Busbey [Fri, 14 Sep 2018 19:27:52 +0000 (14:27 -0500)]
Update README to cover clean up. (#194)
Mike Walch [Thu, 6 Sep 2018 19:26:34 +0000 (15:26 -0400)]
Uno improvements (#193)
* Give better error if user shell env doesn't match uno.conf
* Provide better error if checksum not set for expected version
of software
Mike Walch [Wed, 5 Sep 2018 18:38:34 +0000 (14:38 -0400)]
Several updates to Uno (#192)
* Improved console output to include location of
logs and status pages
* Upgraded ZooKeeper to 3.4.13
* Updated Accumulo 2.0 setup to setup HADOOP_HOME
instead of HADOOP_PREFIX
Mike Walch [Wed, 5 Sep 2018 14:37:05 +0000 (10:37 -0400)]
Merge pull request #191 from mikewalch/uno-update
Several updates to Uno
Mike Walch [Tue, 4 Sep 2018 19:32:57 +0000 (15:32 -0400)]
Improved fetch command
* Falls back to Apache archive if tarball is not found on mirror
* Allow fetch of only Hadoop or ZooKeeper
Mike Walch [Fri, 31 Aug 2018 20:08:44 +0000 (16:08 -0400)]
Updates for Hadoop 3
* Using HADOOP_HOME in place of HADOOP_PREFIX
* Using HADOOP_LOG_DIR instead of YARN_LOG_DIR
Mike Walch [Fri, 31 Aug 2018 18:41:32 +0000 (14:41 -0400)]
Adding Hadoop 3.1.1 checksum
Mike Walch [Fri, 31 Aug 2018 15:06:33 +0000 (11:06 -0400)]
Updated Uno to use accumulo.properties for 2.0 (#189)
Mike Walch [Thu, 30 Aug 2018 18:06:07 +0000 (14:06 -0400)]
Fixes Uno on MacOS (#190)
Keith Turner [Tue, 14 Aug 2018 15:59:49 +0000 (11:59 -0400)]
Use conf/uno-local.conf if it exists (#188)
Keith Turner [Mon, 23 Jul 2018 21:31:05 +0000 (17:31 -0400)]
fixes #185 No longer write to stdin (#187)
Mike Walch [Sat, 21 Jul 2018 00:52:58 +0000 (20:52 -0400)]
Adding Hadoop 3.1.0 checksum (#186)
Christopher Tubbs [Thu, 19 Jul 2018 21:55:28 +0000 (17:55 -0400)]
Update to Accumulo 1.9.2 (#184)
Mike Walch [Fri, 13 Jul 2018 15:56:02 +0000 (11:56 -0400)]
Update Hadoop to 2.8.4 (#183)
Christopher Tubbs [Thu, 14 Jun 2018 20:55:43 +0000 (16:55 -0400)]
Allow some env to be set outside config (#182)
I wanted to temporarily set a different version and local host name
without editing the config file, so I thought it would be easier to
allow these environment variables to be set outside the configuration
script. The change allows them to use whatever was set in the
environment, and default to the config file if not set.
Also, add checksum for Hadoop 3.0.2
Mike Walch [Wed, 6 Jun 2018 21:19:29 +0000 (17:19 -0400)]
Merge pull request #181 from ctubbsii/minimize-output-128
Minimize output 128
Mike Walch [Wed, 6 Jun 2018 20:43:18 +0000 (16:43 -0400)]
Updates due refactoring in apache/accumulo#508 (#180)
Christopher Tubbs [Wed, 6 Jun 2018 20:12:59 +0000 (16:12 -0400)]
Fix #128 Minimize setup output
Christopher Tubbs [Wed, 6 Jun 2018 19:56:37 +0000 (15:56 -0400)]
Fix ZooKeeper naming
Christopher Tubbs [Wed, 6 Jun 2018 18:59:25 +0000 (14:59 -0400)]
Fix #178 Use Accumulo 1.9.1 (#179)
Mike Walch [Wed, 2 May 2018 21:59:27 +0000 (17:59 -0400)]
Updated software versions and README.md (#177)
* README.md updates due to move to Apache
Mike Walch [Wed, 4 Apr 2018 18:35:34 +0000 (14:35 -0400)]
Uno now configures accumulo-client.properties (#174)
Mike Walch [Tue, 3 Apr 2018 18:10:40 +0000 (14:10 -0400)]
Adding Accumulo 1.7.4 checksum (#175)
Mike Walch [Thu, 22 Mar 2018 21:09:37 +0000 (17:09 -0400)]
Uno now sets up metrics for Accumulo (#173)
* Created grafana dashboard for Accumulo
* Users should use 'uno setup accumuo --with-metrics'
Mike Walch [Tue, 13 Mar 2018 18:07:29 +0000 (14:07 -0400)]
#166 Consolidate sha files and use grep -F (#172)
Mike Walch [Mon, 12 Mar 2018 19:38:56 +0000 (15:38 -0400)]
Fixes #166 Made it easier to get hashes (#171)
Mike Walch [Wed, 7 Mar 2018 14:41:51 +0000 (09:41 -0500)]
Updated to Fluo YARN 1.0.0 (#169)
Mike Walch [Tue, 27 Feb 2018 18:52:06 +0000 (13:52 -0500)]
Upgraded Fluo version to 1.2.0 (#168)
Mike Walch [Thu, 8 Feb 2018 21:47:10 +0000 (16:47 -0500)]
Upgraded Hadoop to 2.7.5 (#167)
Mike Miller [Sat, 6 Jan 2018 00:34:49 +0000 (19:34 -0500)]
Add doc for centos (#165)
Keith Turner [Fri, 29 Dec 2017 14:32:21 +0000 (09:32 -0500)]
Made metrics use host config (#163)
Keith Turner [Thu, 28 Dec 2017 17:03:18 +0000 (12:03 -0500)]
Document installing xmllint for Ubuntu (#162)
* Add packages need to build native libs
Keith Turner [Thu, 28 Dec 2017 16:40:43 +0000 (11:40 -0500)]
Added setting limits to Ubuntu setup guide (#161)
Mike Walch [Mon, 18 Dec 2017 23:34:50 +0000 (18:34 -0500)]
Uno needs to set fluo.yarn.dfs.root (#160)
Mike Walch [Wed, 13 Dec 2017 20:22:38 +0000 (15:22 -0500)]
Fixed bugs in fetch/setup of metrics (#159)
Mike Walch [Fri, 17 Nov 2017 18:26:33 +0000 (13:26 -0500)]
Upgraded Zookeeper to 3.4.11 (#158)
Mark Owens [Mon, 13 Nov 2017 22:43:16 +0000 (17:43 -0500)]
Consider explicitly setting JAVA_HOME (#156)
* We should consider explicitly setting the JAVA_HOME variable
in the setup-hadoop.sh script. On Ubuntu there appears to be some
issues with the system reading the system JAVA_HOME variable.
See https://stackoverflow.com/questions/
21533725/hadoop-2-2-0-fails-running-start-dfs-sh-with-error-java-home-is-not-set-and-cou/
38613613 for a discussion of the issue.
* Added code to load-env.sh to alert user if JAVA_HOME is not set.
* Removed a check from the README.md file for JAVA_HOME given that it should
not be necessary with JAVA_HOME set explicitly.
Keith Turner [Fri, 27 Oct 2017 15:12:54 +0000 (11:12 -0400)]
Add command that checks requirements.
Keith Turner [Thu, 14 Sep 2017 19:04:37 +0000 (15:04 -0400)]
Merge pull request #152 from mikewalch/upgrade-hadoop
Upgrade Hadoop to 2.7.4
Mark Owens [Thu, 14 Sep 2017 18:46:08 +0000 (14:46 -0400)]
Update uno README.md with additonal information on how to access the Accumulo shell. (#154)
* Added additional documentation to the quickstart section of the README.md to explicitly indicate how to connect to the Accumulo shell.
Mike Walch [Tue, 12 Sep 2017 21:06:32 +0000 (17:06 -0400)]
Upgrade Hadoop to 2.7.4
Mike Walch [Wed, 16 Aug 2017 13:47:05 +0000 (09:47 -0400)]
Set ZOOKEEPER_HOME in fluo-yarn-env.sh (#151)
Mike Walch [Fri, 11 Aug 2017 15:26:16 +0000 (11:26 -0400)]
Updates due to FLUO-842 (#150)
* Added support to fetch and setup fluo-yarn project
* Updated fluo to support fluo-app.properties & fluo-conn.properties
* Created UNO_HOST variable so cluster can use hostname of machine
Mike Walch [Wed, 5 Jul 2017 15:04:00 +0000 (11:04 -0400)]
Update Spark version to 1.6.3