geode-benchmarks.git
2 years agotemporarily exclude flaky tests
Helena A. Bales [Fri, 25 Oct 2019 18:36:24 +0000 (11:36 -0700)] 
temporarily exclude flaky tests

2 years agoexclude broken Noop test until it can be fixed
Helena A. Bales [Thu, 24 Oct 2019 16:45:07 +0000 (09:45 -0700)] 
exclude broken Noop test until it can be fixed

2 years agoUses full dedicated host and adds more configuration options. (#114)
Jacob Barrett [Tue, 22 Oct 2019 16:43:03 +0000 (09:43 -0700)] 
Uses full dedicated host and adds more configuration options. (#114)

* Use full c5-18-xlarge instance type on dedicated host.
* Adds -PwithThread to override benchmark threads.
* Adds -PwithHeap to override max heap.
* Adds -PwithWarmup to override warmup time.
* Adds -PwithDuration to override test duration.

2 years agoFixes target resolution.
Jacob Barrett [Wed, 16 Oct 2019 20:45:43 +0000 (13:45 -0700)] 
Fixes target resolution.

2 years agoAllow repository to by rsync'd from local host rather than cloned.
Jacob Barrett [Tue, 15 Oct 2019 22:57:50 +0000 (15:57 -0700)] 
Allow repository to by rsync'd from local host rather than cloned.

2 years agoAdds more command line configuration options. (#112)
Jacob Barrett [Mon, 30 Sep 2019 16:58:18 +0000 (09:58 -0700)] 
Adds more command line configuration options. (#112)

* Support for selection GC from CMS, G1, Shenandoah, or Z.
* Support for specifying JMV heap size.

* Refactors JVM argument configuration.
* Improved new GC logging

2 years agoGet first host by array reference (#109)
Jacob Barrett [Thu, 19 Sep 2019 19:14:46 +0000 (12:14 -0700)] 
Get first host by array reference (#109)

2 years agoGet first host by array reference (#109)
Jacob Barrett [Thu, 19 Sep 2019 19:02:50 +0000 (12:02 -0700)] 
Get first host by array reference (#109)

2 years agoCreate dedicated hosts (#109)
Jacob Barrett [Wed, 18 Sep 2019 02:52:50 +0000 (19:52 -0700)] 
Create dedicated hosts (#109)

2 years agoRevert "Create dedicated hosts (#109)"
Jacob Barrett [Wed, 18 Sep 2019 03:16:03 +0000 (20:16 -0700)] 
Revert "Create dedicated hosts (#109)"

This reverts commit 410f23a16886a3fb33fd5eb5cedc9620e092dcba.

2 years agoCreate dedicated hosts (#109)
Jacob Barrett [Wed, 18 Sep 2019 02:52:50 +0000 (19:52 -0700)] 
Create dedicated hosts (#109)

2 years agoIgnore PartitionedFunctionExecutionBenchmark
Jacob Barrett [Tue, 17 Sep 2019 21:56:51 +0000 (14:56 -0700)] 
Ignore PartitionedFunctionExecutionBenchmark

2 years agoRevert "Create dedicated hosts (#109)"
Jacob Barrett [Mon, 16 Sep 2019 18:39:38 +0000 (11:39 -0700)] 
Revert "Create dedicated hosts (#109)"

This reverts commit 2adaf56de71fd4bdceec97c2387eaacb4639e63c.

2 years agoCreate dedicated hosts (#109)
Kamilla Aslami [Fri, 13 Sep 2019 20:33:41 +0000 (13:33 -0700)] 
Create dedicated hosts (#109)

Co-authored-by: Kamilla Aslami <kaslami@pivotal.io>
Co-authored-by: Jacob Barrett <jbarrett@pivotal.io>
2 years agoRevert "Prevent too many keys being offered to ssh server (#103)"
Helena A. Bales [Fri, 13 Sep 2019 16:47:12 +0000 (09:47 -0700)] 
Revert "Prevent too many keys being offered to ssh server (#103)"

This reverts commit 5062dccfa91cb6acebb18cd396810932bce1163a.

This commit appears to cause benchmark task in CI to timeout. Reverting
while we investigate root cause.

2 years agoPrevent too many keys being offered to ssh server (#103)
Donal Evans [Thu, 12 Sep 2019 18:01:03 +0000 (11:01 -0700)] 
Prevent too many keys being offered to ssh server (#103)

2 years agoCheck that security group exists (#107)
Kamilla Aslami [Thu, 12 Sep 2019 17:57:44 +0000 (10:57 -0700)] 
Check that security group exists (#107)

* Check that security group exists
* Throw an exception after max retries + refactoring

2 years agoAdd *LongBenchmark (#110)
Kamilla Aslami [Thu, 12 Sep 2019 17:52:13 +0000 (10:52 -0700)] 
Add *LongBenchmark (#110)

Add prefill and benchmarks using Longs

2 years agoEnabled PutAll benchmarks (#106)
Kamilla Aslami [Fri, 6 Sep 2019 17:31:22 +0000 (10:31 -0700)] 
Enabled PutAll benchmarks (#106)

2 years agoStabilizes query benchmarks (#104)
Kamilla Aslami [Thu, 5 Sep 2019 00:30:24 +0000 (17:30 -0700)] 
Stabilizes query benchmarks (#104)

* Pre-fill region from client so that all servers have PDX instances
* Change query range and number of threads for query benchmarks

2 years agoFix hash map keys in PutAllTask (#105)
Kamilla Aslami [Tue, 3 Sep 2019 22:49:04 +0000 (15:49 -0700)] 
Fix hash map keys in PutAllTask (#105)

2 years agoStabilizes function benchmarks (#101)
Jacob Barrett [Tue, 27 Aug 2019 23:29:42 +0000 (16:29 -0700)] 
Stabilizes function benchmarks (#101)

* New LongRange object for managing ranges of longs.
* Only get 1 value.
* Balanced CPU utilization and threads.

2 years agoExpanding and clarifying readme files for using aws and scripts. (#102)
Donal Evans [Mon, 26 Aug 2019 19:11:46 +0000 (12:11 -0700)] 
Expanding and clarifying readme files for using aws and scripts. (#102)

2 years ago Fixed spotless configuration to support groovy and gradle. (#100)
Kamilla Aslami [Wed, 21 Aug 2019 20:06:25 +0000 (13:06 -0700)] 
 Fixed spotless configuration to support groovy and gradle. (#100)

* Fixed spotless configuration to support groovy and gradle
* Spotless applied

Co-authored-by: Murtuza Boxwala <mboxwala@pivotal.io>
Co-authored-by: Kamilla Aslami <kaslami@pivotal.io>
Co-authored-by: Jacob Barrett <jbarrett@pivotal.io>
2 years agoRemove unattended upgrades so ubuntu doesn't try to upgrade itself mid
Sean Goller [Mon, 19 Aug 2019 19:21:18 +0000 (12:21 -0700)] 
Remove unattended upgrades so ubuntu doesn't try to upgrade itself mid
job.

Authored-by: Sean Goller <sgoller@pivotal.io>
3 years agoLower thread count for improved stability. (#98)
Jacob Barrett [Mon, 12 Aug 2019 19:44:48 +0000 (12:44 -0700)] 
Lower thread count for improved stability. (#98)

By reducing thread count to 10x CPUs we found that on the same instances we only lose about 4% of throughput but seem more than 40% improvement in latency. More importantly the variation between runs drops significantly. This variation was greater than 10% on Java 11 and 3% on Java 8. When lowered to 10x threads we see closer to 1% variation for both Java 11 and 8.

3 years agodisable replicated and partitioned putAll benchmark due to flakiness (#95)
Helena Bales [Thu, 25 Jul 2019 17:43:46 +0000 (10:43 -0700)] 
disable replicated and partitioned putAll benchmark due to flakiness (#95)

3 years agoAdded --baselineDir and branchDir options to analyze_tests script (#93)
Kamilla Aslami [Thu, 25 Jul 2019 16:35:39 +0000 (09:35 -0700)] 
Added --baselineDir and branchDir options to analyze_tests script (#93)

3 years agoUser can run benchmarks with SecurityManager (#91)
Murtuza Boxwala [Mon, 22 Jul 2019 19:31:28 +0000 (15:31 -0400)] 
User can run benchmarks with SecurityManager (#91)

Co-authored-by: Murtuza Boxwala <mboxwala@pivotal.io>
Co-authored-by: Kamilla Aslami <kaslami@pivotal.io>
3 years agoGenerate a self-signed certificate for SSL (#90)
Murtuza Boxwala [Mon, 22 Jul 2019 16:27:29 +0000 (12:27 -0400)] 
Generate a self-signed certificate for SSL (#90)

Co-authored-by: Murtuza Boxwala <mboxwala@pivotal.io>
Co-authored-by: Kamilla Aslami <kaslami@pivotal.io>
3 years agoUser can run benchmarks with alternative JVM (#89)
Kamilla Aslami [Wed, 17 Jul 2019 16:37:13 +0000 (09:37 -0700)] 
User can run benchmarks with alternative JVM (#89)

* Use alternative JVM for benchmark/test
* Use java.home for executing remote jvm.
* Disable GC logging if not Java 8
* Updated the README.md to be clearer.
* Added ClientServerTopologyTest file

Co-authored-by: Murtuza Boxwala <mboxwala@pivotal.io>
Co-authored-by: Kamilla Aslami <kaslami@pivotal.io>
3 years agoAdd option to Gradle command to run benchmark with SSL enabled (#88)
Kamilla Aslami [Thu, 11 Jul 2019 23:23:09 +0000 (16:23 -0700)] 
Add option to Gradle command to run benchmark with SSL enabled (#88)

Add an option for running with SSL enabled to benchmark gradle and scripts.

3 years agoFixes parallel task execution.
Jacob Barrett [Fri, 5 Jul 2019 22:20:15 +0000 (15:20 -0700)] 
Fixes parallel task execution.

3 years agoAdds putAll benchmarks (#79)
Jacob Barrett [Tue, 2 Jul 2019 19:50:29 +0000 (12:50 -0700)] 
Adds putAll benchmarks (#79)

3 years agoSet membership timeout to be more resilient to benchmark load (#87)
Kamilla Aslami [Tue, 25 Jun 2019 15:44:15 +0000 (08:44 -0700)] 
Set membership timeout to be more resilient to benchmark load (#87)

3 years agoAutomatically choose the new high watermark commit (#86)
Kamilla Aslami [Tue, 25 Jun 2019 15:43:31 +0000 (08:43 -0700)] 
Automatically choose the new high watermark commit (#86)

Prints potential new high watermark

3 years agoUpdated the README.md to be clearer. (#85)
Kamilla Aslami [Fri, 21 Jun 2019 04:31:18 +0000 (21:31 -0700)] 
Updated the README.md to be clearer. (#85)

3 years agoMerge pull request #84 from mhansonp/ReadMeAddition
Helena Bales [Wed, 12 Jun 2019 18:44:56 +0000 (11:44 -0700)] 
Merge pull request #84 from mhansonp/ReadMeAddition

Updating the README.md to be clearer.

3 years agodisable flaky PartitionedNonIndexedQueryBenchmark
Helena A. Bales [Fri, 31 May 2019 22:50:34 +0000 (15:50 -0700)] 
disable flaky PartitionedNonIndexedQueryBenchmark

3 years agoUpdating the README.md to be clearer. 84/head
Mark Hanson [Fri, 17 May 2019 21:16:01 +0000 (14:16 -0700)] 
Updating the README.md to be clearer.

3 years agoMinor changes to help message (#83)
mhansonp [Wed, 15 May 2019 17:47:00 +0000 (10:47 -0700)] 
Minor changes to help message (#83)

3 years agoMake expire_clusters.sh executable from anywhere. (#82)
Sean Goller [Fri, 10 May 2019 20:09:18 +0000 (13:09 -0700)] 
Make expire_clusters.sh executable from anywhere. (#82)

3 years agoFix expire_clusters to actually do that. (#81)
Sean Goller [Fri, 10 May 2019 19:02:04 +0000 (12:02 -0700)] 
Fix expire_clusters to actually do that. (#81)

3 years agoAdd expire_clusters script.
Helena Bales [Fri, 10 May 2019 18:56:39 +0000 (11:56 -0700)] 
Add expire_clusters script.

Authored-by: Sean Goller <sgoller@pivotal.io>
3 years agoMerge pull request #80 from balesh2/fixREADME
Helena Bales [Mon, 29 Apr 2019 18:38:14 +0000 (11:38 -0700)] 
Merge pull request #80 from balesh2/fixREADME

fix readme for copy to cluster script

3 years agofix readme for copy to cluster script 80/head
Helena A. Bales [Mon, 29 Apr 2019 18:26:01 +0000 (11:26 -0700)] 
fix readme for copy to cluster script

3 years agoDisable replicated query and function benchmarks.
Jacob Barrett [Fri, 26 Apr 2019 03:02:19 +0000 (20:02 -0700)] 
Disable replicated query and function benchmarks.

Re-enable partitioned.

3 years agoDisable partitioned query and function benchmarks.
Jacob Barrett [Fri, 26 Apr 2019 03:00:46 +0000 (20:00 -0700)] 
Disable partitioned query and function benchmarks.

3 years agoDisable query again
Jacob Barrett [Wed, 24 Apr 2019 21:43:18 +0000 (14:43 -0700)] 
Disable query again

3 years agoSpotless
Jacob Barrett [Wed, 24 Apr 2019 19:11:02 +0000 (12:11 -0700)] 
Spotless

3 years agoMerge pull request #78 from moleske/moleske-patch-1
Helena Bales [Wed, 24 Apr 2019 18:55:29 +0000 (11:55 -0700)] 
Merge pull request #78 from moleske/moleske-patch-1

Remove dead GCP link

3 years agoReduce threads on query benchmarks.
Jacob Barrett [Wed, 24 Apr 2019 16:18:42 +0000 (09:18 -0700)] 
Reduce threads on query benchmarks.

3 years agoCleanup PDX objects.
Jacob Barrett [Wed, 24 Apr 2019 16:02:53 +0000 (09:02 -0700)] 
Cleanup PDX objects.

Reduces wasted allocations on hashCode().
Reduces wast in allocations on toString().

3 years agoRe-enable query benchmarks.
Jacob Barrett [Wed, 24 Apr 2019 05:04:17 +0000 (22:04 -0700)] 
Re-enable query benchmarks.

3 years agoRemove dead GCP link 78/head
M. Oleske [Tue, 23 Apr 2019 22:33:32 +0000 (15:33 -0700)] 
Remove dead GCP link

3 years agoMove threads configuration.
Jacob Barrett [Fri, 19 Apr 2019 14:03:11 +0000 (07:03 -0700)] 
Move threads configuration.
Run fewer threads on function and queries.
Refactor common elements.

3 years agoSpotless
Jacob Barrett [Fri, 19 Apr 2019 18:12:17 +0000 (11:12 -0700)] 
Spotless

3 years agoDisables function benchmarks.
Jacob Barrett [Fri, 19 Apr 2019 18:03:24 +0000 (11:03 -0700)] 
Disables function benchmarks.

3 years agoUse larger disk
Jacob Barrett [Fri, 19 Apr 2019 02:48:26 +0000 (19:48 -0700)] 
Use larger disk

3 years agoAlways reset geode repo.
Jacob Barrett [Fri, 19 Apr 2019 01:03:34 +0000 (18:03 -0700)] 
Always reset geode repo.

3 years agoDisable *IndexedQueryBenchmark
Jacob Barrett [Thu, 18 Apr 2019 23:39:28 +0000 (16:39 -0700)] 
Disable *IndexedQueryBenchmark

Currently unstable.

3 years agoDisable *NonIndexedQueryBenchmark
Jacob Barrett [Thu, 18 Apr 2019 23:37:06 +0000 (16:37 -0700)] 
Disable *NonIndexedQueryBenchmark

Currently unstable.

3 years agoAlways cleanup benchmark directory.
Jacob Barrett [Thu, 18 Apr 2019 22:58:22 +0000 (15:58 -0700)] 
Always cleanup benchmark directory.

3 years agoFixes install of geode artifacts.
Jacob Barrett [Thu, 18 Apr 2019 21:38:00 +0000 (14:38 -0700)] 
Fixes install of geode artifacts.

Uses publishToMavenLocal when available or install on older builds.

Updates existing repo rather than deleting it.

3 years agoFixes parameter parsing in AWS scripts.
Jacob Barrett [Thu, 18 Apr 2019 16:46:37 +0000 (09:46 -0700)] 
Fixes parameter parsing in AWS scripts.

3 years agoGEODE-6628: Increase thread count (#76)
Helena Bales [Fri, 12 Apr 2019 19:58:11 +0000 (12:58 -0700)] 
GEODE-6628: Increase thread count (#76)

3 years agoRAT fixes. (#75)
Sean Goller [Wed, 10 Apr 2019 16:37:30 +0000 (09:37 -0700)] 
RAT fixes. (#75)

Co-authored-by: Helena Bales <hbales@pivotal.io>
Co-authored-by: Sean Goller <sgoller@pivotal.io>
3 years agofind and destroy clusters that were started more than 7 days ago (#74)
Sean Goller [Tue, 9 Apr 2019 23:45:17 +0000 (16:45 -0700)] 
find and destroy clusters that were started more than 7 days ago (#74)

Co-authored-by: Helena Bales <hbales@pivotal.io>
Co-authored-by: Sean Goller <sgoller@pivotal.io>
3 years agoFinish up unique identification of builds. (#73)
Sean Goller [Tue, 9 Apr 2019 21:49:49 +0000 (14:49 -0700)] 
Finish up unique identification of builds. (#73)

Authored-by: Sean Goller <sgoller@pivotal.io>
3 years agoMetadata generation tweaks and database submission code (#72)
Sean Goller [Fri, 22 Mar 2019 19:31:11 +0000 (12:31 -0700)] 
Metadata generation tweaks and database submission code (#72)

* Refactor and tweaking database submission.
Co-authored-by: Sean Goller <sgoller@pivotal.io>
Co-authored-by: Helena Bales <hbales@pivotal.io>
3 years agoMerge pull request #71 from balesh2/updateREADME
Helena Bales [Wed, 20 Mar 2019 22:48:45 +0000 (15:48 -0700)] 
Merge pull request #71 from balesh2/updateREADME

update profiling instructions in the readme

3 years agoadd info on path to profiler 71/head
Helena A. Bales [Wed, 20 Mar 2019 22:31:21 +0000 (15:31 -0700)] 
add info on path to profiler

3 years agoupdate profiling instructions in the readme
Helena A. Bales [Wed, 20 Mar 2019 20:45:54 +0000 (13:45 -0700)] 
update profiling instructions in the readme

* add initial configuration information for YourKit
* fix path to private key when setting up connection authentication in
YourKit

3 years agoMerge pull request #70 from balesh2/updateREADME
Helena Bales [Thu, 14 Mar 2019 17:53:43 +0000 (10:53 -0700)] 
Merge pull request #70 from balesh2/updateREADME

update the readme with instructions for profiling

3 years agoupdate the readme with instructions for profiling 70/head
Helena A. Bales [Tue, 12 Mar 2019 22:07:18 +0000 (15:07 -0700)] 
update the readme with instructions for profiling

3 years agoAdd build_identifier.
Sean Goller [Tue, 12 Mar 2019 18:35:07 +0000 (11:35 -0700)] 
Add build_identifier.

Authored-by: Sean Goller <sgoller@pivotal.io>
3 years agoGEODE-6458: add profiler argument support (#65)
Helena Bales [Tue, 12 Mar 2019 17:18:53 +0000 (10:18 -0700)] 
GEODE-6458: add profiler argument support (#65)

* Added profiler argument support.

* take profile snapshot on jvm close and copy snapshot with benchmark results

Signed-off-by: Jacob Barrett <jbarrett@pivotal.io>
* More string replacements.

* remove dependency on StringUtil since Geode may not have that

Signed-off-by: Helena A. Bales <hbales@pivotal.io>
* GEODE-6458: add options for profiler

add options to run with a profiler, attached to all members.

Signed-off-by: Sean Goller <sgoller@pivotal.io>
3 years agoMerge pull request #68 from apache/feature/GEODE-6508
Darrel Schneider [Tue, 12 Mar 2019 00:12:58 +0000 (17:12 -0700)] 
Merge pull request #68 from apache/feature/GEODE-6508

GEODE-6508: update aws README.md

3 years agoMerge pull request #69 from balesh2/GEODE-6510
Helena Bales [Mon, 11 Mar 2019 23:22:16 +0000 (16:22 -0700)] 
Merge pull request #69 from balesh2/GEODE-6510

GEODE-6510: update scripts to use new key location

3 years agoGEODE-6510: update scripts to use new key location 69/head
Helena A. Bales [Mon, 11 Mar 2019 21:35:00 +0000 (14:35 -0700)] 
GEODE-6510: update scripts to use new key location

3 years agoGEODE-6508: update aws README.md 68/head
Darrel Schneider [Mon, 11 Mar 2019 21:11:37 +0000 (14:11 -0700)] 
GEODE-6508: update aws README.md

3 years agoGEODE-6502: update README (#67)
Helena Bales [Mon, 11 Mar 2019 16:43:34 +0000 (09:43 -0700)] 
GEODE-6502: update README (#67)

Update the readme to reflect all recent script changes, including
changing from positional to named arguments for launching and destroying
clusters, the addition of a --ci option for launching and destroying
clusters for use in continuous integration, and the addition of long
command line options for all scripts.

3 years agoGEODE-6480: break so that options are passed on (#66)
Helena Bales [Mon, 11 Mar 2019 16:43:16 +0000 (09:43 -0700)] 
GEODE-6480: break so that options are passed on (#66)

break out of the case statement so that options after '--' when running
tests and running against the baseline are passed on to gradle.

3 years agoGEODE-6502: update README 67/head
Helena A. Bales [Fri, 8 Mar 2019 20:53:38 +0000 (12:53 -0800)] 
GEODE-6502: update README

Update the readme to reflect all recent script changes, including
changing from positional to named arguments for launching and destroying
clusters, the addition of a --ci option for launching and destroying
clusters for use in continuous integration, and the addition of long
command line options for all scripts.

3 years agoGEODE-6479: add username to aws keypair prefix (#62)
Helena Bales [Fri, 8 Mar 2019 18:35:44 +0000 (10:35 -0800)] 
GEODE-6479: add username to aws keypair prefix (#62)

* GEODE-6479: add username to aws keypair prefix

Get the current username from system properties and add it to the aws
prefix to make the instance owners more immediately identifiable. This
should help reduce the number of instances that are left running with no
clear owner.

If it is run in CI, the username does not get added.

Signed-off-by: Sean Goller <sgoller@pivotal.io>
3 years agoAdd python script to submit database results. (#64)
Sean Goller [Thu, 7 Mar 2019 17:28:47 +0000 (09:28 -0800)] 
Add python script to submit database results. (#64)

* Initial script to submit benchmark to database.

* Creates benchmark_build entry, but doesn't submit results yet.

Co-authored-by: Sean Goller <sgoller@pivotal.io>
Co-authored-by: Nabarun Nag <nabarunnag@pivotal.io>
* Add latency results.

Co-authored-by: Sean Goller <sgoller@pivotal.io>
Co-authored-by: Nabarun Nag <nabarunnag@pivotal.io>
* Add throughput, remove debug print()s.

Authored-by: Sean Goller <sgoller@pivotal.io>
3 years agoGEODE-6480: Just Do It Day: Use long cli options (#63)
Helena Bales [Wed, 6 Mar 2019 23:11:32 +0000 (15:11 -0800)] 
GEODE-6480: Just Do It Day: Use long cli options (#63)

Add long CLI options for scripts to run benchmarks on AWS instances.
Backwards compatible with previous short CLI options.

Signed-off-by: Robert Houghton <rhoughton@pivotal.io>
3 years agoChange bash tests to double brackets and fix baseline branch test. (#61)
Sean Goller [Fri, 1 Mar 2019 19:32:34 +0000 (11:32 -0800)] 
Change bash tests to double brackets and fix baseline branch test. (#61)

Co-authored-by: Sean Goller <sgoller@pivotal.io>
Co-authored-by: Nabarun Nag <nabarunnag@pivotal.io>
3 years agoClean up metadata generation. Add all test names to metadata. (#60)
Sean Goller [Fri, 1 Mar 2019 00:44:11 +0000 (16:44 -0800)] 
Clean up metadata generation. Add all test names to metadata. (#60)

Co-authored-by: Sean Goller <sgoller@pivotal.io>
Co-authored-by: Nabarun Nag <nabarunnag@pivotal.io>
3 years agoAdds copy to cluster script
Jacob Barrett [Thu, 28 Feb 2019 17:06:17 +0000 (09:06 -0800)] 
Adds copy to cluster script

3 years agoFix metadata (#59)
Sean Goller [Wed, 27 Feb 2019 23:28:09 +0000 (15:28 -0800)] 
Fix metadata (#59)

* Fix ssh options for running tests.

* Actually fix ssh options.

3 years agoFix ssh options for running tests. (#58)
Sean Goller [Wed, 27 Feb 2019 23:14:58 +0000 (15:14 -0800)] 
Fix ssh options for running tests. (#58)

3 years agoRefactor metadata production and management. (#57)
Sean Goller [Wed, 27 Feb 2019 22:56:45 +0000 (14:56 -0800)] 
Refactor metadata production and management. (#57)

* Tests now output metadata if the metadata file doesn't exist.
* benchmark run metadata.json is actually json.
* Create configuration directory to store cluster information.
* Move SSH private key for cluster to configuration directory.
* Create metadata for cluster, currently including an instance ID and
  the list of IPs in the cluster.
* Delete metadata when the cluster is destroyed.

3 years agoGEODE-6411: Fixes baseline version option.
Jacob Barrett [Wed, 27 Feb 2019 05:04:44 +0000 (21:04 -0800)] 
GEODE-6411: Fixes baseline version option.

3 years agoGEODE-6444: Store GC logs in files (#56)
Nabarun Nag [Mon, 25 Feb 2019 15:58:13 +0000 (07:58 -0800)] 
GEODE-6444: Store GC logs in files (#56)

* Store the GC logs in a file.
* Print the GC logs in the System.out / System.err in parallel while the benchmark is being executed in parallel.
* Using a thread pool for execution of runAsync and not depend on fork join pools
        * Disabling the dstat probe

Co-authored-by: Dan Smith <dsmith@pivotal.io>
Co-authored-by: nabarunnag <nag@cs.wisc.edu>
Co-authored-by: Jacob Barrett <jbarrett@pivotal.io>
3 years agoGEODE-6411: Fixes version/branch logic.
Jacob Barrett [Thu, 21 Feb 2019 00:07:40 +0000 (16:07 -0800)] 
GEODE-6411: Fixes version/branch logic.

3 years agoGEODE-6411: Fixes help
Jacob Barrett [Wed, 20 Feb 2019 20:13:59 +0000 (12:13 -0800)] 
GEODE-6411: Fixes help

- Adds run_on_cluster script
  `./run_on_cluster.sh -t cluster -- pkill java`

3 years agoGEODE-6411: Fixes quoting
Jacob Barrett [Wed, 20 Feb 2019 16:20:19 +0000 (08:20 -0800)] 
GEODE-6411: Fixes quoting

3 years agoGEODE-6411: Allow alternative repo (#55)
Jacob Barrett [Wed, 20 Feb 2019 04:54:50 +0000 (20:54 -0800)] 
GEODE-6411: Allow alternative repo (#55)

- Arguments after -- will be passed to benchmark gradle task.
  Example: Add `--tests MyTest` to run specific benchmark.

Authored-by: Jacob Barrett <jbarrett@pivotal.io>
3 years agoGEODE-6394: set pool idle-timeout to be infinite (#54)
Helena Bales [Fri, 15 Feb 2019 00:21:10 +0000 (16:21 -0800)] 
GEODE-6394: set pool idle-timeout to be infinite (#54)

The client was dropping connections to the server when it shouldn't
have. Setting the pool's idle-timeout from the default of 5 seconds to
have no limit resolved this issue.