geode.git
3 months agoGEODE-9980: Improve error handling of serial filters (#7355) kirklund-fork/GEODE-9758-support_1.14-02
Kirk Lund [Thu, 10 Feb 2022 18:53:21 +0000 (10:53 -0800)] 
GEODE-9980: Improve error handling of serial filters (#7355)

Improves the error handling of serial filter configuration and
filtering. The API throws a runtime exception wrapping any thrown
exceptions.

When geode.enableGlobalSerialFilter is FALSE:
* Startup succeeds without throwing any exceptions even if an older
  version of Java throws "java.lang.ClassNotFoundException
  sun.misc.ObjectInputFilter".

When geode.enableGlobalSerialFilter is TRUE:
* Startup fails by throwing an exception when configuration of serial
  filter fails for any reason.

Renames ObjectInputFilter to avoid confusion with the Java interface of
the same name.

Fixes a bug found in ReflectiveFacadeGlobalSerialFilterTest which
resulted in configuring a non-mocked process-wide serial filter that
polluted the JVM for all later tests.

Fixes other minor details in LocatorLauncher, InternalDataSerializer
and various related tests.

(cherry picked from commit ce57e9fd2b8b644cadc469209e12e4fbd281e0d9)
(cherry picked from commit 6ecdce0d9ef9040f3bbb90c8ea4ff5eb99d712fc)

3 months agoGEODE-9758: Add internal serial filter API (#7217)
Kirk Lund [Tue, 18 Jan 2022 19:01:25 +0000 (11:01 -0800)] 
GEODE-9758: Add internal serial filter API (#7217)

GEODE-9758: Add internal serial filter API #7217

Expand ObjectInputStreamFilterWrapper to be an internal API which
supports all of Geode's uses of Java's ObjectInputFilter.

Introduce a new system property, geode.enableGlobalSerialFilter, to
enable a process-wide filter with all serializable Geode classes on the
classpath and the value of serializable-object-filter accept-listed.

To enable the process-wide filter with GFSH start commands, add:

* --J=-Dgeode.enableGlobalSerialFilter=true

Functional Capabilities

The internal API lives in geode-serialization and works on OpenJDK
based JREs providing a facade for Java's ObjectInputFilter in Java 8
and Java 9 or greater using reflection. The API provides the following
capabilities:

* creating an ObjectInputFilter
* setting an ObjectInputFilter on an ObjectInputStream
* getting an ObjectInputFilter from a ObjectInputStream
* setting a process-wide ObjectInputFilter
* getting a process-wide ObjectInputFilter

Design Notes

The API defines the following primary interface types:

* factory interfaces for creating instances of types within the API
* filter interfaces to split out single ops from Java's
  ObjectInputFilter
* configuration interfaces for handling system properties, logging,
  and config validation

The concrete classes in the API receive parameters injected via a
constructor for any collaborators that are not specified by the
interfaces. This is intentional even when the instance is only used
once before de-referencing it. All collaborators that are defined in
the interface are passed in as parameters to the implementing
method; all others are passed in via the constructor and stored as
fields.

(cherry picked from commit 7978abf34707d11da45cff0b7cb7445f18d21438)

3 months agoGEODE-9879: Extract SystemProperty to geode-common (#7177)
Kirk Lund [Mon, 20 Dec 2021 18:53:32 +0000 (10:53 -0800)] 
GEODE-9879: Extract SystemProperty to geode-common (#7177)

Extract part of SystemPropertyHelper to geode-common for use in
modules that are upstream from geode-core.

Define new DEFAULT_PREFIX that maps to GEODE_PREFIX and use that
everywhere that GEODE_PREFIX was previously used.

* Inline prefix constants in SystemPropertyHelper
* Use static imports for system property prefixes.
* Split up large tests in SystemPropertyHelperTest.
* Fix JAXBService

(cherry picked from commit ebf8479fffb5775b1f45801aa9382c2dad7106e0)

3 months agoGEODE-9758: Move ClassUtils to geode-common (#7166)
Kirk Lund [Fri, 10 Dec 2021 19:28:17 +0000 (11:28 -0800)] 
GEODE-9758: Move ClassUtils to geode-common (#7166)

(cherry picked from commit b6fca291378a1bc334b0f9927c899a1892442939)

3 months agoGEODE-9758: Move SanctionedSerializables to filter package (#7165)
Kirk Lund [Thu, 9 Dec 2021 18:15:20 +0000 (10:15 -0800)] 
GEODE-9758: Move SanctionedSerializables to filter package (#7165)

Move SanctionedSerializables to new package
org.apache.geode.internal.serialization.filter.

(cherry picked from commit db64b4948e790d61e82f95ae6163a62adc4c67fb)

3 months agoGEODE-10101: Bump version to 1.14.5
Dick Cavender [Fri, 18 Mar 2022 16:50:20 +0000 (09:50 -0700)] 
GEODE-10101: Bump version to 1.14.5

As part of the Geode Release Process, the build number must
be rolled forward so work can begin on the next release

3 months agoGEODE-10101: Replace 1.14.3 with 1.14.4 as old version
Dick Cavender [Fri, 18 Mar 2022 16:50:08 +0000 (09:50 -0700)] 
GEODE-10101: Replace 1.14.3 with 1.14.4 as old version

Replace 1.14.3 with 1.14.4 in old versions on support/1.14
to enable rolling upgrade tests from 1.14.4

The serialization version has not changed between 1.14.3 and 1.14.4,
so there should be no need to keep both

3 months agoGEODE-10101: update Dockerfile to apache-geode 1.14.4
Dick Cavender [Fri, 18 Mar 2022 16:45:42 +0000 (09:45 -0700)] 
GEODE-10101: update Dockerfile to apache-geode 1.14.4

The Dockerfile is updated _after_ the release is already tagged,
because it needs to embed the sha256 of the release

3 months agoGEODE-10100: Replace 1.13.7 with 1.13.8 as old version
Dick Cavender [Tue, 15 Mar 2022 22:04:28 +0000 (15:04 -0700)] 
GEODE-10100: Replace 1.13.7 with 1.13.8 as old version

Replace 1.13.7 with 1.13.8 in old versions on support/1.14
to enable rolling upgrade tests from 1.13.8

The serialization version has not changed between 1.13.7 and 1.13.8,
so there should be no need to keep both

(cherry picked from commit ea783016b775e45f59ca17bc08a40d90921ffa4f)

3 months agoGEODE-10103: Retrieve full region path names (#7419)
Barry Oglesby [Wed, 9 Mar 2022 17:11:30 +0000 (07:11 -1000)] 
GEODE-10103: Retrieve full region path names (#7419)

* GEODE-10103: Retrieve full region path names

This commit modifies RebalanceOperationPerformer getMemberRegionList
to invoke listAllRegionPaths instead of listNames.

(cherry picked from commit 8610ee70d470a8b30ab067db912bd0ac345d9df0)
(cherry picked from commit d8f5afcecab615113c4326a32e9f56e0dfaa44f6)

3 months agoGEODE-9910: Stop embedded locator after failed start (#7393)
Barry Oglesby [Mon, 7 Mar 2022 18:50:19 +0000 (08:50 -1000)] 
GEODE-9910: Stop embedded locator after failed start (#7393)

The start-locator property causes a locator to be started when the
InternalDistributedSystem is initialized. The initialize method creates
the locator and then creates a ClusterDistributionManager. If the
creation of the ClusterDistributionManager failed, the started locator
was not stopped. This change addresses that by stopping the locator if
an exception occurs.

(cherry picked from commit 72665b1ec5c6a6b91d0d6c57e997c23033578c58)
(cherry picked from commit 5a32ec00bdbd949bc473322c3643f3d96165d62d)

3 months agoGEODE-10099: Add 1.12.9 as old version
Dick Cavender [Thu, 10 Mar 2022 02:09:39 +0000 (18:09 -0800)] 
GEODE-10099: Add 1.12.9 as old version

Adds 1.12.9 to old versions on develop

(cherry picked from commit 5243f68505eaca5758c990473b3df527635b25f7)
(cherry picked from commit 75145f3347eb3a081f9675de01d63527ba90263f)

4 months agoGEODE-10093 - Fixed attr issue in Delta Session (#7405) (#7413) rel/v1.14.4 rel/v1.14.4.RC1
BenjaminPerryRoss [Wed, 2 Mar 2022 22:27:08 +0000 (14:27 -0800)] 
GEODE-10093 - Fixed attr issue in Delta Session (#7405) (#7413)

* GEODE-10093 - Fixed attr issue in Delta Session

(cherry picked from commit e040759cd1e42df377501cd423967d549ce2bfab)

4 months agoGEODE-9990: turn DiskAccessException into CacheClosedException (#7334) (#7379)
Joris Melchior [Wed, 23 Feb 2022 18:30:48 +0000 (13:30 -0500)] 
GEODE-9990: turn DiskAccessException into CacheClosedException (#7334) (#7379)

* GEODE-9990: turn DiskAccessException into CacheClosedException

- when DiskInitFile is in closed state and DiskStoreImpl is closed or
  closing
- catch DiskAccessException in PRHARedundancyProvider and turn into
  CacheClosedException if cache closing is in progress
- change CreateBucketMessage to handle DiskAccessException as cause of
  ReplyException

(cherry picked from commit a98197b5d0a3a2547e0581e475dcabaa82e6e92f)

4 months agoGEODE-10057: Correct geode-for-redis docs
Dave Barnes [Wed, 16 Feb 2022 19:11:20 +0000 (11:11 -0800)] 
GEODE-10057: Correct geode-for-redis docs

4 months agoGEODE-9817: Enable customized source set paths for ClassAnalysisRule (#7367)
Kirk Lund [Wed, 16 Feb 2022 09:12:28 +0000 (01:12 -0800)] 
GEODE-9817: Enable customized source set paths for ClassAnalysisRule (#7367)

Adds support for customizing source set paths of ClassAnalysisRule.

PROBLEM

Modules external to Geode must be structured the same as Geode
source code in order to use ClassAnalysisRule and the
Analyze*Serializables tests. This is necessary to better facilitate
pluggability of modules that need to provide sanctioned serializable
lists.

SOLUTION

Add source set path customization to ClassAnalysisRule, introduce
a new layer of Analyze*Serializables test base classes that can be
directly extended in order to customize source set paths in
ClassAnalysisRule. Also includes improvements to some iterating
of classes during analysis.

[prereq for backport of GEODE-9980 and GEODE-9758]

(cherry picked from commit 5d1e91932dff296632916a6ceccfb36039357acd)

5 months agoGEODE-9973: Correct docs regarding P2P socket timeout behaviour (#7310)
Donal Evans [Wed, 26 Jan 2022 22:17:23 +0000 (14:17 -0800)] 
GEODE-9973: Correct docs regarding P2P socket timeout behaviour (#7310)

5 months agoGEODE-9923: Add log message troubleshooting info from support team community (#7296)
Dave Barnes [Mon, 24 Jan 2022 18:40:19 +0000 (10:40 -0800)] 
GEODE-9923: Add log message troubleshooting info from support team community (#7296)

5 months agoBumping version to 1.14.4
Dick Cavender [Wed, 26 Jan 2022 00:00:10 +0000 (16:00 -0800)] 
Bumping version to 1.14.4

5 months agoadd 1.14.3 to old versions on support/1.14
Dick Cavender [Wed, 26 Jan 2022 00:00:00 +0000 (16:00 -0800)] 
add 1.14.3 to old versions on support/1.14

5 months agoupdate Dockerfile to apache-geode 1.14.3
Dick Cavender [Tue, 25 Jan 2022 23:56:00 +0000 (15:56 -0800)] 
update Dockerfile to apache-geode 1.14.3

5 months agoadd 1.13.7 to old versions on develop (#7292)
Dick Cavender [Thu, 20 Jan 2022 23:51:59 +0000 (15:51 -0800)] 
add 1.13.7 to old versions on develop (#7292)

(cherry picked from commit a2ed24199f59f89fb87deca81280e243115f18a9)

5 months agoGEODE-8321: part 3 - remove adoptopenjdk (#6457)
Owen Nichols [Mon, 10 May 2021 21:32:11 +0000 (14:32 -0700)] 
GEODE-8321: part 3 - remove adoptopenjdk (#6457)

This is the final cleanup following successful conversion in Part 2 (#5474)

(all three phases were 1: add liberica  2: switch  3: remove adoptopenjdk)

(cherry picked from commit d9b323fa18dc969fb7e737652c00a200c297de17)

5 months agoGEODE-9372: Added createSenderTime and createSenderInProgress stats (#6608)
Barry Oglesby [Mon, 14 Jun 2021 18:30:44 +0000 (08:30 -1000)] 
GEODE-9372: Added createSenderTime and createSenderInProgress stats (#6608)

(cherry picked from commit f0e6e0d9c2b299e31fd20dea47703b019fc66f31)

5 months agoGEODE-9528: Updated test to await until asserted (#6798)
Barry Oglesby [Wed, 25 Aug 2021 20:38:30 +0000 (10:38 -1000)] 
GEODE-9528: Updated test to await until asserted (#6798)

(cherry picked from commit ed816c55406131b95d4db8571558ed1fcecc53e7)

5 months agoFix for jcenter shutdown. (#7260)
Jacob Barrett [Thu, 13 Jan 2022 01:30:11 +0000 (17:30 -0800)] 
Fix for jcenter shutdown. (#7260)

(cherry picked from commit ac04dc4348c9231960b46cefca13da41c1bff97e)

5 months agoadd 1.12.8 to old versions on develop (#7268)
Dick Cavender [Fri, 14 Jan 2022 11:13:47 +0000 (03:13 -0800)] 
add 1.12.8 to old versions on develop (#7268)

(cherry picked from commit 83de8f25978f0c2cee345beb61d88a85bf5da0f8)

5 months agoGEODE-9819: fix durable client socket leak (#7266)
Darrel Schneider [Fri, 14 Jan 2022 01:02:49 +0000 (17:02 -0800)] 
GEODE-9819: fix durable client socket leak (#7266)

Added unit test that reproduced the socket leak.
This involved some change to the product classes
to make them unit testable.
Fixed the leak by making sure socket.close is called
if the response code was not successful.

(cherry picked from commit 97601eb2cd585f844b7f02bb73ba42fcb86a7cb4)

6 months agopare down oldversion list to only latest patch per serialization version rel/v1.14.3 rel/v1.14.3.RC1
Owen Nichols [Fri, 31 Dec 2021 06:37:03 +0000 (22:37 -0800)] 
pare down oldversion list to only latest patch per serialization version

6 months agoGEODE-9060: Remove the member from a copy of replicates as GII candid… (#6246) (...
Xiaojian Zhou [Tue, 4 Jan 2022 00:04:18 +0000 (16:04 -0800)] 
GEODE-9060: Remove the member from a copy of replicates as GII candid… (#6246) (#7230)

* GEODE-9060: Remove the member from a copy of replicates as GII candidate if
it's not part of the same distributed system, but leave original replicates
unchanged.

(cherry picked from commit 76a5afddc9eaecea9f0b4528a910eb6761e1a3a1)

6 months agoBumping copyright year to 2022
Owen Nichols [Sat, 1 Jan 2022 08:33:54 +0000 (00:33 -0800)] 
Bumping copyright year to 2022

6 months agoGEODE-9905: Bump log4j from 2.17.0 to 2.17.1
Owen Nichols [Wed, 29 Dec 2021 21:10:22 +0000 (13:10 -0800)] 
GEODE-9905: Bump log4j from 2.17.0 to 2.17.1

6 months agoGEODE-9905: [1.14] Bump log4j from 2.16.0 to 2.17.0 (#7216)
Kirk Lund [Tue, 21 Dec 2021 17:26:08 +0000 (09:26 -0800)] 
GEODE-9905: [1.14] Bump log4j from 2.16.0 to 2.17.0 (#7216)

(cherry picked from commit 45714b36b04f89b56c81e97cb03fc0fbf95f58c9)

Co-authored-by: Owen Nichols <34043438+onichols-pivotal@users.noreply.github.com>
6 months agoEnable LGTM as PR-gating checks (#7197)
Robert Houghton [Fri, 17 Dec 2021 03:41:58 +0000 (19:41 -0800)] 
Enable LGTM as PR-gating checks (#7197)

(cherry picked from commit 48ccfe734aac39107c1fa16e2e961027089cb85e)

6 months agoadd 1.12.7 and 1.13.6 to old versions on support/1.14
Owen Nichols [Thu, 16 Dec 2021 01:55:25 +0000 (17:55 -0800)] 
add 1.12.7 and 1.13.6 to old versions on support/1.14

6 months agoincrease disk quota to hold more old versions
Owen Nichols [Thu, 16 Dec 2021 01:33:10 +0000 (17:33 -0800)] 
increase disk quota to hold more old versions

6 months agoBumping version to 1.14.3
Owen Nichols [Thu, 16 Dec 2021 00:54:31 +0000 (16:54 -0800)] 
Bumping version to 1.14.3

6 months agoadd 1.14.2 to old versions on support/1.14
Owen Nichols [Wed, 15 Dec 2021 23:50:23 +0000 (15:50 -0800)] 
add 1.14.2 to old versions on support/1.14

6 months agoupdate Dockerfile to apache-geode 1.14.2
Owen Nichols [Wed, 15 Dec 2021 23:45:25 +0000 (15:45 -0800)] 
update Dockerfile to apache-geode 1.14.2

6 months agoGEODE-9898: Bump log4j from 2.15.0 to 2.16.0 rel/v1.14.2 rel/v1.14.2.RC1
Owen Nichols [Tue, 14 Dec 2021 19:28:57 +0000 (11:28 -0800)] 
GEODE-9898: Bump log4j from 2.15.0 to 2.16.0

(cherry-picked from commit 7bec7474c1fb6794daf199276d0eea8cb40a8206))

6 months agoGEODE-9877: Use ServerSocket to create interfering port (#7182)
Jens Deppe [Sun, 12 Dec 2021 06:39:41 +0000 (22:39 -0800)] 
GEODE-9877: Use ServerSocket to create interfering port (#7182)

- This is a manual backport of 310c647da6 since there are a lot of
  conflicts when cherry picking and the fix is quite trivial.

6 months agoBumping version to 1.14.2
Owen Nichols [Sat, 11 Dec 2021 05:49:56 +0000 (21:49 -0800)] 
Bumping version to 1.14.2

6 months agoadd missing old versions
Owen Nichols [Sat, 11 Dec 2021 05:44:31 +0000 (21:44 -0800)] 
add missing old versions

6 months agoadd 1.14.1 to old versions on support/1.14
Owen Nichols [Sat, 11 Dec 2021 02:26:05 +0000 (18:26 -0800)] 
add 1.14.1 to old versions on support/1.14

6 months agoupdate Dockerfile to apache-geode 1.14.1
Owen Nichols [Sat, 11 Dec 2021 02:15:22 +0000 (18:15 -0800)] 
update Dockerfile to apache-geode 1.14.1

6 months agoGEODE-9888: Bump log4j from 2.14.0 to 2.15.0 (#7184) rel/v1.14.1 rel/v1.14.1.RC2
Owen Nichols [Fri, 10 Dec 2021 19:08:59 +0000 (11:08 -0800)] 
GEODE-9888: Bump log4j from 2.14.0 to 2.15.0 (#7184)

6 months agoGEODE-9877: Use ServerSocket to create interfering port (#7180)
Jens Deppe [Thu, 9 Dec 2021 20:25:13 +0000 (12:25 -0800)] 
GEODE-9877: Use ServerSocket to create interfering port (#7180)

- For some unknown reason `startupFailsGivenPortAlreadyInUse` started to
  fail after a seemingly innocuous Ubuntu base image bump. The problem
  may also have been triggered by arbitrary test ordering changes since
  the test did not fail on its own, but only in conjunction with running
  other tests beforehand.
  Specifically, the test was failing when binding the interfering port
  (bind exception). The port used was always in the TIME_WAIT state left
  from previous tests.
  Using a `ServerSocket`, instead of a regular socket, fixes the problem
  since it actually 'uses' the port and implicitly allows for port
  reuse.

- Use ServerSocket consistently. Rename test to be more appropriate

(cherry picked from commit 310c647da6ee4cc4a1eadc6df174d998e69afb31)

6 months agoGEODE-9882: User Guide, Micrometer section, fix product_name typo (#7181)
Dave Barnes [Thu, 9 Dec 2021 18:58:53 +0000 (10:58 -0800)] 
GEODE-9882: User Guide, Micrometer section, fix product_name typo (#7181)

7 months agoGEODE-9862: pin Gradle use of jgit (#7152) rel/v1.14.1.RC1
Robert Houghton [Tue, 30 Nov 2021 00:12:07 +0000 (16:12 -0800)] 
GEODE-9862: pin Gradle use of jgit (#7152)

* dependency of grgit used in GemFireVersion.properties

Authored-by: Robert Houghton <rhoughton@pivotal.io>
(cherry picked from commit 5d89d4f6e6ded010d05434e76d7baed6c7e9db28)

7 months agoGEODE-9825: processInputBuffer resize retains data (#7131)
Bill Burcham [Tue, 23 Nov 2021 16:29:11 +0000 (08:29 -0800)] 
GEODE-9825: processInputBuffer resize retains data (#7131)

(cherry picked from commit fb142e1bbd42d6af2463fd9b9b49ef3e5519cfcb)

7 months agoGEODE-9713: Support thread count in ExecutorService rules (#7002)
Kirk Lund [Tue, 19 Oct 2021 00:16:32 +0000 (17:16 -0700)] 
GEODE-9713: Support thread count in ExecutorService rules (#7002)

Restores thread count support to ExecutorServiceRule, and adds it to
DistributedExecutorServiceRule.

PROBLEM

ExecutorService rules currently create a newCachedThreadPool which
creates new threads as needed.

Some usages would benefit from the option of specifying a threadCount
limit which would create a newFixedThreadPool that reuses a fixed
number of threads.

SOLUTION

Add optional threadCount creation parameter to both ExecutorServiceRule
and DistributedExecutorServiceRule.

Creating a ExecutorService rule without a threadCount will still create a
newCachedThreadPool. Using a threadCount will now create a
newFixedThreadPool.

(cherry picked from commit 636bea3fd14c634d2568ed49eba3b13f1797d1ff)

7 months agoGEODE-9838: Log key info for deserialization issue while index update (#7136)
Xiaojian Zhou [Tue, 23 Nov 2021 17:22:19 +0000 (09:22 -0800)] 
GEODE-9838: Log key info for deserialization issue while index update (#7136)

(cherry picked from commit f56d60a6227fc46fbf3e8f3f5ba48d8be453e69e)

7 months agoGEODE-9775: fix remaining pipelines to support k8s (#7099)
Owen Nichols [Tue, 9 Nov 2021 21:13:38 +0000 (13:13 -0800)] 
GEODE-9775: fix remaining pipelines to support k8s (#7099)

(cherry picked from commit beb898c1fa06fc488a553faae2c7d03e0428782b)

7 months agoAdd required pipeline path dependencies (#7096)
Robert Houghton [Tue, 9 Nov 2021 19:07:30 +0000 (11:07 -0800)] 
Add required pipeline path dependencies (#7096)

(cherry picked from commit e34147710bd942594fe5b886289a148eea74757e)

7 months agoGEODE-9778: Bump netty from 4.1.67.Final to 4.1.70.Final
Jens Deppe [Fri, 5 Nov 2021 12:57:58 +0000 (05:57 -0700)] 
GEODE-9778: Bump netty from 4.1.67.Final to 4.1.70.Final

(cherry picked from commit 7f4bf62a08b24aca81fe05349cdc72d919a6cab7)

7 months agoGEODE-9050: Putting sleep in PubSubIntegrationTest
Dan Smith [Mon, 8 Nov 2021 18:39:26 +0000 (10:39 -0800)] 
GEODE-9050: Putting sleep in PubSubIntegrationTest

Working around this issue by putting a sleep in PubSubIntegrationTest. This is
not a fix for the underlying race condition in the product but just a
workaround to make this test pass so we can continue to upgrade netty on this
support branch. The actual fix will in 1.15.

8 months agoGEODE-9797: User guide typo repairs (#7085)
Dave Barnes [Fri, 5 Nov 2021 16:17:08 +0000 (09:17 -0700)] 
GEODE-9797: User guide typo repairs (#7085)

8 months agoGEODE-9656: Document Async disk writer exit behavior (#7062)
Dave Barnes [Thu, 28 Oct 2021 23:04:24 +0000 (16:04 -0700)] 
GEODE-9656: Document Async disk writer exit behavior (#7062)

8 months ago[GEODE-9775] Add heavy-lifter environment variables.
Sean Goller [Wed, 27 Oct 2021 16:25:59 +0000 (09:25 -0700)] 
[GEODE-9775] Add heavy-lifter environment variables.

(cherry picked from commit 5012f3997c0ac898e021532eb98a1310d21b9c26)

8 months agoGEODE-9775: fixup missing Concourse variable for PR pipeline (#7047)
Robert Houghton [Tue, 26 Oct 2021 19:30:41 +0000 (12:30 -0700)] 
GEODE-9775: fixup missing Concourse variable for PR pipeline (#7047)

(cherry picked from commit e1fac45368f20896a36a96936f4bc938951b4659)

8 months ago[GEODE-9775] CI Changes to support CI migration
Sean Goller [Tue, 26 Oct 2021 18:48:17 +0000 (18:48 +0000)] 
[GEODE-9775] CI Changes to support CI migration

* Remove unnecessary environment variables.
* get network information from concourse instead of discovering it ourselves.

(cherry picked from commit 4248006916a91f6d86976f77aea50a9dec729757)

8 months agoGEODE-9714: Add Shiro packages to sanctioned serializables (#7017)
Kirk Lund [Thu, 21 Oct 2021 21:21:05 +0000 (14:21 -0700)] 
GEODE-9714: Add Shiro packages to sanctioned serializables (#7017)

Adds all Shiro subpackages that contain exceptions to the list of
sanctioned serializables.

PROBLEM

QueryConfigurationServiceConstraintsDistributedTest failed in
CI when it tried to deserialize
org.apache.shiro.session.StoppedSessionException.

SOLUTION

I did some research and I believe we should add all Shiro
subpackages containing exceptions to the accept-list.

(cherry picked from commit a2a80edf5f4d6ab6405edc05f82bb468c6161267)

8 months agoGEODE-9751: load yaml vars safely (unsafe load was deprecated and is now removed...
Owen Nichols [Mon, 18 Oct 2021 23:54:00 +0000 (16:54 -0700)] 
GEODE-9751: load yaml vars safely (unsafe load was deprecated and is now removed) (#7016)

(cherry picked from commit 6a60434984ab131e5910442fb7c29245a1e442e1)

8 months agoGEODE-9625: Only serialize transaction metadata when grouping enabled. (#6984)
Jacob Barrett [Wed, 13 Oct 2021 17:47:48 +0000 (10:47 -0700)] 
GEODE-9625: Only serialize transaction metadata when grouping enabled. (#6984)

(cherry picked from commit ab651eba9558752fe1336919e462350f4581a22a)

8 months agoGEODE-9640: Initiate threadId in EventID. (#6905)
Eric Shu [Tue, 5 Oct 2021 18:53:05 +0000 (11:53 -0700)] 
GEODE-9640: Initiate threadId in EventID. (#6905)

  * This is to make sure a new EventID can be generated after server restarted
    after a whole cluster is shut down.

 * Wrap around original threadID before it interferes with bulkOp or wan generated threadID.

(cherry picked from commit 4b3c49e788157df94f7d3e4b455adb7a6eaef96b)

9 months agoGEODE-9672: Disable native redis multibulk test (#6941)
Jens Deppe [Wed, 6 Oct 2021 15:18:44 +0000 (08:18 -0700)] 
GEODE-9672: Disable native redis multibulk test (#6941)

- This is a manual packport of the original fix

9 months agoGEODE-9628: Documentation fix for setting credentials in client (#6928)
Dave Barnes [Tue, 5 Oct 2021 16:22:33 +0000 (09:22 -0700)] 
GEODE-9628: Documentation fix for setting credentials in client (#6928)

* GEODE-9568 Documentation fix for setting credentials in client (format & style)

9 months agoGEODE-9568: UG build script keep doc after generating it (#6906)
Alberto Bustamante Reyes [Thu, 30 Sep 2021 14:57:53 +0000 (16:57 +0200)] 
GEODE-9568: UG build script keep doc after generating it (#6906)

* GEODE-9568: UG build script - keep doc after generating it

9 months agoGEODE-9655: Bump shiro-core from 1.7.1 to 1.8.0
Owen Nichols [Tue, 28 Sep 2021 23:58:06 +0000 (16:58 -0700)] 
GEODE-9655: Bump shiro-core from 1.7.1 to 1.8.0

9 months agoGEODE-9486: Improve AnalyzeSerializables integration tests (#6878)
Kirk Lund [Tue, 21 Sep 2021 16:39:48 +0000 (09:39 -0700)] 
GEODE-9486: Improve AnalyzeSerializables integration tests (#6878)

Allow geode modules to have an AnalyzeSerializables integration
test without implementing SanctionedSerializablesService.

Improve debugging information for AnalyzeSerializables integration
tests:
- Provide new failure message when no SanctionedSerializablesService
exists.
- Create ANALYZE_SERIALIZABLES.md to provide detailed instructions for
failures involving AnalyzeSerializables integration tests.
- Reference ANALYZE_SERIALIZABLES.md in failure messages.

Remove geode-serialization and geode-common jars from geode-pulse
.war file:
- Change getModuleClass() to return Optional.
- Delete PulseSanctionedSerializablesService and its resources.
- Change geode-pulse dependency on geode-serialization to be for
integrationTest only.

(cherry picked from commit 7bd1d73dcd02712a10e5c3f2ac5ac0522923bf9e)

9 months agoGEODE-9486: Fix validate-serializable-objects (#6823)
Kirk Lund [Wed, 8 Sep 2021 16:30:50 +0000 (09:30 -0700)] 
GEODE-9486: Fix validate-serializable-objects (#6823)

Rename DistributedSystemService to SanctionedSerializablesService and
remove unused init(DistributedSystem).

Move SanctionedSerializablesService to geode-serialization.

Implement SanctionedSerializablesService in both geode-core and
geode-management to remove special case for each in
InternalDataSerializer.

Fix sanctioned serializables support in geode-management and
geode-apis-compatible-with-redis.

Add sanctioned serializables support to geode-serialization and
geode-pulse.

Add sanctioned serializables support to geode-junit and geode-dunit
to simplify writing tests for validate-serializable-objects and prevent
having to list out DUnit Rules and other test framework classes when
validate-serializable-objects is enabled.

Use ExecutorServiceRule and reformat json strings in
RestRegionAPIIntegrationTest.

Reorganize QueryCommandDUnitTestBase.

Use InvalidClassException instead of Exception in
ObjectInputStreamFilterWrapper fatal log message.

Improve assertion messages in ResourceUtils.

Move loadSanctionedSerializablesServices and loadClassNames to
new SanctionedSerializables in geode-serialization.

Exclude Pulse GemFireAuthentication from sanctioned serializables.

Add SerializationTest Category to all AnalyzeSerializables integration
tests.

Tidy up SANCTIONED_SERIALIZABLES_DEPENDENCIES_PATTERN.

Convert to AssertJ and use BeforeClass in
InternalDataSerializerSerializationAcceptlistTest.

Note: If Git or GitHub is showing invalid file renames in the diffs, you
may need to pull the branch locally and configure diff.renameLimit to
something lower than the default value of 50.

(cherry picked from commit acbd0ff3c37a5e1fe3018d3f7288df385159ac4c)

9 months agofixed the incorrect spelling (#6886)
dkhopade [Thu, 23 Sep 2021 16:15:37 +0000 (12:15 -0400)] 
fixed the incorrect spelling (#6886)

9 months agoGEODE-9619: [documentation] Align contents section in README (#6888)
Kaustubh Maske Patil [Wed, 22 Sep 2021 17:29:16 +0000 (22:59 +0530)] 
GEODE-9619: [documentation] Align contents section in README (#6888)

* Align contents in README
* Fixed typo in "How to Contribute"

Co-authored-by: Dan Smith <dasmith@vmware.com>
9 months agoGEODE-9596: Avoid creating multiple cq maps in ClientUpdateMessage (#6869)
Eric Shu [Fri, 17 Sep 2021 22:48:49 +0000 (15:48 -0700)] 
GEODE-9596: Avoid creating multiple cq maps in ClientUpdateMessage (#6869)

* GEODE-9596: Avoid creating multiple cq maps in ClientUpdateMessage

  * This can occur if HAContainer enables eviction.
  * Also addClientCq can be accessed concurrently by intialization threads during queue registration.

(cherry picked from commit 00b41562f8c4e5982190795c0426e5884f57724a)

9 months agoGEODE-9583: Flush the disk stores before unregistering all serializers (#6854)
Jianxia Chen [Wed, 15 Sep 2021 18:04:43 +0000 (11:04 -0700)] 
GEODE-9583: Flush the disk stores before unregistering all serializers (#6854)

(cherry picked from commit 0a579bde6777cfd75654a59527b5ea3dc37af550)

9 months agoGEODE-5994: Cleanup from some additional review comments (#6852)
mhansonp [Fri, 10 Sep 2021 00:31:02 +0000 (17:31 -0700)] 
GEODE-5994: Cleanup from some additional review comments (#6852)

(cherry picked from commit 7b924b5ccef4646f28615bab290447824f9f9f45)

9 months agoGEODE-9554: Change up the rebalance calls to use new canDelete call (#6845) (#6853)
mhansonp [Fri, 10 Sep 2021 00:31:41 +0000 (17:31 -0700)] 
GEODE-9554: Change up the rebalance calls to use new canDelete call (#6845) (#6853)

GEODE-9554: Change up the rebalance calls to use new canDelete call

If there is no redundancy zone, exit and allow delete
Adding xml files to git
Adding xml files to git
Added new tests

(cherry picked from commit d1d605b24787698c5d8f47b8538808d6b990c0a4)

9 months agoGEODE-9561: typo repair
Dave Barnes [Wed, 8 Sep 2021 20:22:20 +0000 (13:22 -0700)] 
GEODE-9561: typo repair

9 months agoGEODE-9561: User Guide - jmx-manager-ssl-enabled supersedes jmx-manager-ssl (#6837)
Dave Barnes [Wed, 8 Sep 2021 18:09:08 +0000 (11:09 -0700)] 
GEODE-9561: User Guide - jmx-manager-ssl-enabled supersedes jmx-manager-ssl (#6837)

9 months agoGEODE-9578: Bump spring-security from 5.4.5 to 5.4.8
Owen Nichols [Tue, 7 Sep 2021 16:17:05 +0000 (09:17 -0700)] 
GEODE-9578: Bump spring-security from 5.4.5 to 5.4.8

10 months agoGEODE-9532: Register LongWrapperSerializer before Region.put() (#6799) (#6843)
Jianxia Chen [Fri, 3 Sep 2021 19:43:43 +0000 (12:43 -0700)] 
GEODE-9532: Register LongWrapperSerializer before Region.put() (#6799) (#6843)

(cherry picked from commit 10abff6cb6722a56b03305251076c9c78e948dd3)

10 months agoGEODE-9515: Skip setting MBeanServer when JMXConnectorServer will set it (#6770)...
Jianxia Chen [Fri, 3 Sep 2021 19:41:34 +0000 (12:41 -0700)] 
GEODE-9515: Skip setting MBeanServer when JMXConnectorServer will set it (#6770) (#6842)

(cherry picked from commit 280bd841427f244f507633826def2f845a9b10ef)

10 months agoBumping version to 1.14.1
Naburun Nag [Fri, 3 Sep 2021 18:43:02 +0000 (11:43 -0700)] 
Bumping version to 1.14.1

10 months agoGEODE-9527: Use TLS v 1.2 in test (#6781)
Ernie Burghardt [Fri, 3 Sep 2021 17:47:16 +0000 (12:47 -0500)] 
GEODE-9527: Use TLS v 1.2 in test (#6781)

10 months agoadd weekly trigger for 1.14 on Thursday
Owen Nichols [Fri, 3 Sep 2021 17:29:10 +0000 (10:29 -0700)] 
add weekly trigger for 1.14 on Thursday

10 months agoadd 1.14.0 to old versions and set as Benchmarks baseline on support/1.14
Naburun Nag [Fri, 3 Sep 2021 01:56:28 +0000 (18:56 -0700)] 
add 1.14.0 to old versions and set as Benchmarks baseline on support/1.14

10 months agoupdate Dockerfile to apache-geode 1.14.0
Naburun Nag [Fri, 3 Sep 2021 01:15:24 +0000 (18:15 -0700)] 
update Dockerfile to apache-geode 1.14.0

10 months agoFix 1.14.0 rc1 (#6822) rel/v1.14.0
Owen Nichols [Tue, 31 Aug 2021 20:51:39 +0000 (13:51 -0700)] 
Fix 1.14.0 rc1 (#6822)

* run steps that were missed at branch creation, so src archive will match src tag

* fix checker-qual version in license

10 months agoAdding the PGP keys for Nabarun Nag with apache ID (#6818) (#6820)
Nabarun Nag [Tue, 31 Aug 2021 09:36:19 +0000 (02:36 -0700)] 
Adding the PGP keys for Nabarun Nag with apache ID (#6818) (#6820)

(cherry picked from commit a36c3279eed28d0b190d8a23e5b16b675fdedc84)

10 months agoGEODE-9071: Add wait before check cq listener invocations. (#6785)
Eric Shu [Mon, 23 Aug 2021 17:09:56 +0000 (10:09 -0700)] 
GEODE-9071: Add wait before check cq listener invocations. (#6785)

* Cq events sent to client asynchronously. Need to wait events are
    all delivered.

(cherry picked from commit 018fb585b1750a3186ad4693744ed5630d869182)

10 months agoadd 1.13.4 to old versions and set as Benchmarks baseline on support/1.14
Dick Cavender [Fri, 30 Jul 2021 22:07:08 +0000 (15:07 -0700)] 
add 1.13.4 to old versions and set as Benchmarks baseline on support/1.14

(cherry picked from commit 138d5b8969a70bde07ad729461f1d914aa0b14f8)

10 months agoGEODE-9463: Add SerializableRegionRedundancyStatusImpl to accept list (#6753)
Eric Shu [Wed, 11 Aug 2021 16:03:32 +0000 (09:03 -0700)] 
GEODE-9463: Add SerializableRegionRedundancyStatusImpl to accept list (#6753)

* SerializableRegionRedundancyStatusImpl is stored in RegionOperationStateStore region as
     part of OperationState used for REST client.
   * OperationState implements Serializable, which causes it to be serialized as a java
     Serialiable and also nested SerializableRegionRedundancyStatusImpl.
   * Ideally OperationState should implement DSFID to avoid this issue, however, it has been
     released already. So we will add SerializableRegionRedundancyStatusImpl to the accept list
     to avoid this serialization issue when validate-serializable-objects is set to true.

Co-authored-by: Dan Smith <dasmith@vmware.com>
(cherry picked from commit 7f98970afafcec6b71460344e0fd6066d7a76a92)

10 months agoGEODE-9354: Extract and test ArgumentRedactorRegex (#6641) (#6747)
Kirk Lund [Thu, 12 Aug 2021 21:08:31 +0000 (14:08 -0700)] 
GEODE-9354: Extract and test ArgumentRedactorRegex (#6641) (#6747)

* Rename ArgumentRedactorJUnitTest to ArgumentRedactorTest.
* Reorganize and reformat ArgumentRedactor and its tests.
* Fix issues in regex found by new tests.

(cherry picked from commit 693e18c48d1c0e3601c517cb7c5493b54649dc10)

10 months agoGEODE-9480: Changing the version with ordinal 121 to be 1.13.2 (#6730)
Dan Smith [Wed, 11 Aug 2021 18:27:44 +0000 (11:27 -0700)] 
GEODE-9480: Changing the version with ordinal 121 to be 1.13.2 (#6730)

* Changing the version with ordinal 121 to be 1.13.2

This protocol change actually happened in 1.13.2. 1.13.1 is still using the
same protocol ordinal as 1.13.0, which is 120.

Evidence
b2d205459bf is the commit that introduced this version in support/1.13
b2d205459bf is only contained in rel/v1.13.2 and above
* Running geode 1.13.1, it reports it's protocol version as 120.

(cherry picked from commit 2a90a583015352c1cc0f041008ec2a6ea7b5505c)

11 months agoadd 1.12.4 to old versions on support/1.14
Dick Cavender [Mon, 26 Jul 2021 23:07:07 +0000 (16:07 -0700)] 
add 1.12.4 to old versions on support/1.14

(cherry picked from commit 9b139117d1e47e543466ab18b75dc5ea75fe83b5)

11 months agoincrease timeouts (#6404)
Owen Nichols [Thu, 29 Apr 2021 22:00:24 +0000 (15:00 -0700)] 
increase timeouts (#6404)

* increase acceptanceTest timeout from 2 hours to 3 hours
* increase upgradeTest timeout from 1.5 hours to 2.5 hours

(cherry picked from commit ebdf8edcc893478ba4f67892f02b312de5d1b5d4)

11 months agoGEODE-9426: Update docs for HTTP session management (#6703) (#6706)
Dave Barnes [Thu, 22 Jul 2021 21:39:49 +0000 (14:39 -0700)] 
GEODE-9426: Update docs for HTTP session management (#6703) (#6706)

(cherry picked from commit 4618604670ed2f4517653f10294b746c6d0c1e82)

11 months agoGEODE-8609: Check logs for suspicious logs when VM is stopped.
Nabarun Nag [Thu, 27 May 2021 01:57:00 +0000 (18:57 -0700)] 
GEODE-8609: Check logs for suspicious logs when VM is stopped.

* When a VM is stopped, the suspect string file is deleted
* Log checker is called at the end of the test.
* If a VM is restarted during a test, the logs are deleted and is not checked at the end of the test.
* With the fix the logs are checked when the VM is stopped.

(cherry picked from commit e39c4c5ad79ee07d7760c98a85259cfb68c64e4c)

11 months agoGEODE-9404: Do not log error message if sender is not configured. (#6659)
Eric Shu [Fri, 9 Jul 2021 19:09:31 +0000 (12:09 -0700)] 
GEODE-9404: Do not log error message if sender is not configured. (#6659)

 * This is normal case for serial wan configuration. Error message should not be
    logged when executing transactions.

* Log error message only if some events in a tx configured to group transaction but
others do not have sender configured.

* Should not wait for lastTransactionEvent in a tx if no sender configured or sender
does not set must group transaction.

(cherry picked from commit f0e328ba3eb4a1b2b47bdca5d565b79e88fecdca)

11 months agoGEODE-9350: MemberJoinedEvent should be triggered after new view is installed (#6598...
Kamilla Aslami [Mon, 19 Jul 2021 16:54:20 +0000 (09:54 -0700)] 
GEODE-9350: MemberJoinedEvent should be triggered after new view is installed (#6598) (#6695)

* GEODE-9350: trigger MemberJoinedEvent after the new view is installed

(cherry picked from commit b585039a7f7c71f7ed26b6d5b4a5d3561309c19d)