GEODE-8949: Create a new CI pipeline (#746)
authorMichael Martell <mmartell@pivotal.io>
Fri, 19 Feb 2021 06:41:29 +0000 (22:41 -0800)
committerGitHub <noreply@github.com>
Fri, 19 Feb 2021 06:41:29 +0000 (22:41 -0800)
commitbb2f0e448edd0caa0d82f876a2b8a6a646301fb8
tree0fe9caa866ed592392918a20275534bdcf69f928
parentecf06115eb1bedd90d0ede9a5cc9cafff6111606
GEODE-8949: Create a new CI pipeline (#746)

* GEODE-8949: Create a new CI pipeline
* Decrease parallelism to fix Windows 2019 test failures
* Fixes versioning together
* Remove ABI compatibility flags
* Increase TIMEBOMB to 600
* Disable DataInput test for now
* Fix clang-format error
* Fixes packer image projects
* Rename keys and tokens per RTM names
* Remove Python, PIP and Coveralls from Ubuntu 16.04
* Integrate rat-check properly into GitHub PR apparatus
* Add license and/or exclusion as appropriate to pass RAT check (#4)
* Fix ABI compatibility
* Use LLVM 11
* Add Ubunutu 20.04
* Upgrade cmake and add make
* Remove unused exports. Remaining exports are for testing.
* Hide symbols from staticly linked libraries
* Increase timeouts
* Fix warnings
* Add github icon
* Split out GitHub components for various GitHub resources
* Tag builds and upload artifacts
* Add functions to reduce yaml redundancy
* Reduce resource complexity
* Use resource to expand geode
* Updates for release and pr pipelines
* Fixes per clang-tidy and hide noise
* Fixes per clang-format and hide noise
* Add clang-tools Dockerfile
* Improve CacheImpl (nothing should be virtual)
* Improve abstract classes (should define virtual destructors)
* Use the concourse worker's zone by default
* Don't be so verbose with pipeline output
* Always fetch latest cmake
* Rerun failed tests (ctest retry with count 4)
* Disable broken IPv6 test
* Fix test failures due to folder collisions
* Cleanup test output directories for failed tests
* Improve execution of gfsh (use less memory)
* Improve gfsh scoping in integration tests
* Add GfshExecute class to legacy integration tests
* Add heap settings to GfshExecute
* Kill all user processes before running tests
* Use tar to speed up file copies
* README for GitHub Private Key
* Fix for .NET 3.5 install on Windows 2016
* Fixes boost on windows
* Fixes for ACE
* Don't checkout sources after upload.
* Update Building.md per new tooling support
* Package icon
* Fixes Windows 2016
* Remove used windows build scripts
* Update to boost 1.75.0 and fix MSVC
* Support for Visual Studio 2019
* Explicitly set MSVC toolset and Windows SDK
* Don't retrigger PRs on new versions
* Improve build-in help for set-pipeline.sh
* Don't rebuild on image changes
* Retry packer builds if they fail
* Update README.md for new CI
* Add error for canceled jobs
* Copy source from worker to builder
* Support for PR resource
* Split release and pr pipelines
* Upload packages to GCS
* Parameterize bucket and key
* Configure build type, version, date, etc
* Support semver
* Templatize docker builds
* Use newer registry-image resource for images not built in this project.
* Fix Dockerfile path and caches.
* Use project specific minimal task image
* Fix legacy integration port allocations
* Fix .NET test execution
* Add support for Windows Server 2019
* Fix install of .NET 3.5 via WinRM
* Added Google Compute support
* Upgrade to cmake 3.18
* Use GEODE_VERSION=1.13.1
* Adding --schedule-random to ctests
* Update travis.yml to use new cmake

Co-authored-by: Jacob Barrett <jbarrett@pivotal.io>
345 files changed:
.clang-tidy
.lcovrc
.lgtm.yml
.ratignore
.travis.yml
BUILDING.md
CMakeLists.txt
bin/vcvarsall.bat [deleted file]
bin/vcvarsall.ps1 [deleted file]
ci/README.md [new file with mode: 0644]
ci/base/base.yml [new file with mode: 0644]
ci/base/pipeline.yml [new file with mode: 0644]
ci/docker/clang-tools/Dockerfile [new file with mode: 0644]
ci/docker/task/Dockerfile [new file with mode: 0644]
ci/lib/functions.lib.yml [new file with mode: 0644]
ci/lib/templates.lib.txt [new file with mode: 0644]
ci/lib/templates.lib.yml [new file with mode: 0644]
ci/pr/data.yml [new file with mode: 0644]
ci/pr/pipeline.yml [new file with mode: 0644]
ci/release/data.yml [new file with mode: 0644]
ci/release/pipeline.yml [new file with mode: 0644]
ci/set-pipeline.sh [new file with mode: 0755]
clicache/integration-test/CacheHelperN.cs
clicache/integration-test/test.bat.in
clicache/integration-test2/CMakeLists.txt
clicache/integration-test2/DataInputTest.cs
clicache/test/CMakeLists.txt
clicache/test2/CMakeLists.txt
cppcache/CMakeLists.txt
cppcache/benchmark/SerializationRegistryBM.cpp
cppcache/include/geode/AuthenticatedView.hpp
cppcache/include/geode/Cache.hpp
cppcache/include/geode/CacheableString.hpp
cppcache/include/geode/CqServiceStatistics.hpp
cppcache/include/geode/DataInput.hpp
cppcache/include/geode/FunctionService.hpp
cppcache/include/geode/GeodeCache.hpp
cppcache/include/geode/PdxInstance.hpp
cppcache/include/geode/PdxUnreadFields.hpp
cppcache/include/geode/Properties.hpp
cppcache/include/geode/RegionService.hpp
cppcache/include/geode/WritablePdxInstance.hpp
cppcache/include/geode/internal/geode_base.hpp
cppcache/integration-test/.clang-tidy
cppcache/integration-test/BBNamingContext.cpp
cppcache/integration-test/BuiltinCacheableWrappers.hpp
cppcache/integration-test/CMakeLists.txt
cppcache/integration-test/CacheHelper.cpp
cppcache/integration-test/CacheHelper.hpp
cppcache/integration-test/QueryHelper.hpp
cppcache/integration-test/TallyListener.hpp
cppcache/integration-test/TallyLoader.hpp
cppcache/integration-test/ThinClientListenerInit.hpp
cppcache/integration-test/ThinClientLocalCacheLoader.hpp
cppcache/integration-test/ThinClientSecurityHelper.hpp
cppcache/integration-test/ThinClientTransactions.hpp
cppcache/integration-test/ThinClientTransactionsXA.hpp
cppcache/integration-test/TimeBomb.hpp
cppcache/integration-test/fw_dunit.cpp
cppcache/integration-test/fw_dunit.hpp
cppcache/integration-test/fw_helper.hpp
cppcache/integration-test/fw_perf.hpp
cppcache/integration-test/fw_spawn.hpp
cppcache/integration-test/test.bat.in
cppcache/integration-test/test.sh.in
cppcache/integration-test/testFwPerf.cpp
cppcache/integration-test/testOverflowPutGetSqLite.cpp
cppcache/integration-test/testRegionAccessThreadSafe.cpp
cppcache/integration-test/testSerialization.cpp
cppcache/integration-test/testSpinLock.cpp
cppcache/integration-test/testThinClientConflation.cpp
cppcache/integration-test/testThinClientCq.cpp
cppcache/integration-test/testThinClientCqDelta.cpp
cppcache/integration-test/testThinClientCqFailover.cpp
cppcache/integration-test/testThinClientCqHAFailover.cpp
cppcache/integration-test/testThinClientHAQueryFailover.cpp
cppcache/integration-test/testThinClientInterest1Cacheless.cpp
cppcache/integration-test/testThinClientInterestNotify.cpp
cppcache/integration-test/testThinClientListenerCallbackArgTest.cpp
cppcache/integration-test/testThinClientPRSingleHop.cpp
cppcache/integration-test/testThinClientPoolAttrTest.cpp
cppcache/integration-test/testThinClientPoolExecuteFunctionThrowsException.cpp
cppcache/integration-test/testThinClientPoolExecuteHAFunction.cpp
cppcache/integration-test/testThinClientPoolServer.cpp
cppcache/integration-test/testThinClientRemoteQueryFailover.cpp
cppcache/integration-test/testThinClientRemoteQueryFailoverPdx.cpp
cppcache/integration-test/testThinClientSecurityPostAuthorization.cpp
cppcache/integration-test/testThinClientTicket304.cpp
cppcache/integration-test/testTimedSemaphore.cpp
cppcache/integration/framework/.clang-tidy [deleted file]
cppcache/integration/framework/Cluster.cpp
cppcache/integration/framework/Gfsh.cpp
cppcache/integration/framework/Gfsh.h
cppcache/integration/framework/GfshExecute.cpp
cppcache/integration/framework/GfshExecute.h
cppcache/integration/test/AuthInitializeTest.cpp
cppcache/integration/test/BasicIPv6Test.cpp
cppcache/integration/test/CqPlusAuthInitializeTest.cpp
cppcache/integration/test/PartitionRegionOpsTest.cpp
cppcache/integration/test/RegisterKeysTest.cpp
cppcache/integration/test/TransactionsTest.cpp
cppcache/shared/CMakeLists.txt
cppcache/src/AdminRegion.cpp
cppcache/src/AuthenticatedView.cpp
cppcache/src/Cache.cpp
cppcache/src/CacheImpl.hpp
cppcache/src/CachePerfStats.hpp
cppcache/src/CacheTransactionManagerImpl.cpp
cppcache/src/CacheXmlCreation.hpp
cppcache/src/CacheXmlParser.cpp
cppcache/src/CacheXmlParser.hpp
cppcache/src/CacheableToken.hpp
cppcache/src/ClientMetadata.hpp
cppcache/src/ConcurrentEntriesMap.cpp
cppcache/src/ConcurrentEntriesMap.hpp
cppcache/src/ConnectCounter.hpp
cppcache/src/ConnectionQueue.hpp
cppcache/src/CqAttributesImpl.hpp
cppcache/src/CqEventImpl.hpp
cppcache/src/CqQueryImpl.cpp
cppcache/src/CqQueryVsdStats.cpp
cppcache/src/CqQueryVsdStats.hpp
cppcache/src/CqService.cpp
cppcache/src/CqService.hpp
cppcache/src/CqServiceVsdStats.cpp
cppcache/src/CqServiceVsdStats.hpp
cppcache/src/DistributedSystem.hpp
cppcache/src/DistributedSystemImpl.hpp
cppcache/src/EntriesMap.hpp
cppcache/src/EntriesMapFactory.hpp
cppcache/src/EntryExpiryHandler.hpp
cppcache/src/EnumInfo.hpp
cppcache/src/EventId.hpp
cppcache/src/EventIdMap.hpp
cppcache/src/EventSource.hpp
cppcache/src/ExceptionTypes.cpp
cppcache/src/ExpMapEntry.hpp
cppcache/src/ExpiryHandler_T.hpp
cppcache/src/ExpiryTaskManager.cpp
cppcache/src/ExpiryTaskManager.hpp
cppcache/src/GeodeCache.cpp [moved from cppcache/src/FunctionServiceImpl.cpp with 69% similarity]
cppcache/src/InterestResultPolicy.hpp
cppcache/src/LRUAction.hpp
cppcache/src/LRUEntriesMap.cpp
cppcache/src/LRUEntriesMap.hpp
cppcache/src/LRUExpMapEntry.hpp
cppcache/src/LRULocalDestroyAction.hpp
cppcache/src/LRUMapEntry.hpp
cppcache/src/LocalRegion.cpp
cppcache/src/LocalRegion.hpp
cppcache/src/Log.cpp
cppcache/src/MapEntry.hpp
cppcache/src/MapSegment.hpp
cppcache/src/NoResult.hpp
cppcache/src/PdxFieldType.hpp
cppcache/src/PdxInstanceImpl.hpp
cppcache/src/PdxRemotePreservedData.hpp
cppcache/src/PoolXmlCreation.hpp
cppcache/src/PreservedDataExpiryHandler.hpp
cppcache/src/ProxyRegion.hpp
cppcache/src/ProxyRemoteQueryService.hpp
cppcache/src/PutAllPartialResultServerException.hpp
cppcache/src/Queue.hpp
cppcache/src/ReadWriteLock.hpp
cppcache/src/RegionConfig.hpp
cppcache/src/RegionExpiryHandler.hpp
cppcache/src/RegionGlobalLocks.hpp
cppcache/src/RegionService.cpp [moved from cppcache/src/FunctionServiceImpl.hpp with 51% similarity]
cppcache/src/RegionStats.hpp
cppcache/src/RegionXmlCreation.hpp
cppcache/src/RemoteQuery.cpp
cppcache/src/RemoteQuery.hpp
cppcache/src/RemoteQueryService.hpp
cppcache/src/ResultSetImpl.hpp
cppcache/src/SerializationRegistry.cpp
cppcache/src/ServerLocation.hpp
cppcache/src/StructSetImpl.hpp
cppcache/src/SuspendedTxExpiryHandler.hpp
cppcache/src/SystemProperties.cpp
cppcache/src/TXId.cpp
cppcache/src/TXId.hpp
cppcache/src/TableOfPrimes.hpp
cppcache/src/TcrChunkedContext.hpp
cppcache/src/TcrConnection.cpp
cppcache/src/TcrConnection.hpp
cppcache/src/TcrConnectionManager.cpp
cppcache/src/TcrConnectionManager.hpp
cppcache/src/TcrDistributionManager.hpp
cppcache/src/TcrEndpoint.cpp
cppcache/src/TcrHADistributionManager.hpp
cppcache/src/ThinClientBaseDM.cpp
cppcache/src/ThinClientBaseDM.hpp
cppcache/src/ThinClientCacheDistributionManager.hpp
cppcache/src/ThinClientDistributionManager.hpp
cppcache/src/ThinClientHARegion.hpp
cppcache/src/ThinClientPoolDM.cpp
cppcache/src/ThinClientPoolDM.hpp
cppcache/src/ThinClientPoolHADM.cpp
cppcache/src/ThinClientPoolStickyHADM.hpp
cppcache/src/ThinClientRedundancyManager.cpp
cppcache/src/ThinClientRegion.cpp
cppcache/src/ThinClientRegion.hpp
cppcache/src/ThreadPool.hpp
cppcache/src/TombstoneExpiryHandler.hpp
cppcache/src/TrackedMapEntry.hpp
cppcache/src/Utils.hpp
cppcache/src/VersionStamp.hpp
cppcache/src/VersionedCacheableObjectPartList.cpp
cppcache/src/dllmain.cpp
cppcache/src/statistics/OsStatisticsImpl.cpp
cppcache/src/statistics/ProcessStats.hpp
cppcache/src/statistics/StatArchiveWriter.hpp
cppcache/src/statistics/StatSamplerStats.hpp
cppcache/src/statistics/StatisticDescriptor.hpp
cppcache/src/statistics/Statistics.hpp
cppcache/src/statistics/StatisticsFactory.hpp
cppcache/src/statistics/StatisticsType.hpp
cppcache/src/util/Log.hpp
cppcache/src/util/exception.hpp
cppcache/test/CacheableDateTest.cpp
cppcache/test/CacheableKeyCreateTests.cpp
cppcache/test/CacheableKeysTest.cpp
cppcache/test/ChunkedHeaderTest.cpp
cppcache/test/DataInputTest.cpp
cppcache/test/DataOutputTest.cpp
cppcache/test/LoggingTest.cpp
cppcache/test/PdxInstanceImplTest.cpp
cppcache/test/SerializableCreateTests.cpp
cppcache/test/TcrMessageTest.cpp
cppcache/test/ThreadPoolTest.cpp
cppcache/test/util/chrono/durationTest.cpp
cppcache/test/util/functionalTests.cpp
cppcache/test/util/queueTest.cpp
cppcache/test/util/synchronized_mapTest.cpp
cppcache/test/util/synchronized_setTest.cpp
dependencies/ACE/CMakeLists.txt
dependencies/boost/CMakeLists.txt
docker/Dockerfile
docker/centos-7/Dockerfile [new file with mode: 0644]
docker/centos-7/bellsoft.repo [new file with mode: 0644]
docker/centos-8/Dockerfile [new file with mode: 0644]
docker/centos-8/bellsoft.repo [new file with mode: 0644]
docker/rhel-7/Dockerfile [new file with mode: 0644]
docker/rhel-7/bellsoft.repo [new file with mode: 0644]
docker/rhel-8/Dockerfile [new file with mode: 0644]
docker/rhel-8/bellsoft.repo [new file with mode: 0644]
docker/ubuntu-16.04/Dockerfile [new file with mode: 0644]
docker/ubuntu-18.04/Dockerfile [new file with mode: 0644]
docker/windows/Dockerfile [new file with mode: 0644]
docker/windows/README.md [new file with mode: 0644]
packer/build-linux.json [deleted file]
packer/build-rhel-6.json [deleted file]
packer/build-rhel-7.json [new file with mode: 0644]
packer/build-rhel-8.json [new file with mode: 0644]
packer/build-solaris-sparc.json [deleted file]
packer/build-solaris-x86.json [deleted file]
packer/build-ubuntu-16-04.json [new file with mode: 0644]
packer/build-ubuntu-18-04.json [new file with mode: 0644]
packer/build-ubuntu-20-04.json [new file with mode: 0644]
packer/build-ubuntu.json [deleted file]
packer/build-windows-2016-vs-2017.json [new file with mode: 0644]
packer/build-windows-2019-vs-2017.json [new file with mode: 0644]
packer/build-windows-2019-vs-2019.json [new file with mode: 0644]
packer/build-windows.json [deleted file]
packer/default.json
packer/dev-solaris-sparc.json [deleted file]
packer/dev-solaris-x86.json [deleted file]
packer/dev-windows-2012-r2.json [deleted file]
packer/linux/aws/files/usr/local/bin/init-user.sh [moved from packer/rhel/files/etc/init-user.sh with 100% similarity]
packer/linux/aws/setup-files.sh [moved from packer/ubuntu/install-gemfire.sh with 91% similarity]
packer/linux/aws/wait-for-cloud-init.sh [moved from packer/rhel/wait-for-cloud-init.sh with 100% similarity]
packer/linux/files/etc/systemd/system/update-hosts.service [moved from packer/rhel/install-gemfire.sh with 76% similarity]
packer/linux/files/usr/local/bin/update-hosts.sh [moved from packer/solaris/install-gemfire.sh with 84% similarity, mode: 0644]
packer/linux/install-cmake.sh [moved from packer/rhel/install-cmake.sh with 81% similarity]
packer/linux/install-geode.sh [moved from packer/ubuntu/install-cmake.sh with 75% similarity]
packer/linux/setup-files.sh [moved from packer/solaris/add-user-build.sh with 82% similarity]
packer/rhel-7-base.json [deleted file]
packer/rhel/7/install-devtoolset.sh [moved from packer/rhel/install-coverage-tools.sh with 85% similarity]
packer/rhel/aws/add-user-build.sh [moved from packer/rhel/add-user-build.sh with 100% similarity]
packer/rhel/aws/files/etc/cloud/cloud.cfg.d/10_hosts.cfg [moved from packer/rhel/files/etc/cloud/cloud.cfg.d/10_hosts.cfg with 100% similarity]
packer/rhel/aws/setup-files.sh [moved from packer/solaris/cleanup.sh with 92% similarity, mode: 0644]
packer/rhel/install-build-rpms.sh [deleted file]
packer/rhel/install-jdk-1.8.sh [deleted file]
packer/rhel/install-jdk-11.sh [moved from packer/rhel/install-scl-devtoolset.sh with 77% similarity]
packer/rhel/install-scl-python27.sh [deleted file]
packer/solaris/changepasswd [deleted file]
packer/solaris/install-build-tools.sh [deleted file]
packer/solaris/install-cmake.sh [deleted file]
packer/solaris/install-opencsw.sh [deleted file]
packer/solaris/install-solarisstudio.sh [deleted file]
packer/solaris/install-test-tools.sh [deleted file]
packer/solaris/update.sh [deleted file]
packer/test-rhel-7.json [deleted file]
packer/test-solaris-x86.json [deleted file]
packer/test-windows-2012-r2.json [deleted file]
packer/test-windows-2012.json [deleted file]
packer/ubuntu-16.04-base.json [deleted file]
packer/ubuntu/aws/add-user-build.sh [moved from packer/ubuntu/add-user-build.sh with 100% similarity]
packer/ubuntu/cleanup.sh
packer/ubuntu/install-clang-format.sh
packer/ubuntu/install-coverage-tools.sh [deleted file]
packer/ubuntu/install-jdk-11.sh [moved from packer/rhel/install-repos.sh with 76% similarity]
packer/ubuntu/install-packages.sh [deleted file]
packer/ubuntu/wait-for-cloud-init.sh [deleted file]
packer/windows-2016-base.json [deleted file]
packer/windows-2016-vs-2017.json [deleted file]
packer/windows/2016/aws/startup.ps1 [new file with mode: 0644]
packer/windows/2019/aws/startup.ps1 [new file with mode: 0644]
packer/windows/2019/install-ssh.ps1 [moved from packer/windows/install-ssh.ps1 with 65% similarity]
packer/windows/Packer.psm1 [deleted file]
packer/windows/add-user-build.ps1 [deleted file]
packer/windows/aws/init-ssh.ps1 [new file with mode: 0644]
packer/windows/aws/setup-ec2launch.ps1 [moved from packer/windows/setup-ec2launch.ps1 with 100% similarity]
packer/windows/cleanup.ps1
packer/windows/disable-uac.ps1 [moved from packer/windows/install-activeperl.ps1 with 69% similarity]
packer/windows/google/init-ssh.ps1 [new file with mode: 0644]
packer/windows/init-ssh.ps1 [deleted file]
packer/windows/init-user-build.ps1 [deleted file]
packer/windows/install-chocolatey.ps1
packer/windows/install-dependencies-app-from-github.ps1 [deleted file]
packer/windows/install-dependencies.ps1 [deleted file]
packer/windows/install-doxygen.ps1 [deleted file]
packer/windows/install-gemfire.ps1 [deleted file]
packer/windows/install-geode.ps1 [moved from packer/windows/install-openssl.ps1 with 59% similarity]
packer/windows/install-vs-2017-community.ps1
packer/windows/install-vs-2019-community.ps1 [new file with mode: 0644]
packer/windows/setup-ec2config.ps1 [deleted file]
packer/windows/uninstall-doxygen.ps1 [deleted file]
packer/windows/vs-2015-admin.xml [deleted file]
packer/windows/winrm.cloud-init [deleted file]
sqliteimpl/SqLiteHelper.cpp
sqliteimpl/SqLiteImpl.cpp
tests/cli/DUnitFramework/UnitProcess.cs
tests/cli/DUnitFramework/Util.cs
tests/cli/NewFwkLib/Utils.cs
tests/cpp/.clang-tidy [new file with mode: 0644]
tests/cpp/fwklib/FwkBB.hpp
tests/cpp/fwklib/FwkBBServer.hpp
tests/cpp/fwklib/FwkLog.hpp
tests/cpp/fwklib/Service.hpp
tests/cpp/fwklib/TimeBomb.hpp
tests/cpp/fwklib/UDPIpc.hpp
tests/cpp/security/DummyCredentialGenerator.hpp
tests/cpp/security/XmlAuthzCredentialGenerator.hpp
tests/cpp/testobject/VariousPdxTypes.cpp