cassandra-builds.git
2 weeks agoninja-fix: cassandra-website CI to trigger off cassandra-4.1 builds as well trunk
Mick Semb Wever [Wed, 4 May 2022 07:26:20 +0000 (09:26 +0200)] 
ninja-fix: cassandra-website CI to trigger off cassandra-4.1 builds as well

2 weeks agoUpdate trunk to version 4.2
Mick Semb Wever [Mon, 2 May 2022 13:59:41 +0000 (15:59 +0200)] 
Update trunk to version 4.2

Ddocker testing images to include cassandra-4.2 (delete unused ubuntu1910).
Build dtest jar for 4.2 too.
Add 4.1 ci-cassandra.a.o jobs.
Increase git's http.postBuffer (common CI problem).

 patch by Mick Semb Wever; reviewed by Ekaterina Dimitrova for CASSANDRA-17589

2 weeks agoUse the git clone reference feature in jenkins, pointing each split's git clone to...
Mick Semb Wever [Sun, 10 Apr 2022 18:33:58 +0000 (20:33 +0200)] 
Use the git clone reference feature in jenkins, pointing each split's git clone to the first split

Also clean the workspace when jobs are done.

 patch by Mick Semb Wever; reviewed by Ekaterina Dimitrova for CASSANDRA-17589

3 weeks agoRevert "ninja-fix – disable arm64 builds until INFRA-22930 is resolved properly"
Mick Semb Wever [Wed, 27 Apr 2022 08:49:45 +0000 (10:49 +0200)] 
Revert "ninja-fix – disable arm64 builds until INFRA-22930 is resolved properly"

This reverts commit a0b2355c34823c2e4183fbb50957ec61206213cf.

3 weeks agoUpdate Cassandra build CI script for new website
Mick Semb Wever [Thu, 5 Aug 2021 09:44:03 +0000 (11:44 +0200)] 
Update Cassandra build CI script for new website

 patch by Mick Semb Wever; reviewed by Anthony Grasso for CASSANDRA-16765

4 weeks agoWhen building deb and rpm packages (in docker containers) re-use the host's local...
Mick Semb Wever [Sun, 17 Apr 2022 20:59:15 +0000 (22:59 +0200)] 
When building deb and rpm packages (in docker containers) re-use the host's local maven repository

 patch by Mick Semb Wever; reviewed by Martin Grigorov for INFRA-23147

7 weeks agoIn cassandra-test.sh, list the tests in alphabetical sorting so splits are consistent
Mick Semb Wever [Fri, 25 Mar 2022 11:41:12 +0000 (12:41 +0100)] 
In cassandra-test.sh, list the tests in alphabetical sorting so splits are consistent

The order `find` prints the list can change over filesystems and over time.

 patch by Mick Semb Wever; reviewed by Brandon Williams

7 weeks agoAdd subcomponents to contribulyze 60/head
Mick Semb Wever [Sun, 5 Dec 2021 21:59:03 +0000 (22:59 +0100)] 
Add subcomponents to contribulyze

 patch by Mick Semb Wever; reviewed by Aleksei Zotov, Jeremiah Jordan

8 weeks agoLimit GH pull requests to rebases
Mick Semb Wever [Mon, 21 Mar 2022 19:47:48 +0000 (19:47 +0000)] 
Limit GH pull requests to rebases

 patch by Mick Semb Wever; reviewed by Benjamin Lerer, Berenguer Blasi, Brandon Williams, Ekaterina Dimitrova, Stefan Miklosovic for CASSANDRA-17419

2 months agoninja-fix – disable arm64 builds until INFRA-22930 is resolved properly
Mick Semb Wever [Wed, 2 Mar 2022 09:19:55 +0000 (10:19 +0100)] 
ninja-fix – disable arm64 builds until INFRA-22930 is resolved properly

2 months agoRevert "Updated ant to 1.10.12 for cassandra-artifacts build"
Aleksei Zotov [Sun, 20 Feb 2022 17:07:44 +0000 (21:07 +0400)] 
Revert "Updated ant to 1.10.12 for cassandra-artifacts build"

This reverts commit aabc8465be2cda24268f1dc93b2c35bd018160c2.

2 months agoUpdated ant to 1.10.12 for cassandra-artifacts build
Aleksei Zotov [Thu, 17 Feb 2022 18:31:32 +0000 (22:31 +0400)] 
Updated ant to 1.10.12 for cassandra-artifacts build

patch by Aleksei Zotov; reviewed by Mick Semb Wever for CASSANDRA-16630

3 months agoAdd versions logging for build tools
Aleksei Zotov [Wed, 2 Feb 2022 17:08:24 +0000 (21:08 +0400)] 
Add versions logging for build tools

patch by Aleksei Zotov; reviewed by Mick Semb Wever for CASSANDRA-16630

3 months agoFor rpm packaging replace centos8 docker images with almalinux
Mick Semb Wever [Mon, 31 Jan 2022 23:00:11 +0000 (00:00 +0100)] 
For rpm packaging replace centos8 docker images with almalinux

 patch by Mick Semb Wever; reviewed by Brandon Williams for CASSANDRA-17331

3 months ago(second attempt for PostBuildTask >v3) In Jenkins, replace PostBuildTask plugin with... 61/head
Mick Semb Wever [Tue, 25 Jan 2022 14:30:09 +0000 (15:30 +0100)] 
(second attempt for PostBuildTask >v3) In Jenkins, replace PostBuildTask plugin with PostBuildScript plugin

PostbuildTask loads build log into memory, causing OutOfMemoryException
https://issues.jenkins.io/browse/JENKINS-12830
https://the-asf.slack.com/archives/CK23JSY2K/p1643063068079200?thread_ts=1643052183.068300&cid=CK23JSY2K

 patch by Mick Semb Wever; reviewed by Brandon Williams for CASSANDRA-17288

3 months agoIn Jenkins, replace PostBuildTask plugin with PostBuildScript plugin.
Mick Semb Wever [Tue, 25 Jan 2022 11:08:23 +0000 (12:08 +0100)] 
In Jenkins, replace PostBuildTask plugin with PostBuildScript plugin.

PostbuildTask loads build log into memory, causing OutOfMemoryException
https://issues.jenkins.io/browse/JENKINS-12830
https://the-asf.slack.com/archives/CK23JSY2K/p1643063068079200?thread_ts=1643052183.068300&cid=CK23JSY2K

 patch by Mick Semb Wever; reviewed by Brandon Williams for CASSANDRA-17288

4 months agoUpdate ASF-jenkins-agents.md
mck [Sun, 19 Dec 2021 17:54:08 +0000 (18:54 +0100)] 
Update ASF-jenkins-agents.md

Update ASF-jenkins-agents.md, swap around ips for cassandra49 and cassandra50 (INFRA-22632)

4 months agoUpdate ASF-jenkins-agent.md add cassandra50 and cassandra-arm3,4,5,6
mck [Sat, 18 Dec 2021 12:50:06 +0000 (13:50 +0100)] 
Update ASF-jenkins-agent.md add cassandra50 and cassandra-arm3,4,5,6

5 months agoFix ASF names lookup if the committer name in public_ldap_projects.json isn't found...
mck [Thu, 30 Sep 2021 06:51:32 +0000 (08:51 +0200)] 
Fix ASF names lookup if the committer name in public_ldap_projects.json isn't found in icla-info.json by using the committer name as the default full name

 patch by Jeremiah Jordan; reviewed by Mick Semb Wever

Co-authored-by: Jeremiah Jordan <jeremiah@datastax.com>
5 months agoGenerate contributors reports based on git history
Mick Semb Wever [Mon, 2 Aug 2021 21:02:33 +0000 (23:02 +0200)] 
Generate contributors reports based on git history

 patch by Mick Semb Wever; reviewed by Aleksei Zotov, Jeremiah Jordan for CASSANDRA-17185

6 months agodisabling dependency checks
Stefan Miklosovic [Mon, 25 Oct 2021 07:59:52 +0000 (09:59 +0200)] 
disabling dependency checks

7 months agoupdated owasp dependency check to 6.4.1 containing rate limiting workarounds
Stefan Miklosovic [Fri, 15 Oct 2021 07:30:19 +0000 (09:30 +0200)] 
updated owasp dependency check to 6.4.1 containing rate limiting workarounds

7 months agoturn off owasp dependency check in Jenkins pipeline because of instability
Stefan Miklosovic [Fri, 8 Oct 2021 06:30:32 +0000 (08:30 +0200)] 
turn off owasp dependency check in Jenkins pipeline because of instability

see https://github.com/jeremylong/DependencyCheck/issues/3710 for more details

7 months agoattempt to workaround force push
Brandon Williams [Thu, 7 Oct 2021 16:08:22 +0000 (11:08 -0500)] 
attempt to workaround force push

7 months agore-enable owasp dependency checks
Stefan Miklosovic [Tue, 5 Oct 2021 14:37:17 +0000 (16:37 +0200)] 
re-enable owasp dependency checks

7 months agoturn off dependency checks until CASSANDRA-14612 is resolved
Stefan Miklosovic [Tue, 5 Oct 2021 08:24:23 +0000 (10:24 +0200)] 
turn off dependency checks until CASSANDRA-14612 is resolved

7 months agoInstall lsof and update the README file
Ekaterina Dimitrova [Sun, 26 Sep 2021 17:18:36 +0000 (13:18 -0400)] 
Install lsof and update the README file
patch  by Ekaterina Dimitrova; reviewed by Brandon Williams, Michael Semb Wever for CASSANDRA-16981

7 months agoadd dependency check into cassandra-artifacts.sh 57/head
Stefan Miklosovic [Wed, 22 Sep 2021 15:27:01 +0000 (17:27 +0200)] 
add dependency check into cassandra-artifacts.sh

patch by Stefan Miklosovic; reviewed by Mick Semb Wever for CASSANDRA-14612

9 months agore-enable legacy TLSv1 and TLSv1.1 in both openjdk-8 and openjdk-11 apache/cassandra-testing-ubuntu2004-java11-w-dependencies/latest apache/cassandra-testing-ubuntu2004-java11/latest
Mick Semb Wever [Fri, 13 Aug 2021 19:24:54 +0000 (21:24 +0200)] 
re-enable legacy TLSv1 and TLSv1.1 in both openjdk-8 and openjdk-11

 patch by Mick Semb Wever; reviewed by Brandon Williams for CASSANDRA-16848

9 months agoIn jenkins, compress the console.log files
Mick Semb Wever [Thu, 12 Aug 2021 11:24:12 +0000 (13:24 +0200)] 
In jenkins, compress the console.log files

 patch by Mick Semb Wever; reviewed by Berenguer Blasi

9 months agoninja-fix: branchName cannot be in Cassandra-template-cqlsh-tests, move to job branch...
Mick Semb Wever [Mon, 9 Aug 2021 21:07:51 +0000 (23:07 +0200)] 
ninja-fix: branchName cannot be in Cassandra-template-cqlsh-tests, move to job branch implementations

9 months agoninja-fix: branchName cannot be in Cassandra-template-cqlsh-tests, move to job branch...
Mick Semb Wever [Mon, 9 Aug 2021 20:32:11 +0000 (22:32 +0200)] 
ninja-fix: branchName cannot be in Cassandra-template-cqlsh-tests, move to job branch implementations

9 months agoDockerise cqlshlib tests
Mick Semb Wever [Wed, 5 May 2021 10:34:45 +0000 (12:34 +0200)] 
Dockerise cqlshlib tests

 patch by Mick Semb Wever; reviewed by Brandon Williams for CASSANDRA-16809

9 months agoDeploy multi-architecture (amd+arm) docker testing images
Mick Semb Wever [Mon, 9 Aug 2021 12:03:13 +0000 (14:03 +0200)] 
Deploy multi-architecture (amd+arm) docker testing images

 patch by Mick Semb Wever; reviewed by Brandon Williams for CASSANDRA-16833

9 months agoUpdate testing docker images to include cassandra-4.0 branch and ccm
Mick Semb Wever [Mon, 9 Aug 2021 11:38:48 +0000 (13:38 +0200)] 
Update testing docker images to include cassandra-4.0 branch and ccm

 patch by Mick Semb Wever; patch by XXX for CASSANDRA-16832

9 months agoninja-fix: correct echo failure message in cassandra-test.sh
Mick Semb Wever [Sat, 7 Aug 2021 10:55:40 +0000 (12:55 +0200)] 
ninja-fix: correct echo failure message in cassandra-test.sh

9 months agoPreparation for deleting branch cassandra-4.0.0
Mick Semb Wever [Sat, 31 Jul 2021 08:50:33 +0000 (10:50 +0200)] 
Preparation for deleting branch cassandra-4.0.0

 patch by Mick Semb Wever; reviewed Brandon Williams for CASSANDRA-16824

9 months agoFix centos image in readme
Alex Petrov [Thu, 22 Jul 2021 17:32:45 +0000 (19:32 +0200)] 
Fix centos image in readme

9 months agoFix archived jessie deps
Alex Petrov [Thu, 22 Jul 2021 17:28:39 +0000 (19:28 +0200)] 
Fix archived jessie deps

9 months agoAdd information about variables required for a build
Alex Petrov [Fri, 23 Jul 2021 09:01:15 +0000 (11:01 +0200)] 
Add information about variables required for a build

10 months agoMigrate from bintray uploads to ASF's jfrog artifactory. Also uploading deb and rpm...
Mick Semb Wever [Sat, 1 May 2021 10:23:32 +0000 (12:23 +0200)] 
Migrate from bintray uploads to ASF's jfrog artifactory. Also uploading deb and rpm packages to separate artifactory groups.

11 months agoninja-fix: revert 'cleaning orphaned processes' until cqlshlib tests are dockerised
Mick Semb Wever [Mon, 14 Jun 2021 10:19:30 +0000 (12:19 +0200)] 
ninja-fix: revert 'cleaning orphaned processes' until cqlshlib tests are dockerised
 ref: https://github.com/apache/cassandra-builds/pull/50

11 months agoninja-fix: pkill returns non-zero on no matches
Mick Semb Wever [Sat, 12 Jun 2021 09:00:46 +0000 (11:00 +0200)] 
ninja-fix: pkill returns non-zero on no matches

11 months agoFor every Jenkins job, add the nightlies location for the reports and logs in the...
mck [Sat, 5 Jun 2021 11:20:38 +0000 (13:20 +0200)] 
For every Jenkins job, add the nightlies location for the reports and logs in the console log

 patch by Mick Semb Wever; reviewed by Štefan Miklošovič

11 months agoClean up any "org.apache.cassandra" processes that are left dangling after jobs compl...
Mick Semb Wever [Sun, 6 Jun 2021 08:53:02 +0000 (10:53 +0200)] 
Clean up any "org.apache.cassandra" processes that are left dangling after jobs complete (if the agent is otherwise idle)

 patch by Mick Semb Wever; reviewed by Štefan Miklošovič

11 months agomore 4.0.0 additions for jdk version/dtest upgrades
Brandon Williams [Thu, 3 Jun 2021 17:12:54 +0000 (12:12 -0500)] 
more 4.0.0 additions for jdk version/dtest upgrades

11 months agoAdd 4.0.0 branch
Brandon Williams [Thu, 3 Jun 2021 16:42:04 +0000 (11:42 -0500)] 
Add 4.0.0 branch

11 months agoOnly accept valid number values for `jenkins_executor` (despite retry settings the... 47/head
Mick Semb Wever [Tue, 1 Jun 2021 11:02:47 +0000 (13:02 +0200)] 
Only accept valid number values for `jenkins_executor` (despite retry settings the curl above can still fail)

 patch by Mick Semb Wever; reviewed by Berenguer Blasi

11 months agoFixes to test failures introduced by docker `--cpus` limits
Mick Semb Wever [Tue, 1 Jun 2021 10:16:12 +0000 (12:16 +0200)] 
Fixes to test failures introduced by docker `--cpus` limits

 - don't apply cpu limits to long-test (the View* tests fail)
 - don't inner split long-test, along with the burn tests give them extra resource allocation
 - debug docker_cpus evaluation (crashing on ci-caassandra, not yet reproduced)
 - make git cloning quiet
 - increase build timeouts from 20 to 90 minutes (limited cpus can slow down the queue throughput)
 - decrease docker prune time period, as no jobs run for more than 12 hours anymore

 patch by Mick Semb Wever; reviewed by Jacek Lewandowski, Berenguer Blasi

11 months agoSpecify Docker cpu limits on unit and dtest runs
Mick Semb Wever [Fri, 28 May 2021 08:55:46 +0000 (10:55 +0200)] 
Specify Docker cpu limits on unit and dtest runs

 patch by Mick Semb Wever; reviewed by Jacek Lewandowski, Berenguer Blasi

11 months agoSafetly retry downloading dependencies when building debian and redhat packages 44/head
Mick Semb Wever [Thu, 27 May 2021 07:39:30 +0000 (09:39 +0200)] 
Safetly retry downloading dependencies when building debian and redhat packages

 patch by Mick Semb Wever; reviewed by Berenguer Blasi

11 months agoRetry publishOverSsh to nightlies.a.o, and retry curl ant-junit-..rpm command
Mick Semb Wever [Thu, 20 May 2021 07:39:48 +0000 (09:39 +0200)] 
Retry publishOverSsh to nightlies.a.o, and retry curl ant-junit-..rpm command

 patch by Mick Semb Wever; reviewed by Berenguer Blasi

12 months agoAdd retry count and options to wget and curl
Mick Semb Wever [Wed, 12 May 2021 18:03:55 +0000 (20:03 +0200)] 
Add retry count and options to wget and curl
 jenkins builds were crashing because these commands would trip on any network hickup

12 months agoRepeat fix in 14504b9 for devbranch – tests that don't split need to avoid any last...
Mick Semb Wever [Fri, 7 May 2021 15:19:55 +0000 (17:19 +0200)] 
Repeat fix in 14504b9 for devbranch – tests that don't split need to avoid any last argument

12 months agoDon't let wget or find post-build failures crash the job. And improve how wget retries.
Mick Semb Wever [Fri, 7 May 2021 09:13:20 +0000 (11:13 +0200)] 
Don't let wget or find post-build failures crash the job. And improve how wget retries.

12 months agoninja-fix: in cassandra-test.sh put jar before *-build-test ant target
Mick Semb Wever [Thu, 6 May 2021 20:46:40 +0000 (22:46 +0200)] 
ninja-fix: in cassandra-test.sh put jar before *-build-test ant target

12 months agoRepeat last fix to jvm-dtest and jvm-dtest-upgrade too
Mick Semb Wever [Thu, 6 May 2021 16:16:05 +0000 (18:16 +0200)] 
Repeat last fix to jvm-dtest and jvm-dtest-upgrade too

12 months agoFixes for parallel docker runs
Mick Semb Wever [Thu, 6 May 2021 15:28:21 +0000 (17:28 +0200)] 
Fixes for parallel docker runs
 - empty splits will fail, just run one test instead (to create the needed junit xml report)
 - tests that don't split need to avoid any last argument

12 months agoRemove arch conditionals in builds (need to be runtime conditionals)
Mick Semb Wever [Thu, 6 May 2021 12:38:03 +0000 (14:38 +0200)] 
Remove arch conditionals in builds (need to be runtime conditionals)

12 months agoCorrectly report SUCCESS pipelines
Mick Semb Wever [Thu, 22 Apr 2021 11:59:17 +0000 (13:59 +0200)] 
Correctly report SUCCESS pipelines

 patch by Mick Semb Wever; reviewed by Tomek Łasica for CASSANDRA-16604

12 months agoUpdate jenkins job descriptions to document the use of nightlies.a.o, and grab and...
Mick Semb Wever [Mon, 19 Apr 2021 13:24:11 +0000 (15:24 +0200)] 
Update jenkins job descriptions to document the use of nightlies.a.o, and grab and archive the jenkins console logs

 patch by Mick Semb Wever; reviewed by Tomek Łasica for CASSANDRA-16604

12 months agoSplit dockerised test runs into parallel docker container runs
Mick Semb Wever [Sun, 11 Apr 2021 10:34:41 +0000 (12:34 +0200)] 
Split dockerised test runs into parallel docker container runs

Improvements
 - build arm64 docker images on-the-fly (they are not deployed anywhere yet)
 - only pull the docker images if they are not found locally (saves time!)
 - return internal exit codes
 - configure apt to retry on network failures
 - avoid running empty test splits
 - remove per-agent throttle (as they are now dockerised)

 patch by Mick Semb Wever; reviewed by Tomek Łasica for CASSANDRA-16604

12 months agoInclude cassandra-4.0 dtest-jar for jvm-dtest and jvm-dtest-upgrade tests (CASSANDRA...
Mick Semb Wever [Sun, 2 May 2021 07:35:31 +0000 (09:35 +0200)] 
Include cassandra-4.0 dtest-jar for jvm-dtest and jvm-dtest-upgrade tests (CASSANDRA-16642)

12 months agoInclude JDK 11 builds in cassandra-4.0 branch (CASSANDRA-16642)
Mick Semb Wever [Sat, 1 May 2021 10:44:50 +0000 (12:44 +0200)] 
Include JDK 11 builds in cassandra-4.0 branch (CASSANDRA-16642)

12 months agoCreate release branch cassandra-4.0 (CASSANDRA-16642)
Mick Semb Wever [Sat, 1 May 2021 10:32:52 +0000 (12:32 +0200)] 
Create release branch cassandra-4.0 (CASSANDRA-16642)

13 months agoninja-fix revert
Mick Semb Wever [Wed, 14 Apr 2021 07:40:32 +0000 (09:40 +0200)] 
ninja-fix revert

13 months agoFix JDK11 test runs inside docker
Mick Semb Wever [Thu, 8 Apr 2021 09:50:39 +0000 (11:50 +0200)] 
Fix JDK11 test runs inside docker

Previously cassandra-test.sh depended on the jenkins JAVA_HOME having been configured for different JDK matrix axes. It is now passed through cassandra-test-docker.sh

 patch by Mick Semb Wever; reviewed by Tomek Łasica

13 months agoRevert 6bffb4b "Use the jenkins agent API to identify when the agent is idle"
Mick Semb Wever [Wed, 14 Apr 2021 07:02:02 +0000 (09:02 +0200)] 
Revert 6bffb4b "Use the jenkins agent API to identify when the agent is idle"

The call to the agent API is called from a job on that agent, so the result is never idle.
Lots of agents filled up their disk this week, from docker volumes not getting pruned.

13 months agomake docker prune calls opportunistic (it is ok to skip if another prune command...
Mick Semb Wever [Fri, 9 Apr 2021 21:13:55 +0000 (23:13 +0200)] 
make docker prune calls opportunistic (it is ok to skip if another prune command is running)

13 months agoStay logged into docker (credentials are expected to already be in `.docker/config...
Mick Semb Wever [Thu, 8 Apr 2021 15:50:09 +0000 (17:50 +0200)] 
Stay logged into docker (credentials are expected to already be in `.docker/config.json`)

13 months agoUse the jenkins agent API to identify when the agent is idle (for when it is safe...
Mick Semb Wever [Sun, 4 Apr 2021 18:42:33 +0000 (20:42 +0200)] 
Use the jenkins agent API to identify when the agent is idle (for when it is safe to remove docker volumes)

 patch by Mick Semb Wever; reviewed by Tomek Łasica

13 months agoFixes for arm64 and print-shas (INFRA-21619)
Mick Semb Wever [Sat, 3 Apr 2021 20:38:05 +0000 (22:38 +0200)] 
Fixes for arm64 and print-shas (INFRA-21619)

13 months agoIn docker tests, don't fail if build/test/logs doesn't exist, as not all tests create it
Mick Semb Wever [Fri, 2 Apr 2021 10:50:16 +0000 (12:50 +0200)] 
In docker tests, don't fail if build/test/logs doesn't exist, as not all tests create it

13 months agoninja-fix sha printing
Mick Semb Wever [Fri, 2 Apr 2021 10:27:04 +0000 (12:27 +0200)] 
ninja-fix sha printing

13 months agoninja-fix docker scritps calls
Mick Semb Wever [Thu, 1 Apr 2021 19:28:34 +0000 (21:28 +0200)] 
ninja-fix docker scritps calls

13 months agoProvide scripts to dockerise test runs
Mick Semb Wever [Thu, 1 Apr 2021 09:35:51 +0000 (11:35 +0200)] 
Provide scripts to dockerise test runs

 patch by Mick Semb Wever; reviewed by Brandon Williams

13 months agoninja-fix sha printing
Mick Semb Wever [Thu, 1 Apr 2021 19:04:25 +0000 (21:04 +0200)] 
ninja-fix sha printing

13 months agoJenkins user on agents shouldn't have sudo
Mick Semb Wever [Thu, 1 Apr 2021 14:08:35 +0000 (16:08 +0200)] 
Jenkins user on agents shouldn't have sudo

13 months agoIn Jenkins devbranch pipeline, summarise the SHAs (when consistent) rather than print...
Mick Semb Wever [Sun, 21 Mar 2021 12:09:53 +0000 (13:09 +0100)] 
In Jenkins devbranch pipeline, summarise the SHAs (when consistent) rather than printing them all out

 patch by Mick Semb Wever; reviewed by Berenguer Blasi

13 months agoAdd 14 Jenkins agents to ci-cassandra, and retire 7.
Mick Semb Wever [Sat, 20 Mar 2021 10:27:44 +0000 (11:27 +0100)] 
Add 14 Jenkins agents to ci-cassandra, and retire 7.
Clean up the installation documentation, and provide an install script for stick Ubuntu 18.04 servers.
Rename ASF-jenkins-agents.txt to ASF-jenkins-agents.md

13 months agoFix ip to Huawei servers
Mick Semb Wever [Mon, 29 Mar 2021 19:22:32 +0000 (21:22 +0200)] 
Fix ip to Huawei servers

13 months agofix postBuildTask needs to come after after publishOverSsh
Mick Semb Wever [Sat, 27 Mar 2021 21:29:05 +0000 (22:29 +0100)] 
fix postBuildTask needs to come after after publishOverSsh

13 months agoA more intuitve layout of builds in nightlies.a.o
Mick Semb Wever [Sat, 27 Mar 2021 20:42:28 +0000 (21:42 +0100)] 
A more intuitve layout of  builds in nightlies.a.o
  This commits follows on from da5f40aa6f1bf39fb917ddf1623bc8b8b73cf0fd

13 months agoA more intuitve layout of builds in nightlies.a.o
Mick Semb Wever [Sat, 27 Mar 2021 15:38:53 +0000 (16:38 +0100)] 
A more intuitve layout of  builds in nightlies.a.o
 This commits follows on from da5f40aa6f1bf39fb917ddf1623bc8b8b73cf0fd

13 months agoninja-fix: echo into the fifo in build-scripts/cassandra-test.sh
Mick Semb Wever [Sat, 27 Mar 2021 13:45:58 +0000 (14:45 +0100)] 
ninja-fix: echo into the fifo in build-scripts/cassandra-test.sh

13 months agoninja-fix: fix testlist splits, echo into the fifo
Mick Semb Wever [Sat, 27 Mar 2021 11:41:57 +0000 (12:41 +0100)] 
ninja-fix: fix testlist splits, echo into the fifo

13 months agoSplit unit and jvm dtests. Move jvm dtests to DTest stage in the pipeline
Mick Semb Wever [Sat, 13 Mar 2021 15:43:23 +0000 (16:43 +0100)] 
Split unit and jvm dtests. Move jvm dtests to DTest stage in the pipeline

 patch by Mick Semb Wever; reviewed by Tomek Łasica for CASSANDRA-16402

13 months agoAdd arm64 jobs and axis to jenkins jobs.
Mick Semb Wever [Sat, 13 Mar 2021 14:52:50 +0000 (15:52 +0100)] 
Add arm64 jobs and axis to jenkins jobs.

Three new lables are introduced: 'cassandra-arm64', 'cassandra-arm64-dtest', and 'cassandra-arm64-dtest-large'

Artifact, Unit Test, and cqlshlib, matrix jobs have added an arm64 axis, using one of the above labels.

DTest jobs have arm64 variants created, as there's not enough arm64 resources to include these into the existing jobs as axis.

 patch by Mick Semb Wever; reviewed by Tomek Łasica for CASSANDRA-16475

13 months agoDisable parallel test runners until post 4.0-rc1
Mick Semb Wever [Wed, 24 Mar 2021 07:50:04 +0000 (08:50 +0100)] 
Disable parallel test runners until post 4.0-rc1

14 months agoJava DTests don't support parallel runners (CASSANDRA-16511)
Mick Semb Wever [Fri, 12 Mar 2021 19:05:37 +0000 (20:05 +0100)] 
Java DTests don't support parallel runners (CASSANDRA-16511)

14 months agoIn Jenkins, introduce the "cassandra-dtest" label
Mick Semb Wever [Thu, 11 Mar 2021 10:54:18 +0000 (11:54 +0100)] 
In Jenkins, introduce the "cassandra-dtest" label

DTests jobs take up a lot of disk space, becuase there is a git clone per split. Agents with not enough disk space can still be used by excluding dtests jobs.

14 months agoadded docs for Plausible deployment (CASSANDRA-16488)
Stefan Miklosovic [Tue, 9 Mar 2021 20:14:55 +0000 (21:14 +0100)] 
added docs for Plausible deployment (CASSANDRA-16488)

Co-authored-by: mck <mck@apache.org>
14 months agoFix centos packaging for arm64
Mick Semb Wever [Thu, 4 Mar 2021 09:47:32 +0000 (10:47 +0100)] 
Fix centos packaging for arm64

 patch by Mick Semb Wever; reviewed by Brandon Williams for CASSANDRA-16477

14 months agoDon't build cython extensions for cassandra-driver in testing images (#37)
Sam Tunnicliffe [Wed, 3 Mar 2021 13:44:24 +0000 (13:44 +0000)] 
Don't build cython extensions for cassandra-driver in testing images (#37)

Patch by Sam Tunnicliffe; reviewed by Mick Semb Wever for CASSANDRA-16474

14 months agoFix selections of JDKs in debian docker images on arm64
Mick Semb Wever [Sat, 6 Feb 2021 09:26:50 +0000 (10:26 +0100)] 
Fix selections of JDKs in debian docker images on arm64

 patch by Mick Semb Wever; reviewed by Zhao Renhai,Brandon Williams for CASSANDRA-16428

14 months agokeep disk usage on ci-cassandra.a.o master down by only keeping stage job artefacts...
Mick Semb Wever [Fri, 19 Feb 2021 08:48:38 +0000 (09:48 +0100)] 
keep disk usage on ci-cassandra.a.o master down by only keeping stage job artefacts for 24 hrs (INFRA-21422)

15 months agoAdd dtest-upgrade and dtest-large-novnode to Jenkins devbranch pipeline
Mick Semb Wever [Fri, 15 Jan 2021 19:14:52 +0000 (20:14 +0100)] 
Add dtest-upgrade and dtest-large-novnode to Jenkins devbranch pipeline

 patch by Mick Semb Wever; reviewed by Jacek Lewandowski,Tomek Łasica for CASSANDRA-16377

15 months agoninja-fix: correct nightlies url for devbranch
Mick Semb Wever [Tue, 9 Feb 2021 18:32:26 +0000 (19:32 +0100)] 
ninja-fix: correct nightlies url for devbranch

15 months agoJenkins builds to provide link to nightlies archive, and remove the Jenkins plaintext...
Mick Semb Wever [Sat, 23 Jan 2021 10:32:06 +0000 (11:32 +0100)] 
Jenkins builds to provide link to nightlies archive, and remove the Jenkins plaintext reports

 Also add aggregated xml reports to the test jobs, and archive them to nightlies.a.o

 patch by Mick Semb Wever; reviewed by Tomek Łasica for CASSANDRA-16401

15 months agoPin 'cryptography<3.4' (dep to urllib3) to maintain support for python2 in the docker...
Mick Semb Wever [Mon, 8 Feb 2021 10:58:57 +0000 (11:58 +0100)] 
Pin 'cryptography<3.4' (dep to urllib3) to maintain support for python2 in the docker image used for building the rpm packages

 patch by Mick Semb Wever; reviewed by Sam Tunnicliffe