cassandra-dtest.git
11 months agoRemove CircleCI folder from dtest
Ruslan Fomkin [Tue, 7 Sep 2021 07:42:49 +0000 (09:42 +0200)] 
Remove CircleCI folder from dtest

CircleCI configuration in this repo is never used and, thus, is not
up-to-date, which is confusing. This commit removes it. Configuration
from the main Cassandra repo is used for running dtest in CircleCI.

 patch by Ruslan Fomkin; reviewed by Brandon Williams, Michael Semb Wever for CASSANDRA-16853

11 months agoninja: fix version checks in TestNetworkAuth
Sam Tunnicliffe [Mon, 6 Sep 2021 18:45:36 +0000 (19:45 +0100)] 
ninja: fix version checks in TestNetworkAuth

Follow up to CASSANDRA-16404

11 months agowait for node to be available in upgrade tests for Thrift for dense and sparse superc...
Stefan Miklosovic [Thu, 26 Aug 2021 17:47:20 +0000 (19:47 +0200)] 
wait for node to be available in upgrade tests for Thrift for dense and sparse supercolumn tests

patch by Stefan Miklosovic; reviewed by Benjamin Lerer for CASSANDRA-16892

11 months agoAdd JMX auth test
Aleksei Zotov [Sun, 22 Aug 2021 15:30:34 +0000 (19:30 +0400)] 
Add JMX auth test

Patch by Aleksei Zotov; reviewed by Sam Tunnicliffe for
CASSANDRA-16404

11 months agoExtend network auth test to check deprecated mbean name
Sam Tunnicliffe [Tue, 17 Aug 2021 13:26:45 +0000 (14:26 +0100)] 
Extend network auth test to check deprecated mbean name

Patch by Sam Tunnicliffe; reviewed by Aleksei Zotov for
CASSANDRA-16404

12 months agoAdd test for CASSANDRA-16104
Andrés de la Peña [Thu, 15 Jul 2021 11:38:26 +0000 (12:38 +0100)] 
Add test for CASSANDRA-16104

patch by Andrés de la Peña; reviewed by Benjamin Lerer for CASSANDRA-16104

12 months agoFix flaky test consistent_bootstrap_test.py::TestBootstrapConsistency::test_consisten...
David Capwell [Wed, 4 Aug 2021 02:07:56 +0000 (19:07 -0700)] 
Fix flaky test consistent_bootstrap_test.py::TestBootstrapConsistency::test_consistent_reads_after_move

patch by David Capwell; reviewed by Abe Ratnofsky, Ekaterina Dimitrova for CASSANDRA-16826

12 months agoFix TestCqlsh for Cassandra 2.2, except test_client_warnings
Aleksandr Sorokoumov [Tue, 12 Jan 2021 12:07:51 +0000 (13:07 +0100)] 
Fix TestCqlsh for Cassandra 2.2, except test_client_warnings
patch by Aleksandr Sorokoumov; review by Ekaterina Dimitrova and Brandon Williams for CASSANDRA-15985

12 months agoPass enable_scripted_user_defined_functions to clusters with version >= 3.0
Ekaterina Dimitrova [Wed, 14 Jul 2021 23:58:18 +0000 (19:58 -0400)] 
Pass enable_scripted_user_defined_functions to clusters with version >= 3.0
patch by Ekaterina Dimitrova, review by Brandon Williams for CASSANDRA-16736

13 months agoUpdate timer metrics assertion for Cassandra-16760 (#149)
Yifan Cai [Fri, 16 Jul 2021 17:24:30 +0000 (10:24 -0700)] 
Update timer metrics assertion for Cassandra-16760 (#149)

13 months agoAdd 4_0 to Python DTest's upgrade_manifest for cassandra-4.0.0
Mick Semb Wever [Thu, 1 Jul 2021 12:04:52 +0000 (14:04 +0200)] 
Add 4_0 to Python DTest's upgrade_manifest for cassandra-4.0.0

 patch by Mick Semb Wever; reviewed by Berenguer Blasi, Brandon Williams for CASSANDRA-16781

13 months agoBinLog does not close chronicle queue leaving this to GC to cleanup
David Capwell [Fri, 2 Jul 2021 17:38:29 +0000 (10:38 -0700)] 
BinLog does not close chronicle queue leaving this to GC to cleanup

patch by David Capwell; reviewed by Caleb Rackliffe, Marcus Eriksson for CASSANDRA-16774

13 months agoMark counter_leader_with_partial_view_test since 3.0
Brandon Williams [Wed, 30 Jun 2021 15:29:26 +0000 (10:29 -0500)] 
Mark counter_leader_with_partial_view_test since 3.0

Patch by Joel Knighton, reviewed by brandonwilliams for CASSANDRA-14028

13 months agoNinja remove mention of cassandra_dir in pytest.ini that doesn't work
Brandon Williams [Tue, 29 Jun 2021 15:50:05 +0000 (10:50 -0500)] 
Ninja remove mention of cassandra_dir in pytest.ini that doesn't work

(CASSANDRA-14651)

13 months agoNinja fix all occurences of non-existent self.fail to pytest.fail
Brandon Williams [Thu, 24 Jun 2021 21:44:08 +0000 (16:44 -0500)] 
Ninja fix all occurences of non-existent self.fail to pytest.fail

13 months agoEnable DROP COMPACT for thrift upgrade tests
Benjamin Lerer [Tue, 22 Jun 2021 09:05:00 +0000 (11:05 +0200)] 
Enable DROP COMPACT for thrift upgrade tests

13 months agoRemove unecessary DROP COMPACT STORAGE
Benjamin Lerer [Mon, 21 Jun 2021 09:28:49 +0000 (11:28 +0200)] 
Remove unecessary DROP COMPACT STORAGE

13 months agoTests changes for CASSANDRA-16733
Benjamin Lerer [Tue, 15 Jun 2021 13:14:48 +0000 (15:14 +0200)] 
Tests changes for CASSANDRA-16733

13 months agoVerify that the server can start after changing sstable levels
Andrés de la Peña [Wed, 9 Jun 2021 23:44:06 +0000 (00:44 +0100)] 
Verify that the server can start after changing sstable levels

patch by Andrés de la Peña; reviewed by Berenguer Blasi and Stefania Alborghetti for CASSANDRA-12519

14 months agoAdd TLS test for cqlsh
Brandon Williams [Fri, 11 Jun 2021 21:03:51 +0000 (16:03 -0500)] 
Add TLS test for cqlsh
patch by Brandon Williams, reviewed by Ekaterina Dimitrova, Adam Holmberg and David Capwell for CASSANDRA-16695

14 months agoCASSANDRA-16729 - user_types_test.py::TestUserTypes::test_type_keyspace_permission_is...
David Capwell [Thu, 10 Jun 2021 23:35:22 +0000 (16:35 -0700)] 
CASSANDRA-16729 - user_types_test.py::TestUserTypes::test_type_keyspace_permission_isolation uses retries to avoid flakyness

patch by David Capwell; reviewed by Brandon Williams for CASSANDRA-16729

14 months agoCASSANDRA-16728 - test_tombstone_failure_threshold_message assert checking if array...
David Capwell [Wed, 9 Jun 2021 23:01:18 +0000 (16:01 -0700)] 
CASSANDRA-16728 - test_tombstone_failure_threshold_message assert checking if array == string, should check for array truthiness
patch by David Capwell; reviewed by Yifan Cai for CASSANDRA-16728

14 months agoMove flaky in-jvm fql dtest to python
Brandon Williams [Wed, 9 Jun 2021 13:48:08 +0000 (08:48 -0500)] 
Move flaky in-jvm fql dtest to python

Patch by brandonwilliams; reviewed by edimitrova for CASSANDRA-16720

14 months agodtest for setting hostId upon node startup
fibersel [Wed, 26 May 2021 23:49:56 +0000 (02:49 +0300)] 
dtest for setting hostId upon node startup

patch by Abi Palagashvili; reviewed by Stefan Miklosovic and Paulo Motta for CASSANDRA-14582

14 months agoFlaky TestConsistency.test_13880
Bereng [Mon, 7 Jun 2021 07:50:09 +0000 (09:50 +0200)] 
Flaky TestConsistency.test_13880

patch by Berenguer Blasi; reviewed by Andres de la Peña for CASSANDRA-16716

14 months agoAdd 4.0.0 branch
Brandon Williams [Thu, 3 Jun 2021 16:46:39 +0000 (11:46 -0500)] 
Add 4.0.0 branch

14 months agoFailure to execute queries should emit a KPI other than read timeout/unavailable...
David Capwell [Fri, 14 May 2021 22:53:41 +0000 (15:53 -0700)] 
Failure to execute queries should emit a KPI other than read timeout/unavailable so it can be alerted/tracked

patch by David Capwell; reviewed by Sam Tunnicliffe for CASSANDRA-16581

14 months agoninja fix six >=1.12.0
Brandon Williams [Wed, 26 May 2021 21:51:39 +0000 (16:51 -0500)] 
ninja fix six >=1.12.0

14 months agoFlaky TestPaxos.test_replica_availability
Bereng [Tue, 25 May 2021 06:46:07 +0000 (08:46 +0200)] 
Flaky TestPaxos.test_replica_availability

patch by Berenguer Blasi; reviewed by Ekaterina Dimitrova for CASSANDRA-16693

14 months agoDon't pip install ccm in editable mode. Because of the "movable" cassandra-test tag...
Mick Semb Wever [Sun, 23 May 2021 15:45:33 +0000 (17:45 +0200)] 
Don't pip install ccm in editable mode. Because of the "movable" cassandra-test tag, pip needs to re-install ccm each time.

 patch by Mick Semb Wever; reviewed by David Capwell, Berenguer Blasi, Ekaterina Dimitrova for CASSANDRA-16688

14 months agoStandaloneVerifier does not fail when unable to verify SSTables, it only fails if...
David Capwell [Fri, 21 May 2021 22:50:06 +0000 (15:50 -0700)] 
StandaloneVerifier does not fail when unable to verify SSTables, it only fails if Corruption is thrown

patch by David Capwell; reviewed by Marcus Eriksson for CASSANDRA-16683

14 months agoFix paxos_test::test_cluster_availability
Ekaterina Dimitrova [Mon, 17 May 2021 23:53:04 +0000 (19:53 -0400)] 
Fix paxos_test::test_cluster_availability
authored by Ekaterina Dimitrova; reviewed by Berenguer Blasi for CASSANDRA-16657

14 months agoFix jmx_test
Brandon Williams [Tue, 18 May 2021 22:23:34 +0000 (17:23 -0500)] 
Fix jmx_test

14 months agoadd bloom filter false ratio tests
Jaroslaw Grabowski [Tue, 26 May 2020 12:45:07 +0000 (14:45 +0200)] 
add bloom filter false ratio tests

Patch by Jaroslaw Grabowski, reviewed by brandonwilliams and paulo for
CASSANDRA-15834

Verifies if BloomFilterFalseRatio takes into account true negatives.
Without this fix, the following scenario (many reads for non-existing
rows) would yield BloomFilterFalseRatio=1.0. With the fix we assume
it should be less then the default bloom_filter_fp_chance.

14 months agoFlaky TestTransientReplicationRing.test_move_backwards_and_cleanup
Bereng [Mon, 10 May 2021 05:28:56 +0000 (07:28 +0200)] 
Flaky TestTransientReplicationRing.test_move_backwards_and_cleanup

patch by Berenguer Blasi; reviewed by Ekaterina Dimitrova for CASSANDRA-16644

15 months agoMove CASSANDRA-14559s bootstrap_test.py::TestBootstrap::test_node_cannot_join_as_hibe...
David Capwell [Thu, 13 May 2021 19:42:44 +0000 (12:42 -0700)] 
Move CASSANDRA-14559s bootstrap_test.py::TestBootstrap::test_node_cannot_join_as_hibernating_node_without_replace_address into a jvm-dtest

patch by David Capwell; reviewed by Stefan Miklosovic for CASSANDRA-16662

15 months agoFix test_counters upgrade test for 4.0
Andrés de la Peña [Wed, 12 May 2021 19:48:23 +0000 (20:48 +0100)] 
Fix test_counters upgrade test for 4.0

patch by Andrés de la Peña; reviewed by Ekaterina Dimitrova for CASSANDRA-16653

15 months agopython test failures caused by error checks not filtering JAVA_TOOL_OPTIONS
David Capwell [Thu, 6 May 2021 21:27:42 +0000 (14:27 -0700)] 
python test failures caused by error checks not filtering JAVA_TOOL_OPTIONS

patch by David Capwell; reviewed by Benjamin Lerer for CASSANDRA-16660

15 months agoAdd 4_0_x to Python DTest's upgrade_manifest
Bereng [Tue, 4 May 2021 08:06:44 +0000 (10:06 +0200)] 
Add 4_0_x to Python DTest's upgrade_manifest

patch by Berenguer Blasi; reviewed by Mick Semb Wever for CASSANDRA-16648

Co-authored-by: Mick Semb Wever <mck@apache.org>
Co-authored-by: Bereng <berenguerblasi@gmail.com>
15 months agoAdd gossip tests that were useful while validating CASSANDRA-16588
Matt Fleming [Mon, 26 Apr 2021 11:10:18 +0000 (12:10 +0100)] 
Add gossip tests that were useful while validating CASSANDRA-16588

Patch by Matt Fleming; reviewed by brandonwilliams for CASSANDRA-16632

15 months agoFix flaky test_pending_range
Andrés de la Peña [Wed, 21 Apr 2021 15:53:39 +0000 (16:53 +0100)] 
Fix flaky test_pending_range

patch by Andrés de la Peña; reviewed by Berenguer Blasi for CASSANDRA-16614

Co-authored-by: Andrés de la Peña <a.penya.garcia@gmail.com>
Co-authored-by: Bereng <berenguerblasi@gmail.com>
15 months agoRemove references to run_dtests.py in the README
Matt Fleming [Wed, 21 Apr 2021 13:32:22 +0000 (14:32 +0100)] 
Remove references to run_dtests.py in the README
Authored by Matt Fleming; reviewed by Michael Semb Wever and Ekaterina Dimitrova for CASSANDRA-16623

16 months agoAdd test for bootstrap when schema changes with removed nodes
Brandon Williams [Thu, 8 Apr 2021 14:41:57 +0000 (09:41 -0500)] 
Add test for bootstrap when schema changes with removed nodes

Patch by brandonwilliams, reviewed by Adam Holmberg, adelpena and
bdeggleston for CASSANDRA-16577

16 months agoRelax timeouts and less concurrency for test_contention_many_threads
Adam Holmberg [Fri, 26 Mar 2021 00:16:41 +0000 (00:16 +0000)] 
Relax timeouts and less concurrency for test_contention_many_threads
authored by Adam Holmberg; reviewed by Ekaterina Dimitrova and Benjamin Lerer for CASSANDRA-13517

16 months agosimplify/harden GPFS test
Brandon Williams [Wed, 17 Mar 2021 20:42:59 +0000 (15:42 -0500)] 
simplify/harden GPFS test

Patch by brandonwilliams, reviewed by edimitrova for CASSANDRA-13196

16 months agoRemove flaky annotation from `test_resumable_rebuild` and add ignore-log pattern.
Gianluca Righetto [Mon, 22 Mar 2021 06:40:43 +0000 (03:40 -0300)] 
Remove flaky annotation from `test_resumable_rebuild` and add ignore-log pattern.

 patch by Gianluca Righetto; reviewed by Ekaterina Dimitrova, Mick Semb Wever, Zhao Yang for CASSANDRA-15892

16 months agoFix flaky test_ttl_deletions
Bereng [Mon, 22 Mar 2021 10:42:46 +0000 (11:42 +0100)] 
Fix flaky test_ttl_deletions
patch authored by Berenguer Blasi; reviewed by Ekaterina Dimitrova and Andres de la Pena for CASSANDRA-16530

17 months agoReduce data amount and allow one read for reset interval
Brandon Williams [Fri, 12 Mar 2021 19:41:52 +0000 (13:41 -0600)] 
Reduce data amount and allow one read for reset interval

Patch by brandonwilliams; reviewed by Berenguer Blasi for
CASSANDRA-16472

17 months agoTests fixed and new ones added for CASSANDRA-15897
Ekaterina Dimitrova [Fri, 11 Dec 2020 15:06:19 +0000 (10:06 -0500)] 
Tests fixed and new ones added for CASSANDRA-15897

patch by Ekaterina Dimitrova; reviewed by Benjamin Lerer and Brandon Williams

17 months agoInclude column selections in TestCQLSlowQuery
Andrés de la Peña [Wed, 10 Mar 2021 17:39:07 +0000 (17:39 +0000)] 
Include column selections in TestCQLSlowQuery

patch by Andrés de la Peña; reviewed by Benjamin Lerer for CASSANDRA-16483

17 months agoAdd annotations to stop running batch write and hinted handoff tests that have been...
Caleb Rackliffe [Mon, 8 Mar 2021 17:13:52 +0000 (17:13 +0000)] 
Add annotations to stop running batch write and hinted handoff tests that have been ported to the in-JVM framework in 4.0

patch by Caleb Rackliffe; reviewed by Andrés de la Peña and Ekaterina Dimitrova for CASSANDRA-16181#

17 months agoincremental_repair_test's test_manual_session_fail, test_manual_session_cancel_non_co...
Marcus Eriksson [Mon, 22 Feb 2021 13:21:09 +0000 (14:21 +0100)] 
incremental_repair_test's test_manual_session_fail, test_manual_session_cancel_non_coordinator_failure and test_manual_session_force_cancel,  migrated to in-jvm dtests

 patch by Marcus Eriksson; reviewed by Adam Holmberg, Mick Semb Wever for CASSANDRA-16425

17 months agoAdd checks to test the RepairMetrics.previewFailures counter
Yasar Arafath Baigh [Fri, 20 Nov 2020 02:51:49 +0000 (08:21 +0530)] 
Add checks to test the RepairMetrics.previewFailures counter

patch by Yasar Arafath Baigh; reviewed by Adam Holmberg, Andrés de la Peña and Benjamin
Lerer for CASSANDRA-16191

17 months agofix snitch_test.py::TestGossipingPropertyFileSnitch::test_prefer_local_reconnect_on_l...
Mick Semb Wever [Sat, 27 Feb 2021 10:07:15 +0000 (11:07 +0100)] 
fix snitch_test.py::TestGossipingPropertyFileSnitch::test_prefer_local_reconnect_on_listen_address

Patch by mck; reviewed by brandonwilliams for CASSANDRA-16381

17 months agoadd simple removenode test
Brandon Williams [Mon, 1 Feb 2021 23:47:54 +0000 (17:47 -0600)] 
add simple removenode test

Patch by brandonwilliams; reviwed by mck for CASSANDRA-16381

17 months agoFix selections of JDKs in debian docker images on arm64
Mick Semb Wever [Sun, 7 Feb 2021 10:38:06 +0000 (11:38 +0100)] 
Fix selections of JDKs in debian docker images on arm64

 patch by Mick Semb Wever; reviewed by Zhao Renhai,Brandon Williams for CASSANDRA-16428

17 months agoFix reg exp in replication_test.TestReplication.test_network_topology to include...
Bereng [Thu, 25 Feb 2021 09:58:19 +0000 (10:58 +0100)] 
Fix reg exp in replication_test.TestReplication.test_network_topology to include 4.0 verbs

 patch by Berenguer Blasi; reviewed by Mick Semb Wever for CASSANDRA-16469

17 months agoUpdate dtests following CASSANDRA-14973 (#127)
Sam Tunnicliffe [Thu, 25 Feb 2021 19:49:02 +0000 (19:49 +0000)] 
Update dtests following CASSANDRA-14973 (#127)

* Specify v5 for pushed notification test if available
* Add v5 to cqlsh protocol negotiation test
* Default to v5 for 4.0

Patch by Sam Tunnicliffe; reviewed by Brandon Williams for CASSANDRA-14973

17 months agoDisable autocompaction during snapshot test
Brandon Williams [Tue, 23 Feb 2021 23:25:51 +0000 (17:25 -0600)] 
Disable autocompaction during snapshot test

Patch by brandonwilliams; reviewed by mck for CASSANDRA-16441

17 months agoAdd tests for parent repair session cleanup
jtgrabowski [Wed, 24 Feb 2021 18:50:46 +0000 (18:50 +0000)] 
Add tests for parent repair session cleanup

patch by Jaroslaw Grabowski and Berenguer Blasi; reviewed by Ekaterina Dimitrova and Andrés de la Peña for CASSANDRA-16446

Co-authored-by: jtgrabowski <jaroslaw.grabowski@datastax.com>
Co-authored-by: Bereng <berenguerblasi@gmail.com>
17 months agoFix Cassandra version families, and more…
jacek-lewandowski [Tue, 9 Feb 2021 16:23:21 +0000 (17:23 +0100)] 
Fix Cassandra version families, and more…

 - Remove OVERRIDE_MANIFEST, as it is unused.
 - Upgrade manifest, remove upgrades from unsupported indev versions, and remove upgrades to current if indev is still supported.
 - Correct the enforced protocol version to use v3 for 2.2/3.0 upgrades. (ref: CASSANDRA-15193)
 - Fix broken thrift_upgrade_test.py
 - Fix upgrade_udtfix_test.py (not applicable before 3.11.6, ref: CASSANDRA-15035)
 - Remove hardcoded references to gitbox.a.o
 - Remove unnecessary implicit upgrade scenarios. `--upgrade-target-version-only` only tests upgrades from the target version and to the target version, i.e. those upgrade paths where the target (indev) version was the origin or destination version. Previously the filter was applied only for the version family but not on the variant, pulling in completely unrelated upgrade scenarios.

 patch by Jacek Lewandowski; reviewed by Tomek Łasica, Mick Semb Wever for CASSANDRA-16433

17 months agoAdd explicit DC to tests where we have multidc setup
Bereng [Mon, 15 Feb 2021 07:13:22 +0000 (08:13 +0100)] 
Add explicit DC to tests where we have multidc setup

 patch by Berenguer Blasi; reviewed by Ekaterina Dimitrova, Tomek Łasica, Andres de la Peña for CASSANDRA-16411

17 months agoAdd test to verify that a node can join when RF > N in multi-DC
Bereng [Thu, 18 Feb 2021 11:46:32 +0000 (11:46 +0000)] 
Add test to verify that a node can join when RF > N in multi-DC

patch by Berenguer Blasi; reviewed by Andrés de la Peña, Ekaterina Dimitrova and Tomasz Lasica for CASSANDRA-16296

17 months agoMark tests for short read protection and put-get tests as ported to in-JVM
Andrés de la Peña [Mon, 30 Nov 2020 18:05:04 +0000 (18:05 +0000)] 
Mark tests for short read protection and put-get tests as ported to in-JVM

patch by Andrés de la Peña; reviewed by Caleb Rackliffe, Alex Petrov and Blake Eggleston for CASSANDRA-16180

18 months agoUpdate requirements.txt with the new ccm update strategy
Ekaterina Dimitrova [Wed, 10 Feb 2021 17:57:49 +0000 (12:57 -0500)] 
Update requirements.txt with the new ccm update strategy
Patch by Ekaterina Dimitrova, reviewed by Michael Semb Wever for CASSANDRA-16438

18 months agoAdd explicit DC to tests where we have multidc setup
Bereng [Tue, 2 Feb 2021 07:28:10 +0000 (08:28 +0100)] 
Add explicit DC to tests where we have multidc setup
patch by Berenguer Blasi, reviewed by Tomasz Lasica, Andres de la Peña and Ekaterina Dimitrova for CASSANDRA-16411

18 months agoUpdate tests for CASSANDRA-14793
Benjamin Lerer [Mon, 28 Sep 2020 12:23:44 +0000 (14:23 +0200)] 
Update tests for CASSANDRA-14793

patch by Benjamin Lerer; reviewed by Andrés de la Peña and  Marcus
Eriksson for CASSANDRA-14793

18 months agoImprove flake8
Tomek Lasica [Tue, 26 Jan 2021 19:40:07 +0000 (20:40 +0100)] 
Improve flake8

patch by Tomek Łasica; reviewed by Mick Semb Wever

18 months agoHandle NodeError as it may be raised from ccm
Tomek Lasica [Tue, 26 Jan 2021 15:29:20 +0000 (16:29 +0100)] 
Handle NodeError as it may be raised from ccm

patch by Tomek Łasica; reviewed by Mick Semb Wever for CASSANDRA-16405

18 months agoListing tests (--collect-only and --dtest-print-tests-only) only lists tests that...
jacek-lewandowski [Fri, 22 Jan 2021 07:55:28 +0000 (08:55 +0100)] 
Listing tests (--collect-only and --dtest-print-tests-only) only lists tests that will run according to other arguments specified

This patch fixes behaviour for both `run_dtests.py` and `pytest`.
- Error handling for invalid parameter values / combinations is in a single place (`dtest_config.py`) and is executed before we actually traverse through the tests
- We exit with just a clean error message instead of tons of spam
- `run_dtests.sh` will not loose the exit code of `pytest` any more so we can clearly detect when test cases collection fails
- removed a bit of boilerplate code from `run_dtests.py`, e.g. what it did with xml processing is simply provided with `-q` argument of `pytest`
- tests filtering has been refactored to be cleaner
- fixed filtering of resource intensive tests and other tests (note that except for upgrade tests, we took care only about test method annotations - module level annotations were ignored for vnodes, no_vnodes, no_offheap_memtables and resource_intensive, ...)
- added meta_tests for the filtering and parsing exception handling
- added special parameter --metatests which is enough to run all the meta tests
- fixed Travis configuration so that it runs meta tests

Note that now `run_dtests.py` seems to be redundant. If we need it only for listing dtests, we can simply achieve exactly the same effect using `--collect-only -q --ignore=meta_tests` arguments for `pytest` instead of `--dtest-print-tests-only`, plus  we need to filter output with `grep '.py::'` (in order to not include the summary line) and pipe stdout to the target file. It is now simplified so `run_dtests.sh` just uses `pytest` with those arguments.

patch by Jacek Lewandowski; reviewed by Tomek Łasica and Mick Semb Wever for CASSANDRA-16399

18 months agoProtocol v5 is only supported in 4.0+ (#116)
Sam Tunnicliffe [Fri, 22 Jan 2021 11:16:50 +0000 (11:16 +0000)] 
Protocol v5 is only supported in 4.0+ (#116)

Follow up to CASSANDRA-15299

Patch by Sam Tunnicliffe; reviewed by Marcus Eriksson

18 months agoFix `--keep-failed-test-dir` on skipped dtests
Mick Semb Wever [Thu, 21 Jan 2021 13:58:53 +0000 (14:58 +0100)] 
Fix `--keep-failed-test-dir` on skipped dtests

 patch by Mick Semb Wever; reviewed by Tomek Lasica for CASSANDRA-16397

18 months agoExplicit node start timeouts
Tomek Lasica [Mon, 18 Jan 2021 19:47:09 +0000 (20:47 +0100)] 
Explicit node start timeouts

Some tests require longer start timeout than default 90s:
* bootstrap with reset state
* node replacement
* cdc tests (due to checks for other seeds connectivity)

Before: use default timeout, 90s or rather 600s (due to bug in ccm)
After: use explicit timeout per test case: 120s or 180s

 patch by Tomek Lasica; reviewed by Mick Semb Wever for CASSANDRA-16395

19 months agoAdd empty text values to cqlsh copy test
Aleksandr Sorokoumov [Sat, 9 Jan 2021 15:52:30 +0000 (16:52 +0100)] 
Add empty text values to cqlsh copy test

Patch by Aleksandr Sorokoumov, reviewed by brandonwilliams for
CASSANDRA-16372

19 months agofix version checking for 4.0+ conditionals
Adam Holmberg [Wed, 23 Dec 2020 18:31:31 +0000 (12:31 -0600)] 
fix version checking for 4.0+ conditionals

patch by Adam Holmberg; reviewed by Benjamin Lerer, David Capwell for CASSANDRA-16330

19 months agostart rolling clusters with protocol capping overridden
Adam Holmberg [Tue, 5 Jan 2021 20:31:07 +0000 (14:31 -0600)] 
start rolling clusters with protocol capping overridden

patch by Adam Holmberg; reviewed by David Capwell for CASSANDRA-16347

19 months agooverride overly strict max protocol in 3.0 upgrade test
Adam Holmberg [Tue, 22 Dec 2020 16:07:17 +0000 (10:07 -0600)] 
override overly strict max protocol in 3.0 upgrade test

patch by Adam Holmberg; reviewed by David Capwell, Sam Tunnicliffe for CASSANDRA-16354

19 months agopytest is not meant to run internal parameterized test method
Adam Holmberg [Tue, 5 Jan 2021 22:24:08 +0000 (16:24 -0600)] 
pytest is not meant to run internal parameterized test method

patch by Adam Holmberg; reviewed by David Capwell for CASSANDRA-16331

19 months agoFix upgrade python dtest test_static_columns_with_2i - upgrade_tests.cql_tests.TestCQ...
Adam Holmberg [Fri, 18 Dec 2020 22:37:18 +0000 (14:37 -0800)] 
Fix upgrade python dtest test_static_columns_with_2i - upgrade_tests.cql_tests.TestCQLNodes

patch by Adam Holmberg; reviewed by Caleb Rackliffe, David Capwell for CASSANDRA-16332

19 months agoFix upgrade python dtest test_static_columns_with_2i - upgrade_tests.cql_tests.TestCQ...
Adam Holmberg [Fri, 18 Dec 2020 22:37:18 +0000 (14:37 -0800)] 
Fix upgrade python dtest test_static_columns_with_2i - upgrade_tests.cql_tests.TestCQLNodes

patch by Adam Holmberg; reviewed by Caleb Rackliffe, David Capwell for CASSANDRA-16332

20 months agoUse the token allocation strategy generator tool for 4.0 vnode clusters, from CASSAND...
Mick Semb Wever [Sun, 15 Nov 2020 16:14:15 +0000 (17:14 +0100)] 
Use the token allocation strategy generator tool for 4.0 vnode clusters, from CASSANDRA-16205

 patch by Mick Semb Wever; reviewed by Adam Holmberg, Paulo Motta for CASSANDRA-16079

20 months agoFix upgrade python dtest test_crc_check_chance_upgrade - upgrade_crc_check_chance_tes...
Aleksandr Sorokoumov [Tue, 15 Dec 2020 17:37:12 +0000 (18:37 +0100)] 
Fix upgrade python dtest test_crc_check_chance_upgrade - upgrade_crc_check_chance_test.TestCrcCheckChanceUpgrade

patch by Aleksandr Sorokoumov; reviewed by David Capwell for CASSANDRA-16346

20 months agopython upgrade tests include tests which are not impacted by the version under test...
dcapwell [Mon, 14 Dec 2020 18:20:54 +0000 (10:20 -0800)] 
python upgrade tests include tests which are not impacted by the version under test (#106)

patch by David Capwell, Michael Semb Wever; reviewed by Marcus Eriksson, Michael Semb Wever  for CASSANDRA-16328

20 months agoMerge pull request #104 from ifesdjeen/CASSANDRA-16217-followup
Alex Petrov [Tue, 8 Dec 2020 07:25:15 +0000 (08:25 +0100)] 
Merge pull request #104 from ifesdjeen/CASSANDRA-16217-followup

Follow-up: remove tests deprecated by CASSANDRA-16217

20 months agoChange expected response when role data is corrupt
Sam Tunnicliffe [Fri, 13 Nov 2020 17:36:22 +0000 (17:36 +0000)] 
Change expected response when role data is corrupt

Patch by Sam Tunnicliffe; reviewed by Adam Holmberg for CASSANDRA-16275

20 months agoninja-fix: in boot_strap.py TestBootstrap::_monitor_datadir, variable sstables needs...
Mick Semb Wever [Wed, 25 Nov 2020 19:58:23 +0000 (20:58 +0100)] 
ninja-fix: in boot_strap.py TestBootstrap::_monitor_datadir, variable sstables needs to be defined first (CASSANDRA-15997)

20 months agoFollow-up: remove tests deprecated by CASSANDRA-16217 104/head
Alex Petrov [Fri, 20 Nov 2020 15:21:43 +0000 (16:21 +0100)] 
Follow-up: remove tests deprecated by CASSANDRA-16217

Patch by Alex Petrov; reviewed by Ekaterina Dimitrova for CASSANDRA-16217

20 months agoExplicitly define num_tokens=1 when not using vnodes
Brandon Williams [Tue, 17 Nov 2020 23:33:13 +0000 (17:33 -0600)] 
Explicitly define num_tokens=1 when not using vnodes

21 months agoAdd tests to cover ClientRequest metrics
Adam Holmberg [Wed, 11 Nov 2020 11:46:56 +0000 (11:46 +0000)] 
Add tests to cover ClientRequest metrics

patch by Adam Holmberg; reviewed by Andrés de la Peña for CASSANDRA-16183

21 months agoCASSANDRA-15158 give node a bit more time to come up
Blake Eggleston [Fri, 9 Oct 2020 17:12:01 +0000 (10:12 -0700)] 
CASSANDRA-15158 give node a bit more time to come up

21 months agoFix test_pending_range
Ekaterina Dimitrova [Thu, 22 Oct 2020 22:23:38 +0000 (18:23 -0400)] 
Fix test_pending_range

Patch by Ekaterina Dimitrova, reviewed by Berenguer Blasi and
brandonwilliams for CASSANDRA-16220

21 months agoRename master branch to trunk in cassandra-dtest
Mick Semb Wever [Sun, 25 Oct 2020 12:00:08 +0000 (13:00 +0100)] 
Rename master branch to trunk in cassandra-dtest

 patch by Mick Semb Wever; reviewed by Brandon Williams for CASSANDRA-16166

21 months agoSet max window correctly.
Bereng [Thu, 15 Oct 2020 07:53:40 +0000 (09:53 +0200)] 
Set max window correctly.

Patch by Berenguer Blasi, reviwewed by brandonwilliams for
ASSANDRA-15865

21 months agoWhen running python dtest and using JAVA_TOOL_OPTIONS to inject cassandra configurati...
David Capwell [Wed, 21 Oct 2020 19:46:26 +0000 (12:46 -0700)] 
When running python dtest and using JAVA_TOOL_OPTIONS to inject cassandra configurations, tests fail as they don't expect this flag in stderr

patch by David Capwell; reviewed by Jordan West for CASSANDRA-16219

21 months agoRevert "Revert "Add test_truncate_failure""
Brandon Williams [Wed, 21 Oct 2020 14:12:37 +0000 (09:12 -0500)] 
Revert "Revert "Add test_truncate_failure""

This restores test_truncate_failure.
This reverts commit 016a0eb38db25ab36e1adabbc0bfe9575212b2ec.

21 months agoSkip read repair tests ported to in-JMV
Andrés de la Peña [Mon, 19 Oct 2020 14:42:08 +0000 (15:42 +0100)] 
Skip read repair tests ported to in-JMV

patch by Andrés de la Peña; reviewed by Caleb Rackliffe and Benjamin Lerer for CASSANDRA-15977

22 months agoRevert "Add test_truncate_failure"
Brandon Williams [Thu, 15 Oct 2020 16:46:48 +0000 (11:46 -0500)] 
Revert "Add test_truncate_failure"

This reverts commit 8cb6bd23e62c4d3b4e208d3909361d6812182bc6.

22 months agoAdd test_truncate_failure
Ekaterina Dimitrova [Thu, 8 Oct 2020 13:23:00 +0000 (09:23 -0400)] 
Add test_truncate_failure

Patch by Ekaterina Dimitrova, reviewed by brandonwilliams for
CASSANDRA-16208

22 months agoFix file size calculations racing with async file deletions
Adam Holmberg [Tue, 13 Oct 2020 14:28:47 +0000 (09:28 -0500)] 
Fix file size calculations racing with async file deletions

Patch by Adam Holmberg, reviewed by brandonwilliams for CASSANDRA-16196

22 months agoUpdate compact storage related tests
Ekaterina Dimitrova [Tue, 13 Oct 2020 15:42:17 +0000 (16:42 +0100)] 
Update compact storage related tests

patch by Ekaterina Dimitrova; reviewed by Andrés de la Peña and Sylvain Lebresne for CASSANDRA-16063