Task queue unblock (#12099)
authorJason Koch <jkoch@netflix.com>
Sat, 14 May 2022 23:44:29 +0000 (16:44 -0700)
committerGitHub <noreply@github.com>
Sat, 14 May 2022 23:44:29 +0000 (16:44 -0700)
commitbb1a6def9dee55528907999e99ecf1b6c0c5f741
tree76416207a9cf1d92a64c7a5d421cb5af3cc82327
parent7ab21708021cb534ad34608b3fb06cb0273c2cd2
Task queue unblock (#12099)

* concurrency: introduce GuardedBy to TaskQueue

* perf: Introduce TaskQueueScaleTest to test performance of TaskQueue with large task counts

This introduces a test case to confirm how long it will take to launch and manage (aka shutdown)
a large number of threads in the TaskQueue.

h/t to @gianm for main implementation.

* perf: improve scalability of TaskQueue with large task counts

* linter fixes, expand test coverage

* pr feedback suggestion; swap to different linter

* swap to use SuppressWarnings

* Fix TaskQueueScaleTest.

Co-authored-by: Gian Merlino <gian@imply.io>
indexing-service/src/main/java/org/apache/druid/indexing/overlord/TaskQueue.java
indexing-service/src/test/java/org/apache/druid/indexing/overlord/TaskQueueScaleTest.java [new file with mode: 0644]