Add a new flag for ingestion to preserve existing metrics (#12185)
authorMaytas Monsereenusorn <maytasm@apache.org>
Fri, 8 Apr 2022 18:02:02 +0000 (11:02 -0700)
committerGitHub <noreply@github.com>
Fri, 8 Apr 2022 18:02:02 +0000 (11:02 -0700)
commit8edea5a82dfdb34c3177c0efd7a79bae54751ab8
tree628a4bc08841f230e51b2c219722c838f0ad0207
parentbf96ddf5bac50e5e9ae778eb28ee300fea6fc62f
Add a new flag for ingestion to preserve existing metrics (#12185)

* add impl

* add impl

* fix checkstyle

* add impl

* add unit test

* fix stuff

* fix stuff

* fix stuff

* add unit test

* add more unit tests

* add more unit tests

* add IT

* add IT

* add IT

* add IT

* add ITs

* address comments

* fix test

* fix test

* fix test

* address comments

* address comments

* address comments

* fix conflict

* fix checkstyle

* address comments

* fix test

* fix checkstyle

* fix test

* fix test

* fix IT
26 files changed:
core/src/main/java/org/apache/druid/data/input/InputRowSchema.java
indexing-service/src/main/java/org/apache/druid/indexing/input/DruidInputSource.java
indexing-service/src/main/java/org/apache/druid/indexing/input/InputRowSchemas.java
indexing-service/src/test/java/org/apache/druid/indexing/common/task/ClientCompactionTaskQuerySerdeTest.java
indexing-service/src/test/java/org/apache/druid/indexing/input/DruidInputSourceTest.java
indexing-service/src/test/java/org/apache/druid/indexing/input/InputRowSchemasTest.java
integration-tests/pom.xml
integration-tests/src/main/java/org/apache/druid/testing/utils/CompactionUtil.java
integration-tests/src/test/java/org/apache/druid/tests/coordinator/duty/ITAutoCompactionTest.java
integration-tests/src/test/java/org/apache/druid/tests/coordinator/duty/ITAutoCompactionUpgradeTest.java
integration-tests/src/test/resources/indexer/wikipedia_index_no_rollup_preserve_metric.json [new file with mode: 0644]
integration-tests/src/test/resources/indexer/wikipedia_index_rollup_preserve_metric.json [new file with mode: 0644]
integration-tests/src/test/resources/indexer/wikipedia_index_sketch_queries.json [new file with mode: 0644]
processing/src/main/java/org/apache/druid/segment/incremental/AppendableIndexBuilder.java
processing/src/main/java/org/apache/druid/segment/incremental/IncrementalIndex.java
processing/src/main/java/org/apache/druid/segment/incremental/OnheapIncrementalIndex.java
processing/src/test/java/org/apache/druid/segment/data/IncrementalIndexTest.java
processing/src/test/java/org/apache/druid/segment/incremental/IncrementalIndexAdapterTest.java
processing/src/test/java/org/apache/druid/segment/incremental/OnheapIncrementalIndexBenchmark.java
server/src/main/java/org/apache/druid/client/indexing/ClientCompactionTaskQueryTuningConfig.java
server/src/main/java/org/apache/druid/server/coordinator/UserCompactionTaskQueryTuningConfig.java
server/src/test/java/org/apache/druid/server/coordinator/DataSourceCompactionConfigTest.java
server/src/test/java/org/apache/druid/server/coordinator/UserCompactionTaskQueryTuningConfigTest.java
server/src/test/java/org/apache/druid/server/coordinator/duty/CompactSegmentsTest.java
server/src/test/java/org/apache/druid/server/coordinator/duty/NewestSegmentFirstIteratorTest.java
server/src/test/java/org/apache/druid/server/coordinator/duty/NewestSegmentFirstPolicyTest.java