drill.git
7 weeks ago[maven-release-plugin] prepare release drill-1.20.1 drill-1.20.1
James Turton [Mon, 16 May 2022 08:46:30 +0000 (10:46 +0200)] 
[maven-release-plugin] prepare release drill-1.20.1

7 weeks agoDRILL-8200: Update Hadoop libs to ≥ 3.2.3 for CVE-2022-26612 (set hadoop.version)
James Turton [Mon, 16 May 2022 08:26:49 +0000 (10:26 +0200)] 
DRILL-8200: Update Hadoop libs to ≥ 3.2.3 for CVE-2022-26612 (set hadoop.version)

8 weeks agoDRILL-8221: Collect bug fixes from master for Drill 1.20.1 (#2545)
James Turton [Thu, 12 May 2022 04:54:57 +0000 (06:54 +0200)] 
DRILL-8221: Collect bug fixes from master for Drill 1.20.1 (#2545)

* Prepare for the next bugfix iteration.

* SAS Reader fixes (#2472)

Co-authored-by: pseudomo <pseudomo@yandex.ru>
* Add jackson-bom (#2454)

* [DRILL-8150] log4j 2.17.2 in format-excel (#2476)

* DRILL-8151: Add support for more ElasticSearch and Cassandra data types (#2477)

* DRILL-8154: Upgrade to poi 5.2.1 (#2480)

* DRILL-8145: Fix flaky TestDrillbitResilience#memoryLeaksWhenCancelled test case (#2471)

* Set Brotli codec jar and test to occur only on Linux amd64.

* DRILL-8145: Fix flaky TestDrillbitResilience#memoryLeaksWhenCancelled test case

- changing timeout for TestDrillbitResilience tests
- timing tuning for memoryLeaksWhenCancelled
- update TestContainers version
- -DforkCount=1 for Travis Maven build
- directMemoryMb: 2500 -> 4500 leads to less occasinal test failures

Co-authored-by: James Turton <james@somecomputer.xyz>
* [MINOR UPDATE] Add Stalebot Config (#2487)

* [MINOR UPDATE] Fix license for Stalebot Config (#2488)

* DRILL-8156: Declare and chown a /data VOLUME in the Drill Dockerfile (#2491)

* Add a mountpoint and VOLUME for local storage to Dockerfile.

* Address review comments concerning layer ordering.

* Fix image size blowup by moving chmod to intermediate container.

* Combine RUN commands in Dockerfile.

* DRILL-8168: Do not duplicate attempts to impersonate a user in the REST API (#2495)

* DRILL-8172: Use the specified memory usage for Travis CI (#2500)

* DRILL-8165: Upgrade liquibase because of CVE-2022-0839 (#2497)

* Create codeql-analysis.yml

* Update codeql-analysis.yml

Removed cpp from code analysis

* [MINOR UPDATE] Add license to CodeQL YAML (#2501)

* DRILL-8176: Upgrade Jackson Due to CVE-2020-36518 (#2504)

* DRILL-8164: Upgrade metadata-extractor because of CVE-2022-24613 (#2493)

* DRILL-8164: Upgrade metadata-extractor because of CVE-2022-24613

* Update the ProfileCopyright tag name

* Update the mov format name

* Add the QuickTime.Rotation tag

* Bump metadata-extractor to 2.17.0

* DRILL-8178: Bump AWS Libraries to Latest Version (#2506)

* DRILL-8175: Update Drill release script after 1.20 (#2503)

* Set DRILL_PID_DIR in Dockerfile to writable location for distributed mode.

Some users of the images built from this Dockerfile customise
them so that they launch Drill in distributed mode instead of
embedded mode.  This change saves them from having to set
DRILL_PID_DIR themselves in order to succeed.

* Update release script and instructions after the release of 1.20.

- Add support for specifying a build profile such as "hadoop-2".
- Update instuctions for the Drill web site.
- Update instructions for uploading RCs (no more home.apache)
- Some fixes.

* DRILL-8176: minor issue in previous jackson bom (#2508)

* minor issue in previous jackson bom

* Update pom.xml

* DRILL-8187: Dialect factory returns ANSI SQL dialect for BigQuery (#2513)

* DRILL-8192: Cassandra queries fail when enabled Mongo plugin (#2518)

* DRILL-8013: Drill attempts to push "$SUM0" to JDBC storage plugin for AVG (#2521)

* DRILL-8194: Fix the function of REPLACE throws IndexOutOfBoundsException If text's length is more than previously applied (#2522)

* DRILL-8200: Update Hadoop libs to ≥ 3.2.3 for CVE-2022-26612 (#2525)

* Remove pointless Buffer casts.

Compiling Drill with JDK > 8 will still result in ByteBuffer <-> Buffer cast
exceptions at runtime when running on JDK 8 even though maven.target.version
is set to 8. Setting maven.compiler.release to 8 solves the Buffer casts
but raises a compilation error of package sun.security.jgss does not exist
for JDK 8. There were a few handwritten casts to avoid the Buffer casting
issue but many instances are not covered so the few reverted in this commit
achieve nothing.

* Update Hadoop to 3.2.3.

* [MINOR UPDATE] Update AWS Java SDK to 1.12.211

* DRILL-8219: Handle null catalog names returned by DB2 in storage-jdbc. (#2542)

Co-authored-by: pseudomo <yura_levchenko@mail.ru>
Co-authored-by: pseudomo <pseudomo@yandex.ru>
Co-authored-by: Rymar Maksym <rim.maxim+dev@gmail.com>
Co-authored-by: PJ Fanning <pjfanning@users.noreply.github.com>
Co-authored-by: Volodymyr Vysotskyi <vvovyk@gmail.com>
Co-authored-by: Vitalii Diravka <vitalii@apache.org>
Co-authored-by: Charles S. Givre <cgivre@apache.org>
Co-authored-by: luoc <luoc@apache.org>
Co-authored-by: xurenhe <xurenhe19910131@gmail.com>
4 months ago[maven-release-plugin] prepare release drill-1.20.0 drill-1.20.0
James Turton [Tue, 22 Feb 2022 17:56:14 +0000 (19:56 +0200)] 
[maven-release-plugin] prepare release drill-1.20.0

4 months agoDRILL-8144: Cannot launch Drill 1.20 RC 4 on Windows (#2470)
James Turton [Tue, 22 Feb 2022 17:33:51 +0000 (19:33 +0200)] 
DRILL-8144: Cannot launch Drill 1.20 RC 4 on Windows (#2470)

4 months agoDRILL-8143: Error querying json with $date field (#2469)
Anton Gozhiy [Mon, 21 Feb 2022 14:07:38 +0000 (16:07 +0200)] 
DRILL-8143: Error querying json with $date field (#2469)

4 months ago DRILL-8142: SAS Reader Returns NPE #2468
Charles S. Givre [Sun, 20 Feb 2022 05:35:25 +0000 (00:35 -0500)] 
 DRILL-8142: SAS Reader Returns NPE #2468

4 months agoDRILL-8139: Parquet CodecFactory thread safety bug (#2463)
James Turton [Thu, 17 Feb 2022 17:02:20 +0000 (19:02 +0200)] 
DRILL-8139: Parquet CodecFactory thread safety bug  (#2463)

4 months agoDRILL-8134: Cannot query Parquet INT96 columns as timestamps (#2460)
James Turton [Thu, 17 Feb 2022 15:32:27 +0000 (17:32 +0200)] 
DRILL-8134: Cannot query Parquet INT96 columns as timestamps (#2460)

* Scale writer index stride to cater for 96-to-64-bit downcasting.

* Remove advanceWriterIndex methods entirely.

* Bump postgresql in storage-jdbc for dependabot alert.

* Fix config opt setting bug in TestParquetWriter.

4 months agoDRILL-8122: Change kafka metadata obtaining due to KAFKA-5697 (#2456)
Rymar Maksym [Wed, 16 Feb 2022 06:33:29 +0000 (08:33 +0200)] 
DRILL-8122: Change kafka metadata obtaining due to KAFKA-5697 (#2456)

4 months agoDRILL-8137: Prevent reading union inputs after cancellation request (#2462)
Volodymyr Vysotskyi [Wed, 16 Feb 2022 06:32:16 +0000 (08:32 +0200)] 
DRILL-8137: Prevent reading union inputs after cancellation request (#2462)

4 months agoDRILL-8131: Infinite planning when JDBC or Phoenix plugin is enabled (#2459)
Volodymyr Vysotskyi [Sun, 13 Feb 2022 06:11:49 +0000 (08:11 +0200)] 
DRILL-8131: Infinite planning when JDBC or Phoenix plugin is enabled (#2459)

4 months agoDRILL-8130: Upgrade Hadoop 2 to 2.10.1 because of CVE-2020-9492 (#2458)
James Turton [Fri, 11 Feb 2022 08:12:01 +0000 (10:12 +0200)] 
DRILL-8130: Upgrade Hadoop 2 to 2.10.1 because of CVE-2020-9492 (#2458)

* Upgrade Hadoop 2 to 2.10.1 because of CVE-2020-9492.

* Update JDBC jar size limit for Hadoop 2.10.1.

4 months agoDRILL-8129: Storage-phoenix cannot resolve OSGi bundle apache-ds.jdbm1 (#2457)
James Turton [Thu, 10 Feb 2022 04:21:13 +0000 (06:21 +0200)] 
DRILL-8129: Storage-phoenix cannot resolve OSGi bundle apache-ds.jdbm1 (#2457)

* Add maven-bundle-plugin to storage-phoenix pom for -Phadoop-2.

Also correct the jdbc-all jar size limits, esp. hadoop-2 profile.

* Move storage-phoenix maven-bundle-plugin into hadoop-2 profile.

4 months ago DRILL-8126: Ignore OAuth Parameter in Storage Plugin
Charles S. Givre [Tue, 8 Feb 2022 07:41:35 +0000 (02:41 -0500)] 
 DRILL-8126: Ignore OAuth Parameter in Storage Plugin

5 months agoSet failOnNoFiles = false so that checksum-maven-plugin works on tools-parent.
James Turton [Fri, 4 Feb 2022 14:27:41 +0000 (16:27 +0200)] 
Set failOnNoFiles = false so that checksum-maven-plugin works on tools-parent.

5 months agoRevert .travis.yml to 80fa2662.
James Turton [Thu, 3 Feb 2022 12:02:25 +0000 (14:02 +0200)] 
Revert .travis.yml to 80fa2662.

5 months agoFix line continuations in .travis.yml and update NOTICE.
James Turton [Thu, 3 Feb 2022 10:35:30 +0000 (12:35 +0200)] 
Fix line continuations in .travis.yml and update NOTICE.

5 months agoDRILL-8124: Fix implicit file issue with EVF 2 (#2451)
Paul Rogers [Thu, 3 Feb 2022 12:52:27 +0000 (04:52 -0800)] 
DRILL-8124: Fix implicit file issue with EVF 2 (#2451)

5 months agoDRILL-8123: Revise scan limit pushdown (#2450)
Paul Rogers [Thu, 3 Feb 2022 12:51:10 +0000 (04:51 -0800)] 
DRILL-8123: Revise scan limit pushdown (#2450)

5 months agoAdd James Turton's PGP key.
James Turton [Thu, 3 Feb 2022 08:15:25 +0000 (10:15 +0200)] 
Add James Turton's PGP key.

5 months agoDRILL-7994: Dependency version updates for severe vulnerabilities
James Turton [Wed, 2 Feb 2022 15:56:55 +0000 (17:56 +0200)] 
DRILL-7994: Dependency version updates for severe vulnerabilities

Postgresql: 42.3.1 -> 42.3.2.

5 months agoDRILL-7994: Dependency version updates for severe vulnerabilities (#2447)
James Turton [Wed, 2 Feb 2022 14:05:18 +0000 (16:05 +0200)] 
DRILL-7994: Dependency version updates for severe vulnerabilities (#2447)

* Updates deps for dependabot.

* Remove jetty version spec from storage-phoenix pom.

* Revert parallel GC setting.

5 months agoDRILL-8109: Hive storage plugin support reading parquet timestamp type with int64...
Thinking Chen [Wed, 2 Feb 2022 09:34:47 +0000 (17:34 +0800)] 
DRILL-8109: Hive storage plugin support reading parquet timestamp type with int64 logical type (#2431)

5 months agoDRILL-7994: Dependency version updates for severe vulnerabilities (#2432)
James Turton [Wed, 2 Feb 2022 09:18:22 +0000 (11:18 +0200)] 
DRILL-7994: Dependency version updates for severe vulnerabilities (#2432)

* Sev 8+ vuln dep updates.

* Adjust netty-tcnative version for windows-x86_64.

* Bump Avro because of severe Velocity vulns.

* Adjust expected row count to accommodate t-digest 3.3 improvements.

"The meaning of the compression parameter became a bit more strict in this
latest version. As such, the digest should be a bit smaller and tails
should be a bit more accurate." -- Ted Dunning

* Code comment whitespace formatting.

* Remove cruft from jdbc-all jar.

* Return needed Netty jars to jdbc-all.

* Adjust unit test memory allocs for TestAggregateFunctions.

* Remove references to unused artifact jersey-guava.

* Netty to 2.0.48.

* +200MiB direct memory for the unit test run.

* Upgrade jetty-server and h2 for dependabot.

* Fixes for H2 lib upgrade.

* Work around DOUBLE type DDL syntax error for pg dialect.

* Increase CI heap mem allocation for the sake of JDK 8.

* Specify parallel GC for CI to try to minimise peak mem usage.

* Cast Netty ByteBuffer to Buffer for JDK 8 compat.

* Increase CI heap mem allocation for the sake of TestAggregateFunctions.

5 months agoDRILL-8111: Remove lombok usage (#2433)
Volodymyr Vysotskyi [Wed, 2 Feb 2022 01:22:54 +0000 (03:22 +0200)] 
DRILL-8111: Remove lombok usage (#2433)

5 months agoDRILL-8115: Adds LIMIT pushdown support in the scan framework (#2441)
Paul Rogers [Tue, 1 Feb 2022 09:54:24 +0000 (01:54 -0800)] 
DRILL-8115: Adds LIMIT pushdown support in the scan framework (#2441)

* Adds LIMIT pushdown support in the scan framework

Modifies EVF and the scan framework to enforce LIMIT
pushdown across readers.

* Fix build issues

* Fixes from review comments

5 months agoDRILL-8056: Add OAuth2 Support for HTTP Rest Plugin (#2401)
Charles S. Givre [Mon, 31 Jan 2022 21:48:42 +0000 (16:48 -0500)] 
DRILL-8056: Add OAuth2 Support for HTTP Rest Plugin (#2401)

* DRILL-8056: Add OAuth2 Support for HTTP Rest Plugin

* Fixed one unit test and removed code from other branch

* Fix UT

* WIP

* Moving to Cred provider

* WIP

* UT working with Cred provider

* Successfully optained tokens

* Ready for review

* Fixed Checkstyle

* Code cleanup

* Updated docs and minor code cleanup

* Moved okhttp3 to test scope

* Fixed pom... again

* Pom fixes

* Added redirect URI to access token request

* Added token type to config

* Doc update

* Updated docs and addressed review comments

* Initial work with persistent store

* 2/3 Unit tests passing

* All unit tests passing

* Code cleanup

* Passing manual tests with Clickup and Salesforce

* Final revisions

* Fix resource leak

* Added Success FTL

* Fix resource leak

* UTs passing

* Addressed Review Comments

* Removed unused import

5 months agoDRILL-8118: Add Option to Allow Disk Use on Mongo Queries
Charles S. Givre [Mon, 31 Jan 2022 05:30:34 +0000 (00:30 -0500)] 
DRILL-8118: Add Option to Allow Disk Use on Mongo Queries

5 months agoDRILL-8116: Upgrade Apache Xerces because of CVE-2022-23437 (#2443)
kingswanwho [Sun, 30 Jan 2022 17:03:46 +0000 (01:03 +0800)] 
DRILL-8116: Upgrade Apache Xerces because of CVE-2022-23437 (#2443)

Co-authored-by: kingswanwho <jingchuanhu2017@u.northwestern.edu>
5 months agoDRILL-8118: Add Option to Allow Disk Use on Mongo Queries (#2442)
Charles S. Givre [Sun, 30 Jan 2022 11:26:39 +0000 (06:26 -0500)] 
DRILL-8118: Add Option to Allow Disk Use on Mongo Queries (#2442)

* Initial commit

* Update contrib/storage-mongo/src/main/java/org/apache/drill/exec/store/mongo/MongoRecordReader.java

Co-authored-by: luoc <luoc@apache.org>
Co-authored-by: luoc <luoc@apache.org>
5 months agoDRILL-8061: Add Impersonation Support for Phoenix (#2422)
Vitalii Diravka [Sat, 29 Jan 2022 02:36:42 +0000 (04:36 +0200)] 
DRILL-8061: Add Impersonation Support for Phoenix (#2422)

5 months agoDRILL-8114: Prevent applying Iceberg project on non-Iceberg tables (#2436)
Volodymyr Vysotskyi [Thu, 27 Jan 2022 09:38:39 +0000 (11:38 +0200)] 
DRILL-8114: Prevent applying Iceberg project on non-Iceberg tables (#2436)

* DRILL-8114: Prevent applying Iceberg project on non-Iceberg tables

* DRILL-8114: Change after code review

5 months ago[MINOR UPDATE] Remove bogus copy pasta test of log dir env var. (#2434)
James Turton [Wed, 26 Jan 2022 15:27:50 +0000 (17:27 +0200)] 
[MINOR UPDATE] Remove bogus copy pasta test of log dir env var. (#2434)

The removed test is a copy pasta of the log dir test so does not test
the native lib dir variables it claims to at all.  There is a legitimate
test of the native lib dir env vars present in the same test class.

5 months agoDRILL-8112: Excel Reader Ignores HeaderRow Config Param
Charles S. Givre [Wed, 26 Jan 2022 07:22:47 +0000 (02:22 -0500)] 
DRILL-8112: Excel Reader Ignores HeaderRow Config Param

5 months agoDRILL-8092: Add Auto Pagination to HTTP Storage Plugin (#2424)
James Turton [Wed, 19 Jan 2022 10:32:38 +0000 (12:32 +0200)] 
DRILL-8092: Add Auto Pagination to HTTP Storage Plugin (#2424)

* Simplify Pagintor classes.

* Correct Javadoc on JsonLoader#readBatch().

5 months agoDRILL-8023: Empty dict page breaks the "old" Parquet reader (#2430)
James Turton [Wed, 19 Jan 2022 10:05:52 +0000 (12:05 +0200)] 
DRILL-8023: Empty dict page breaks the "old" Parquet reader (#2430)

* Fix empty dict page handling in "old" Parquet reader.

* Move empty_dict_page.parquet to a dir that doesn't break other tests.

* Fix pageData null check after nextInternal loop in PageReader.

5 months agoDRILL-8057: INFORMATION_SCHEMA filter push down is inefficient (#2388)
James Turton [Wed, 19 Jan 2022 06:34:25 +0000 (08:34 +0200)] 
DRILL-8057: INFORMATION_SCHEMA filter push down is inefficient (#2388)

* Add schema search tree pruning capability to InfoSchema.

* Fix checkstyle, address review comments.

* WIP.

* WIP.

* Address review comments.

* Clean up and add a unit test of lazy schema registration.

* Remove call to registerSchemas() in PlanningBase.

5 months agoDRILL-8107: Hadoop2 backport Maven profile (#2429)
Vitalii Diravka [Wed, 19 Jan 2022 06:31:00 +0000 (08:31 +0200)] 
DRILL-8107: Hadoop2 backport Maven profile (#2429)

* DRILL-8107: Hadoop2 backport Maven profile

- Increase jdbc-all jar file size for hadoop-2 profile
- Patch Guava Futures addCallback

* Changes after review

5 months agoDRILL-8094: Support reverse truncation for split_part udf (#2416)
leon [Mon, 17 Jan 2022 15:57:35 +0000 (23:57 +0800)] 
DRILL-8094: Support reverse truncation for split_part udf (#2416)

* DRILL-8094: Support reverse truncation for split_part udf

* fix ut

Co-authored-by: feiteng.wtf <feiteng.wtf@cainiao.com>
5 months agoDRILL-8108: Excel Reader Fails with Duplicate Columns (#2428)
Charles S. Givre [Sun, 16 Jan 2022 12:53:20 +0000 (07:53 -0500)] 
DRILL-8108: Excel Reader Fails with Duplicate Columns (#2428)

* DRILL-8108 Excel Reader Fails with Duplicate Columns

* Fix for case sensitivity

* Formatting fix

* Used TreeSet

5 months agoDRILL-8095: upgrade to poi 5.2.0 (#2427)
PJ Fanning [Sat, 15 Jan 2022 23:10:32 +0000 (00:10 +0100)] 
DRILL-8095: upgrade to poi 5.2.0 (#2427)

* upgrade to poi 5.2.0 and ignore cell styles (to avoid unnecessary parse time)

* need to parse styles

5 months agoDRILL-8104: Upgrade protobuf-java because of CVE-2021-22569 (#2425)
kingswanwho [Fri, 14 Jan 2022 17:00:57 +0000 (01:00 +0800)] 
DRILL-8104: Upgrade protobuf-java because of CVE-2021-22569 (#2425)

5 months agoDRILL-8106: do not use cellIterator because it skips empty cells (#2426)
PJ Fanning [Thu, 13 Jan 2022 20:10:00 +0000 (21:10 +0100)] 
DRILL-8106: do not use cellIterator because it skips empty cells (#2426)

* [DRILL-8106] do not use cellIterator because it skips empty cells

* Update ExcelBatchReader.java

* Update ExcelBatchReader.java

* Update ExcelBatchReader.java

* Update ExcelBatchReader.java

* Create missing_data.xlsx

* Update TestExcelFormat.java

* Update TestExcelFormat.java

5 months agoDRILL-8028: Add PDF Format Plugin (#2359)
Charles S. Givre [Sun, 9 Jan 2022 03:33:37 +0000 (22:33 -0500)] 
DRILL-8028: Add PDF Format Plugin (#2359)

* Initial commit

* WIP

* Regular queries working

* Metadata fields working

* Minor fixes

* Fixed unit test

* Added additional closing functions.

* WIP

* Fixed Headless Issue

* Updated to Drill 1.20

* Added option to merge pages

* Ready for PR

* Removed struts

* WIP

* Progress..

* UTs all passing

* Fix Duplicate Page Issue

* Fixed extract headers

* Refactored Tables and Added Metadata class

* Added UT

* Code cleanup

* New UTs

* Added UTs

* Added UT and removed extra test files

* Removed comment

* Removed comment

* Bump pdfbox to latest version

* Moved Java config to drill-config.sh

5 months agoDRILL-8089: Separate the setup time for some operators(#2413)
feiteng.wtf [Tue, 21 Dec 2021 07:47:51 +0000 (15:47 +0800)] 
DRILL-8089: Separate the setup time for some operators(#2413)

5 months agoDRILL-8092: Add Auto Pagination to HTTP Storage Plugin (#2414)
Charles S. Givre [Thu, 6 Jan 2022 20:06:14 +0000 (15:06 -0500)] 
DRILL-8092: Add Auto Pagination to HTTP Storage Plugin (#2414)

6 months agoDRILL-8090: LIMIT clause is pushed down to an invalid OFFSET-FETCH clause for MS...
Volodymyr Vysotskyi [Mon, 3 Jan 2022 22:34:31 +0000 (00:34 +0200)] 
DRILL-8090: LIMIT clause is pushed down to an invalid OFFSET-FETCH clause for MS SQL Server (#2420)

* DRILL-8090: LIMIT clause is pushed down to an invalid OFFSET-FETCH clause for MS SQL Server

* DRILL-8090: Changes after code review

6 months agoDRILL-8071: upgrade log4j to 2.17.1 (#2417)
PJ Fanning [Mon, 3 Jan 2022 12:58:33 +0000 (13:58 +0100)] 
DRILL-8071: upgrade log4j to 2.17.1 (#2417)

* DRILL-8071: upgrade log4j to 2.17.1

Description
Drill's format-excel has only gained log4j dependencies recently (and this is not in any Drill release yet).

Log4J have released 2.17.1 with another CVE fix. These CVEs don't affect Drill because it does not yet use log4j-core but for optics, it is better to update all log4j jars.

https://logging.apache.org/log4j/2.x/security.html

Documentation
No changes

Testing
Unit tests

* upgrade excel-streaming-reader due to cve in h2

https://www.cvedetails.com/cve/CVE-2021-23463/

6 months agoDRILL-8088: Improve expression evaluation performance (#2412)
leon [Mon, 3 Jan 2022 01:58:20 +0000 (09:58 +0800)] 
DRILL-8088: Improve expression evaluation performance (#2412)

* DRILL-8088: Improve expression evaluation performance

* fix checkstyle

6 months agoDRILL-8081: Maven Connection timed out (#2411)
luoc [Mon, 20 Dec 2021 02:19:36 +0000 (10:19 +0800)] 
DRILL-8081: Maven Connection timed out (#2411)

6 months agoDRILL-8080: Enable the describe Case-Insensitive for Phoenix (#2410)
luoc [Mon, 20 Dec 2021 02:19:23 +0000 (10:19 +0800)] 
DRILL-8080: Enable the describe Case-Insensitive for Phoenix (#2410)

6 months agoDRILL-8078: Add WEEK to Date Extract (#2407)
Charles S. Givre [Sat, 18 Dec 2021 23:03:20 +0000 (18:03 -0500)] 
DRILL-8078: Add WEEK to Date Extract (#2407)

6 months agoDRILL-8079: Upgrade logback to 1.2.9 because of CVE-2021-42550
kingswanwho [Sat, 18 Dec 2021 04:44:45 +0000 (12:44 +0800)] 
DRILL-8079: Upgrade logback to 1.2.9 because of CVE-2021-42550

6 months agoDRILL-8071: upgrade log4j to 2.17.0
PJ Fanning [Sat, 18 Dec 2021 10:47:57 +0000 (10:47 +0000)] 
DRILL-8071: upgrade log4j to 2.17.0

6 months agoDRILL-8015: Add MongoDB Metastore implementation (#2384)
feiteng [Mon, 25 Oct 2021 14:38:46 +0000 (22:38 +0800)] 
DRILL-8015: Add MongoDB Metastore implementation (#2384)

6 months agoDRILL-8074: Second upgrade of log4j (2.16 now) because of CVE-2021-44228 (#2405)
James Turton [Wed, 15 Dec 2021 15:53:02 +0000 (17:53 +0200)] 
DRILL-8074: Second upgrade of log4j (2.16 now) because of CVE-2021-44228 (#2405)

6 months agoDRILL-8076: Remove unneeded Vault token BOOT opt (#2404)
James Turton [Tue, 14 Dec 2021 17:31:42 +0000 (19:31 +0200)] 
DRILL-8076: Remove unneeded Vault token BOOT opt (#2404)

* Remove unneeded Vault token BOOT opt.

* Remove Vault token BOOT opt code from unit test class.

6 months agoDRILL-8073: Add support for persistent table and storage aliases (#2398)
Volodymyr Vysotskyi [Tue, 14 Dec 2021 14:44:24 +0000 (16:44 +0200)] 
DRILL-8073: Add support for persistent table and storage aliases (#2398)

* DRILL-8073: Add support for persistent table and storage aliases

* DRILL-8073: Changes after code review

6 months agoDRILL-8071: Use Excel cell.getLocalDateTimeCellValue (#2400)
PJ Fanning [Mon, 13 Dec 2021 14:12:25 +0000 (15:12 +0100)] 
DRILL-8071: Use Excel cell.getLocalDateTimeCellValue (#2400)

* DRILL-8071: use excel cell.getLocalDateTimeCellValue

* Update pom.xml

6 months agoDRILL-8055: Druid Plugin support for V0.20 and up (#2387)
Christian Pfarr [Sun, 12 Dec 2021 17:01:57 +0000 (18:01 +0100)] 
DRILL-8055: Druid Plugin support for V0.20 and up (#2387)

* DRILL-8055: first edits... compile and normal test works, but TestDrillQueries has problems in compose file. I need to address them first.

* DRILL-8055: removed old SelectQuery.java and SelectQueryBuilder.java

* DRILL-8055: Rewrote SelectQuery to ScanQuery

* DRILL-8055: Switched SelectQuery to ScanQuery

* DRILL-8055: removed old SelectQuery.java and SelectQueryBuilder.java

* DRILL-8055: Switched to Druid 0.22.0 and changed Query for testTwoANDdEqualsFilter... First Test positive

* DRILL-8055: Fixed 4 of 5 Druid Test Queries from TestDruidQueries.java

* DRILL-8055: All TestDruidQueries.java run successfully

* DRILL-8055: Some Code Cleanup

* DRILL-8055: Fixed license header

* DRILL-8055: Fixed automated tests

* DRILL-8055: removed unused code

* DRILL-8055: updated README.md

* DRILL-8055: Switched to BigInteger for Druid Offset

* DRILL-8055: removed commented out code

Co-authored-by: Christian Pfarr <z0ltrix@pm.me>
6 months agoDRILL-8074: Upgrade log4j because of CVE-2021-44228 (#2403)
kingswanwho [Sat, 11 Dec 2021 06:18:14 +0000 (14:18 +0800)] 
DRILL-8074: Upgrade log4j because of CVE-2021-44228 (#2403)

Co-authored-by: kingswanwho <jingchuanhu2017@u.northwestern.edu>
6 months agoDRILL-8047: Add a custom authn provider for HashiCorp Vault (#2394)
James Turton [Thu, 9 Dec 2021 22:59:32 +0000 (00:59 +0200)] 
DRILL-8047: Add a custom authn provider for HashiCorp Vault (#2394)

* Add Vault user authenticator and unit tests.

* Fix test failures.

* Enable Vault token auth method.

* Fix bug affecting token owner check.

* Add Vault token auth method unit test.

* Get token auth unit test passing.

6 months agoDRILL-7983: Add a REST API to support the get running or completed profiles (#2353)
CuteKittyhoho [Thu, 9 Dec 2021 08:55:03 +0000 (16:55 +0800)] 
DRILL-7983: Add a REST API to support the get running or completed profiles (#2353)

6 months agoDRILL-8070: format-excel assumes that rowIterator returns every row (#2399)
PJ Fanning [Thu, 9 Dec 2021 02:56:28 +0000 (03:56 +0100)] 
DRILL-8070: format-excel assumes that rowIterator returns every row (#2399)

* DRILL-8070: format-excel assumes that rowIterator returns every row

* add test

6 months agoDRILL-8069: remove use of excel sheet getLastRowNum (#2396)
PJ Fanning [Wed, 8 Dec 2021 20:28:26 +0000 (21:28 +0100)] 
DRILL-8069: remove use of excel sheet getLastRowNum (#2396)

* DRILL-8069: remove use of excel sheet getLastRowNum

* reintroduce logic to shortcut if no rows in sheet

* Update ExcelBatchReader.java

* Update ExcelBatchReader.java

* Update ExcelBatchReader.java

* upgrade excel-streaming-reader

* remove '= 0' on variable

6 months agoDRILL-8067: Localize the font for better User-experience of China mainland (#2395)
kingswanwho [Wed, 8 Dec 2021 16:19:25 +0000 (00:19 +0800)] 
DRILL-8067: Localize the font for better User-experience of China mainland (#2395)

Co-authored-by: kingswanwho <jingchuanhu2017@u.northwestern.edu>
6 months agoDRILL-8072: Fix NPE in HTTP Post Requests (#2397)
Charles S. Givre [Tue, 7 Dec 2021 19:35:49 +0000 (14:35 -0500)] 
DRILL-8072: Fix NPE in HTTP Post Requests (#2397)

* Initial commit

* Addressed Review Comments

* Added Unit Test

7 months agoDRILL-8066: Convert non-finite floating point literals to string RexLiterals (#2393)
James Turton [Mon, 6 Dec 2021 07:41:37 +0000 (09:41 +0200)] 
DRILL-8066: Convert non-finite floating point literals to string RexLiterals (#2393)

7 months agoDRILL-7863: Add Storage Plugin for Apache Phoenix
luocooong [Thu, 25 Feb 2021 02:52:14 +0000 (10:52 +0800)] 
DRILL-7863: Add Storage Plugin for Apache Phoenix

7 months agoDRILL-8064: Cannot query text files with names that contain a backslash (#2392)
James Turton [Sat, 4 Dec 2021 04:23:26 +0000 (06:23 +0200)] 
DRILL-8064: Cannot query text files with names that contain a backslash (#2392)

* Unescape root path in dfs plugin.

* Fix a spelling mistake in a comment.

7 months agoupgrade JQuery version for CVE (#2391)
kingswanwho [Wed, 1 Dec 2021 13:25:56 +0000 (21:25 +0800)] 
upgrade JQuery version for CVE (#2391)

Co-authored-by: kingswanwho <jingchuanhu2017@u.northwestern.edu>
7 months agoDRILL-8009: DrillConnectionImpl#isValid() doesn't correspond JDBC API
Maksym Rymar [Wed, 13 Oct 2021 15:45:31 +0000 (18:45 +0300)] 
DRILL-8009: DrillConnectionImpl#isValid() doesn't correspond JDBC API

7 months agoDRILL-8054: Add SAS Format Plugin (#2386)
Charles S. Givre [Wed, 24 Nov 2021 22:38:16 +0000 (17:38 -0500)] 
DRILL-8054: Add SAS Format Plugin (#2386)

* Initial commit

* Initial commit

* Added SerDe

* Dates working

* Added Implicit Fields and date unit tests

* Updated docs and added unit tests

* Exclude SAS test files from license check

* Added Time Support

* Fixed checkstyle issues

* Addressed Review Comments

* Fixed unused imports

7 months agoDRILL-8053: Reduce Docker image size (#2385)
Volodymyr Vysotskyi [Wed, 24 Nov 2021 01:07:40 +0000 (03:07 +0200)] 
DRILL-8053: Reduce Docker image size (#2385)

7 months agoDRILL-1282: Add read and write support for Parquet v2 (#2351)
James Turton [Tue, 23 Nov 2021 15:30:36 +0000 (17:30 +0200)] 
DRILL-1282: Add read and write support for Parquet v2 (#2351)

* Add an option for Parquet v2 writing.

* Finish adding Parquet v2 write support.

* Fix LGTM error inadvertently merged in #2366.

* Add parquet format config options for version and various other parameters.

* Fix persistence and application of config opts.

* Fix TestFormatPluginOptionExtractor failure.

* Add a test of parquet format config writer options.

* Fix checkstyle violations.

* Address  review comments.

* Upgrade TestParquetWriter to ClusterTest to make a home for parquet format config test.

* Change Parquet version strings to "v1", "v2".

* Convert comment containing an @link to Javadoc.

7 months agoDRILL-8050: Fix license-maven-plugin unknown file extension warnings
Volodymyr Vysotskyi [Sun, 31 Oct 2021 18:56:53 +0000 (20:56 +0200)] 
DRILL-8050: Fix license-maven-plugin unknown file extension warnings

7 months agoDRILL-8049: Make rule names for Iceberg plugin instances unique
Volodymyr Vysotskyi [Fri, 19 Nov 2021 17:05:17 +0000 (19:05 +0200)] 
DRILL-8049: Make rule names for Iceberg plugin instances unique

7 months agoDRILL-8026: Update Sqlline to 1.12 (#2379)
Volodymyr Vysotskyi [Thu, 18 Nov 2021 01:37:38 +0000 (03:37 +0200)] 
DRILL-8026: Update Sqlline to 1.12 (#2379)

7 months agoDRILL-8044: Update contrib/storage-hive copy of log4j Strings.java (#2375)
PJ Fanning [Wed, 17 Nov 2021 16:43:48 +0000 (17:43 +0100)] 
DRILL-8044: Update contrib/storage-hive copy of log4j Strings.java (#2375)

* DRILL-8044: Update contrib/storage-hive copy of log4j Strings.java

Update Strings.java

Update Strings.java

DRILL-8044: Update contrib/storage-hive copy of log4j Strings.java

Update Strings.java

Update Strings.java

* DRILL-8033: uptake POI 5.1.0

* add dependency on log4j-to-slf4j so POI logs go to slf4j

7 months agoDRILL-8046: Enabling ignored test cases for SchemaChange (#2378)
Vitalii Diravka [Tue, 16 Nov 2021 13:35:35 +0000 (15:35 +0200)] 
DRILL-8046: Enabling ignored test cases for SchemaChange (#2378)

7 months agoFix individual storage export REST API call and serverMessage error text. (#2376)
James Turton [Tue, 16 Nov 2021 13:35:14 +0000 (15:35 +0200)] 
Fix individual storage export REST API call and serverMessage error text. (#2376)

7 months agoDRILL-8034: Add support for java 17 (#2377)
Volodymyr Vysotskyi [Tue, 16 Nov 2021 13:34:55 +0000 (15:34 +0200)] 
DRILL-8034: Add support for java 17 (#2377)

* DRILL-8034: Add support for java 17

* DRILL-8034: Rename profile

7 months agoInitial Commit
Charles Givre [Sun, 14 Nov 2021 03:20:47 +0000 (22:20 -0500)] 
Initial Commit

7 months agoDRILL-8007: Fix reading time / timestamp micros and binary types (#2370)
Volodymyr Vysotskyi [Sun, 14 Nov 2021 05:30:59 +0000 (07:30 +0200)] 
DRILL-8007: Fix reading time / timestamp micros and binary types (#2370)

7 months agoDRILL-8025: Bump HBase client version to 2.4.8
Christian Pfarr [Fri, 12 Nov 2021 19:59:23 +0000 (20:59 +0100)] 
DRILL-8025: Bump HBase client version to 2.4.8

7 months agoDRILL-8041: Fix mongo scan spec deserialization (#2368)
Volodymyr Vysotskyi [Fri, 12 Nov 2021 16:42:42 +0000 (18:42 +0200)] 
DRILL-8041: Fix mongo scan spec deserialization (#2368)

7 months agoDRILL-8027: Format plugin for Apache Iceberg (#2357)
Volodymyr Vysotskyi [Fri, 12 Nov 2021 15:25:40 +0000 (17:25 +0200)] 
DRILL-8027: Format plugin for Apache Iceberg (#2357)

7 months agoDRILL-8042: Select star from MongoDB with aggregated pipeline fails with empty $proje...
Volodymyr Vysotskyi [Fri, 12 Nov 2021 12:58:40 +0000 (14:58 +0200)] 
DRILL-8042: Select star from MongoDB with aggregated pipeline fails with empty $project error (#2369)

7 months agoDRILL-8039: More LGTM Code Cleanup (#2365)
Charles S. Givre [Tue, 9 Nov 2021 14:35:53 +0000 (09:35 -0500)] 
DRILL-8039: More LGTM Code Cleanup (#2365)

* Initial Commit

* Fixed Spurious Javadocs

7 months agoDRILL-8040: Add HTTP status codes for API errors
James Turton [Tue, 9 Nov 2021 13:38:51 +0000 (15:38 +0200)] 
DRILL-8040: Add HTTP status codes for API errors

8 months agopoi 5.1.0
PJ Fanning [Thu, 4 Nov 2021 08:12:27 +0000 (09:12 +0100)] 
poi 5.1.0

8 months agoDRILL-8030: Intermittent TestDrillbitResilience cancelInMiddleOfFetchingResults and...
Vitalii Diravka [Wed, 3 Nov 2021 10:22:23 +0000 (12:22 +0200)] 
DRILL-8030: Intermittent TestDrillbitResilience cancelInMiddleOfFetchingResults and foreman_runTryEnd failures

8 months agoDRILL-8032: Remove obsolete Python scripts from the project (#2362)
Vitalii Diravka [Thu, 4 Nov 2021 02:38:34 +0000 (04:38 +0200)] 
DRILL-8032: Remove obsolete Python scripts from the project (#2362)

8 months agoDRILL-8029: Upgrade project parent POM to 24 version (#2360)
Vitalii Diravka [Wed, 3 Nov 2021 15:42:47 +0000 (17:42 +0200)] 
DRILL-8029: Upgrade project parent POM to 24 version (#2360)

8 months agoDRILL-8020: Add JSON Configuration Options to HTTP Rest Plugin (#2348)
Charles S. Givre [Wed, 3 Nov 2021 12:09:03 +0000 (08:09 -0400)] 
DRILL-8020: Add JSON Configuration Options to HTTP Rest Plugin (#2348)

* DRILL-8020: Add JSON Configuration Options to HTTP Rest Plugin

* Addressed review comments

* Addressed Review Comments

* Changed to Boolean

* Removed unused import

8 months agoExclude .js Files From LGTM (#2358)
Charles S. Givre [Mon, 1 Nov 2021 12:03:41 +0000 (08:03 -0400)] 
Exclude .js Files From LGTM (#2358)

* Create .lgtm.yml

Adds an exclusion to LGTM code audit.  Specifically all the minified `js` files from D3.

* Add License Header

* Exclude lgtm.yml from RAT check

8 months agoDRILL-8022: Add Provided Schema Support for Excel Reader
Charles Givre [Sun, 31 Oct 2021 23:06:22 +0000 (19:06 -0400)] 
DRILL-8022: Add Provided Schema Support for Excel Reader

8 months agoDRILL-8024: Bump Mongo client and Testcontainers version to latest (#2356)
luoc [Sun, 31 Oct 2021 13:55:18 +0000 (21:55 +0800)] 
DRILL-8024: Bump Mongo client and Testcontainers version to latest (#2356)

8 months agoDRILL-8021: Add the srv protocol support for the mongo storage (#2352)
luoc [Thu, 28 Oct 2021 13:50:40 +0000 (21:50 +0800)] 
DRILL-8021: Add the srv protocol support for the mongo storage (#2352)