drill.git
21 months ago[maven-release-plugin] prepare release drill-1.18.0 (#2102) drill-1.18.0
Abhishek Girish [Sat, 5 Sep 2020 16:39:24 +0000 (09:39 -0700)] 
[maven-release-plugin] prepare release drill-1.18.0 (#2102)

22 months agoDRILL-7782: Update the copyright year in NOTICE (#2100)
Abhishek Girish [Mon, 24 Aug 2020 18:45:21 +0000 (11:45 -0700)] 
DRILL-7782: Update the copyright year in NOTICE (#2100)

22 months agoAdd Abhishek's GPG Keys (#2099)
Abhishek Girish [Mon, 24 Aug 2020 18:25:46 +0000 (11:25 -0700)] 
Add Abhishek's GPG Keys (#2099)

22 months agoDRILL-7780: Fix string reference comparisons
Nes Cohen [Tue, 18 Aug 2020 22:10:54 +0000 (15:10 -0700)] 
DRILL-7780: Fix string reference comparisons

22 months agoDRILL-7774: IS NOT NULL predicate fails with NPE for the case of non-existing columns...
Volodymyr Vysotskyi [Thu, 6 Aug 2020 19:55:23 +0000 (22:55 +0300)] 
DRILL-7774: IS NOT NULL predicate fails with NPE for the case of non-existing columns with non-deterministic expression

23 months agoDRILL-7773: Incorrect conversion result to TIME_EPOCH_BE
Oleg Zinoviev [Wed, 29 Jul 2020 12:29:30 +0000 (15:29 +0300)] 
DRILL-7773: Incorrect conversion result to TIME_EPOCH_BE

23 months agoDRILL-7764: Cleanup warning messages in GuavaPatcher class (#2093)
Bohdan Kazydub [Wed, 8 Jul 2020 15:09:13 +0000 (18:09 +0300)] 
DRILL-7764: Cleanup warning messages in GuavaPatcher class (#2093)

* DRILL-7764: Cleanup warning messages in GuavaPatcher class

2 years agoDRILL-7759: Code compilation exception for queries containing (untyped) NULL
Bohdan Kazydub [Fri, 26 Jun 2020 14:42:14 +0000 (17:42 +0300)] 
DRILL-7759: Code compilation exception for queries containing (untyped) NULL

2 years agoDRILL-7761: Drill fails with OOM for the case of large filter conditions
Volodymyr Vysotskyi [Tue, 30 Jun 2020 19:11:50 +0000 (22:11 +0300)] 
DRILL-7761: Drill fails with OOM for the case of large filter conditions

2 years agoDRILL-5956: Add Storage Plugin for Apache Druid
akkapur [Sun, 27 Oct 2019 01:20:09 +0000 (21:20 -0400)] 
DRILL-5956: Add Storage Plugin for Apache Druid

2 years agoDRILL-7750: Drill fails to read KeyStore password from Credential provider (#2088)
Bohdan Kazydub [Sat, 20 Jun 2020 12:51:14 +0000 (15:51 +0300)] 
DRILL-7750: Drill fails to read KeyStore password from Credential provider (#2088)

2 years agoDRILL-7749: Drill-on-Yarn Application Master UI is broken due to bootstrap update
Anton Gozhiy [Wed, 17 Jun 2020 15:47:16 +0000 (18:47 +0300)] 
DRILL-7749: Drill-on-Yarn Application Master UI is broken due to bootstrap update

Fixed navigation classes in AM templates.

2 years agoDRILL-7723: Add Excel Metadata as Implicit Fields
Charles Givre [Sun, 14 Jun 2020 15:30:22 +0000 (11:30 -0400)] 
DRILL-7723: Add Excel Metadata as Implicit Fields

2 years agoDRILL-7746: Add REST API Ability to Accept CSV Input
Charles Givre [Tue, 2 Jun 2020 19:23:21 +0000 (15:23 -0400)] 
DRILL-7746: Add REST API Ability to Accept CSV Input

2 years agoAdding Slack Icon to README.md
Charles S. Givre [Tue, 2 Jun 2020 15:27:10 +0000 (11:27 -0400)] 
Adding Slack Icon to README.md

Adding slack icon to README.md.

2 years agoDRILL-7727: Fix protobuf warning message
Laurent Goujon [Wed, 29 Apr 2020 16:09:50 +0000 (16:09 +0000)] 
DRILL-7727: Fix protobuf warning message

Fix protobuf warning message about the use of ByteSize(), replaced with
ByteSizeLong().

Also add a minimum version requirement to match what is described in the
docs.

2 years agoDRILL-7744: Move Filters from HTTP Storage Plugin to Drill Core
Charles Givre [Tue, 26 May 2020 19:10:01 +0000 (15:10 -0400)] 
DRILL-7744: Move Filters from HTTP Storage Plugin to Drill Core

2 years agoDRILL-7725: Updates to the EVF2 framework
Paul Rogers [Thu, 30 Apr 2020 23:06:55 +0000 (16:06 -0700)] 
DRILL-7725: Updates to the EVF2 framework

* Supports internal implicit columns
* Better support for standard conversions
* Handle several reader corner cases
* Simplified file reader

closes #2073

2 years agoDRILL-7734: Revise the result set reader
Paul Rogers [Wed, 6 May 2020 01:22:05 +0000 (18:22 -0700)] 
DRILL-7734: Revise the result set reader

Revised into two forms: push (for streaming JSON results) and
pull (for one operator reading from another).

closes #2077

2 years agoDRILL-7739: Allow implicit casts from required to nullable data type
Volodymyr Vysotskyi [Sun, 17 May 2020 20:31:17 +0000 (23:31 +0300)] 
DRILL-7739: Allow implicit casts from required to nullable data type

closes #2080

2 years agoDRILL-7741: Columns are missing when using convert_from function
Volodymyr Vysotskyi [Fri, 15 May 2020 11:30:47 +0000 (14:30 +0300)] 
DRILL-7741: Columns are missing when using convert_from function

closes #2081

2 years agoDRILL-7707: Unable to analyze table metadata is it resides in non-writable workspace
Volodymyr Vysotskyi [Mon, 11 May 2020 17:31:38 +0000 (20:31 +0300)] 
DRILL-7707: Unable to analyze table metadata is it resides in non-writable workspace

2 years agoRevisions from review comments
Paul Rogers [Thu, 7 May 2020 22:16:07 +0000 (15:16 -0700)] 
Revisions from review comments

2 years agoDRILL-7730: Improve web query efficiency
Paul Rogers [Mon, 4 May 2020 21:17:18 +0000 (14:17 -0700)] 
DRILL-7730: Improve web query efficiency

Implements a direct transfer of batches from Screen to web client.
Cleans up web client query processing to avoid duplicate schema
info.
Much related code cleanup.

2 years agoDRILL-7738: Fix TestDynamicUDFSupport failure for GitHub Actions
Volodymyr Vysotskyi [Mon, 11 May 2020 21:08:30 +0000 (00:08 +0300)] 
DRILL-7738: Fix TestDynamicUDFSupport failure for GitHub Actions

2 years agoDRILL-7716: Create Format Plugin for SPSS Files
Charles Givre [Wed, 6 May 2020 00:34:11 +0000 (20:34 -0400)] 
DRILL-7716: Create Format Plugin for SPSS Files

2 years agoDRILL-7717: Support Mongo extended types in V2 JSON loader
Paul Rogers [Sun, 26 Apr 2020 21:11:47 +0000 (14:11 -0700)] 
DRILL-7717: Support Mongo extended types in V2 JSON loader

Adds support for Mongo extended types to the JSON loader.
Refactors the JSON code to make such extensions easier.
Added support for provided schema with extended types.

2 years agoDRILL-7724: Refactor metadata controller batch
Paul Rogers [Thu, 30 Apr 2020 21:16:22 +0000 (14:16 -0700)] 
DRILL-7724: Refactor metadata controller batch

Also changed for (;;) infinite loops to
while (true) as preferred by IntelliJ.

2 years agoDRILL-7726: Update boost requirement to 1.54
Laurent Goujon [Tue, 28 Apr 2020 19:30:12 +0000 (19:30 +0000)] 
DRILL-7726: Update boost requirement to 1.54

To support TLS1.2 flag, Boost ASIO 1.54 is required.

Also replace deprecated use of
`ssl::context::context(boost::asio::io_service &, method m)` which has
been removed from recent versions of Boost ASIO (>= 1.66).

2 years agoDRILL-7711: Add data path, parameter filter pushdown to HTTP plugin
Paul Rogers [Sat, 18 Apr 2020 19:46:45 +0000 (12:46 -0700)] 
DRILL-7711: Add data path, parameter filter pushdown to HTTP plugin

Adds an option to specify the path to data so the plugin will
ignore REST message "overhead" except the actual data.

Allows specifying HTTP URL parameters as filter push-downs from
SQL.

* Revised scan cost model to allow a scan more freedom
  to define cost. Needed to ensure that filter push-down
  is actually accepted by Calcite.
* Reduced size of HTTP scan plan by including on the one
  needed connection config rather than all of them.
* Revised URL building so that the proxy sees the full
  URL after adding parameters, etc.
* Many code refinements.
* Added more details to README

2 years agoDRILL-7705: Updated jQuery and Bootstrap libraries
Anton Gozhiy [Fri, 17 Apr 2020 15:58:04 +0000 (18:58 +0300)] 
DRILL-7705: Updated jQuery and Bootstrap libraries

- jQuery: 3.2.1 -> 3.4.1
- Bootstrap: 3.1.1 -> 4.4.1
- Also fixed styles that were considerably broken after the update.

2 years agoDRILL-7710: Fix TestMetastoreCommands#testDefaultSegment test
Volodymyr Vysotskyi [Tue, 21 Apr 2020 18:17:19 +0000 (21:17 +0300)] 
DRILL-7710: Fix TestMetastoreCommands#testDefaultSegment test

2 years agoDRILL-7706: Implement Drill RDBMS Metastore
Arina Ielchiieva [Thu, 5 Mar 2020 11:34:09 +0000 (13:34 +0200)] 
DRILL-7706: Implement Drill RDBMS Metastore

1. Fix issue with undeterministic execution of batch update / delete statements, now they will be executed in the same order as they were added.
2. Abstracted Metastore common test classes to be used by different Metastore implementations.
3. Added drill-metastore-override-example.conf with example of Drill Metastore configuration.
4. Replaced list of metadata types which are required to be passed during read / write operations with set to avoid possible duplicates.
5. Add RDBMS Metastore implementation, README.md and unit tests.

2 years agoDRILL-7713: Upgrade misc libraries which outdated versions have reported vulnerabilities
Arina Ielchiieva [Sat, 18 Apr 2020 15:58:20 +0000 (18:58 +0300)] 
DRILL-7713: Upgrade misc libraries which outdated versions have reported vulnerabilities

1. Jackson
2. Retrofit
3. Commons-beanutils
4. Xalan
5. Xerdes
6. Commons-codec
7. Snakeyaml
8. Metadata-extractor
9. Protostuff

2 years agoDRILL-7701: EVF V2 Scan Framework
Paul Rogers [Wed, 15 Apr 2020 05:57:01 +0000 (22:57 -0700)] 
DRILL-7701: EVF V2 Scan Framework

Revises the scan framework to use the revised schema resolution
introduced in DRILL-7696.

2 years agoDRILL-6168: Revise format plugin table functions
Paul Rogers [Sun, 12 Apr 2020 07:19:02 +0000 (00:19 -0700)] 
DRILL-6168: Revise format plugin table functions

Allows table functions to inherit properties from a
defined format plugin.

Also DRILL-7612: enforces immutability for all format plugins.

2 years agoDRILL-7703: Support for 3+D arrays in EVF JSON loader
Paul Rogers [Wed, 15 Apr 2020 18:02:47 +0000 (11:02 -0700)] 
DRILL-7703: Support for 3+D arrays in EVF JSON loader

Revises the EVF-based JSON loader to support nested
repeated lists.

2 years agoDRILL-7704: Update Maven to 3.6.3
Arina Ielchiieva [Thu, 16 Apr 2020 14:35:53 +0000 (17:35 +0300)] 
DRILL-7704: Update Maven to 3.6.3

2 years agoDRILL-7702: Update shaded guava 2057/head
Volodymyr Vysotskyi [Tue, 14 Apr 2020 09:14:07 +0000 (12:14 +0300)] 
DRILL-7702: Update shaded guava

2 years agoDRILL-7702: Update ZooKeeper and Curator, exclude org.codehaus.jackson
Volodymyr Vysotskyi [Mon, 13 Apr 2020 15:04:28 +0000 (18:04 +0300)] 
DRILL-7702: Update ZooKeeper and Curator, exclude org.codehaus.jackson

2 years agoDRILL-7702: Update httpclient, libthrift, httpdlog-parser, jetty, derby, exclude...
Volodymyr Vysotskyi [Fri, 10 Apr 2020 16:20:20 +0000 (19:20 +0300)] 
DRILL-7702: Update httpclient, libthrift, httpdlog-parser, jetty, derby, exclude and ban log4j, jasper-runtime, commons-httpclient

closes #2057

2 years agoDRILL-7693: Updated protobuf version to 3.11.1
Anton Gozhiy [Thu, 9 Apr 2020 11:04:10 +0000 (14:04 +0300)] 
DRILL-7693: Updated protobuf version to 3.11.1

2 years agoDRILL-7603 and DRILL-7604: Add schema, options to REST query
Paul Rogers [Fri, 10 Apr 2020 19:45:12 +0000 (12:45 -0700)] 
DRILL-7603 and DRILL-7604: Add schema, options to REST query

Update and revision of work originally done by dobesv.

DRILL-7603: Allow default schema to be set for HTTP queries
DRILL-7604: Allow session options to be set in HTTP queries

Merges the above two. Separates running a REST query from the
JSON representation. Allows setting all option types from
a string (as required by DRILL-7604).

Added default schema to query profile query editor.

Made the two query editors a bit more similar visually,
but see DRILL-7697 for more work needed.

Added a utility to run a server for UI teseting without
a full build.

2 years agoDRILL-7696: EVF v2 scan schema resolution
Paul Rogers [Fri, 10 Apr 2020 03:46:06 +0000 (20:46 -0700)] 
DRILL-7696: EVF v2 scan schema resolution

Provides the mechanism to resolve the scan schema from a
projection list, provided schema, early reader schema and
actual reader schema.

2 years agoDRILL-7692: Add dropdown to select default storage
Justin Chen [Mon, 13 Apr 2020 22:42:20 +0000 (18:42 -0400)] 
DRILL-7692: Add dropdown to select default storage

2 years agoDRILL-7437: Storage Plugin for Generic HTTP REST API
Charles Givre [Mon, 13 Apr 2020 14:16:36 +0000 (10:16 -0400)] 
DRILL-7437: Storage Plugin for Generic HTTP REST API

2 years agoDRILL-7699: Update javax.validation Dependency
Charles Givre [Mon, 13 Apr 2020 00:10:05 +0000 (20:10 -0400)] 
DRILL-7699: Update javax.validation Dependency

2 years agoDRILL-7678: Update Yauaa dependency
Niels Basjes [Tue, 31 Mar 2020 09:44:30 +0000 (11:44 +0200)] 
DRILL-7678: Update Yauaa dependency

closes #2044

2 years agoDRILL-7694: Register drill.queries.* counter metrics on Drillbit startup
Bohdan Kazydub [Thu, 9 Apr 2020 13:46:18 +0000 (16:46 +0300)] 
DRILL-7694: Register drill.queries.* counter metrics on Drillbit startup

closes #2050

2 years agoDRILL-7668: Allow Time Bucket Function to Accept Floats and Timestamps
Charles Givre [Mon, 6 Apr 2020 20:11:31 +0000 (16:11 -0400)] 
DRILL-7668: Allow Time Bucket Function to Accept Floats and Timestamps

closes #2040

2 years agoDRILL-7683: Add "message parsing" to new JSON loader
Paul Rogers [Tue, 31 Mar 2020 20:23:05 +0000 (13:23 -0700)] 
DRILL-7683: Add "message parsing" to new JSON loader

Adds the ability to parse "extra" JSON around the data payload,
as often needed for a REST API.

closes #2045

2 years agoDRILL-7675: Work around for partitions sender memory use
Paul Rogers [Thu, 2 Apr 2020 18:45:12 +0000 (11:45 -0700)] 
DRILL-7675: Work around for partitions sender memory use

Adds an ad-hoc system/session option to limit partition sender
memory use. See DRILL-7686 for the underlying issue.

Also includes code cleanup and diagnostic tools.

closes #2047

2 years agoDRILL-7429: Wrong column order when selecting complex data using Hive storage plugin
Igor Guzenko [Thu, 5 Mar 2020 12:14:25 +0000 (14:14 +0200)] 
DRILL-7429: Wrong column order when selecting complex data using Hive storage plugin

2 years agoDRILL-7680: Place UDFs before plugins in contrib
Paul Rogers [Tue, 31 Mar 2020 18:50:07 +0000 (11:50 -0700)] 
DRILL-7680: Place UDFs before plugins in contrib

2 years agoDRILL-7673: View set query fails with NPE for non-existing option
Volodymyr Vysotskyi [Fri, 27 Mar 2020 22:49:50 +0000 (00:49 +0200)] 
DRILL-7673: View set query fails with NPE for non-existing option

closes #2043

2 years agoDRILL-7672: Make metadata type required when reading from / writing into Drill Metastore
Arina Ielchiieva [Wed, 25 Mar 2020 14:42:53 +0000 (16:42 +0200)] 
DRILL-7672: Make metadata type required when reading from / writing into Drill Metastore

1. Upgraded Iceberg version and removed unneeded code for In / NotIn Expressions.
2. Updated Metastore Read / Modify interfaces to support required metadata types:
 a. introduced abstract Read / Modify classes with boilerplate code;
 b. added delete operation with filter and metadata type;
 c. added metadata type validator which checks supported metadata types for each component;
 d. made purge operation terminal;
 e. made necessary changes in REAME.md files.
3. Added / updated unit tests.

closes #2042

2 years agoDRILL-7641: Convert Excel Reader to use Streaming Reader
Charles Givre [Fri, 27 Mar 2020 13:12:45 +0000 (09:12 -0400)] 
DRILL-7641: Convert Excel Reader to use Streaming Reader

closes #2024

2 years agoDRILL-6604: Upgrade Drill Hive client to Hive3.1 version
Volodymyr Vysotskyi [Sun, 22 Mar 2020 21:42:59 +0000 (23:42 +0200)] 
DRILL-6604: Upgrade Drill Hive client to Hive3.1 version

closes #2038

2 years agoDRILL-7665: Add UNION to schema parser
Arina Ielchiieva [Wed, 25 Mar 2020 17:31:23 +0000 (19:31 +0200)] 
DRILL-7665: Add UNION to schema parser

2 years agoDRILL-7663: Code refactor to DefaultFunctionResolver
weijie.tong [Wed, 25 Mar 2020 12:00:44 +0000 (20:00 +0800)] 
DRILL-7663: Code refactor to DefaultFunctionResolver

2 years agoDRILL-7633: Fixes for union and repeated list accessors
Paul Rogers [Mon, 9 Mar 2020 23:56:36 +0000 (16:56 -0700)] 
DRILL-7633: Fixes for union and repeated list accessors

Minor fixes and cleanup for the obscure union and
repeated list types in the column accesor framework.

Added variant type typeString() function

2 years agoDRILL-7648: Scrypt j_security_check works without security headers
Igor Guzenko [Fri, 20 Mar 2020 17:07:25 +0000 (19:07 +0200)] 
DRILL-7648: Scrypt j_security_check works without security headers

1. Added callback for setting headers in DrillHttpSecurityHandlerProvider,
   since ResponseHeadersSettingFilter doesn't covers this flow.

2 years agoDRILL-7643: Fix issues with using columns with the same name as a reserved keyword
Volodymyr Vysotskyi [Mon, 16 Mar 2020 18:41:35 +0000 (20:41 +0200)] 
DRILL-7643: Fix issues with using columns with the same name as a reserved keyword

closes #2028

2 years agoDRILL-7656: Support injecting BufferManager into UDF
weijie.tong [Sat, 21 Mar 2020 02:04:31 +0000 (10:04 +0800)] 
DRILL-7656: Support injecting BufferManager into UDF

closes #2036

2 years agoDRILL-7654: Add support for JDK 14
Volodymyr Vysotskyi [Fri, 20 Mar 2020 21:59:56 +0000 (23:59 +0200)] 
DRILL-7654: Add support for JDK 14

2 years agoDRILL-7651: Increase timeout for TestLargeFileCompilation to avoid GitHub Action...
Volodymyr Vysotskyi [Thu, 19 Mar 2020 16:43:02 +0000 (18:43 +0200)] 
DRILL-7651: Increase timeout for TestLargeFileCompilation to avoid GitHub Action failures and fix concurrent issue in TestTpchDistributedConcurrent

2 years agoDRILL-7652: Add time_bucket() function for time series analysis
Charles Givre [Fri, 20 Mar 2020 14:14:10 +0000 (10:14 -0400)] 
DRILL-7652: Add time_bucket() function for time series analysis

2 years agoDRILL-7650: Add option to enable Jetty's dump for troubleshooting
Igor Guzenko [Thu, 19 Mar 2020 11:13:56 +0000 (13:13 +0200)] 
DRILL-7650: Add option to enable Jetty's dump for troubleshooting

1. Added option drill.exec.http.jetty.server.dumpAfterStart
2. Removed redundant setProtocol() call

2 years agoDRILL-7330: Implement metadata usage for all format plugins
Volodymyr Vysotskyi [Thu, 12 Mar 2020 20:05:06 +0000 (22:05 +0200)] 
DRILL-7330: Implement metadata usage for all format plugins

2 years agoDRILL-7649: Replace maprfs.version property usage by mapr.release.version
Anton Gozhiy [Thu, 19 Mar 2020 12:42:55 +0000 (14:42 +0200)] 
DRILL-7649: Replace maprfs.version property usage by mapr.release.version

Also added mapr-security-web to the Dependency Management and Distribution POM
to fix a problem, where the jar file is not being added to the distribution in some build environments.

2 years agoDRILL-7644: Log SSL protocol version at Drill start up
Igor Guzenko [Tue, 17 Mar 2020 15:58:06 +0000 (17:58 +0200)] 
DRILL-7644: Log SSL protocol version at Drill start up

2 years agoDRILL-7626: Add ability to set HTTP response headers
Igor Guzenko [Wed, 4 Mar 2020 18:16:50 +0000 (20:16 +0200)] 
DRILL-7626: Add ability to set HTTP response headers

1. Created ResponseHeadersSettingFilter for adding configured values to each response.
2. Now for when drill.exec.http.ssl_enabled users can add following headers
   to improve security:
      "X-XSS-Protection" : "1; mode=block",
      "X-Content-Type-Options" : "nosniff",
      "Strict-Transport-Security" : "max-age=31536000;includeSubDomains",
      "Content-Security-Policy" : "Content-Security-Policy": "default-src https:; script-src 'unsafe-inline' https:; style-src 'unsafe-inline' https:; font-src data: https:; img-src data: https:"

2 years agoDRILL-7640: EVF-based JSON Loader
Paul Rogers [Thu, 12 Mar 2020 22:54:44 +0000 (15:54 -0700)] 
DRILL-7640: EVF-based JSON Loader

Builds on the JSON structure parser and several other PRs
to provide an enhanced, robust mechanism to read JSON data
into value vectors via the EVF. This is not the JSON reader,
rather it is the "V2" version of the JsonProcessor which
does the actual JSON parsing/loading work.

closes #2023

2 years agoDRILL-7639: Replace DBCP2 with HikariCP in RDBMS (JDBC) plugin
Arina Ielchiieva [Fri, 13 Mar 2020 16:31:40 +0000 (18:31 +0200)] 
DRILL-7639: Replace DBCP2 with HikariCP in RDBMS (JDBC) plugin

2 years agoDRILL-7620: Fix plugin mutability issues
Paul Rogers [Tue, 3 Mar 2020 23:03:49 +0000 (15:03 -0800)] 
DRILL-7620: Fix plugin mutability issues

A recent commit made the plugin registry more strict about
the rule that, once a plugin is registered, it must be
immutable. A flaw enforcing that rule in the UI put the
registry in an inconsistent state.

Also
* Registry-specific errors
* Push more operations from UI layer into registry
* Clean up semantics of "resolve" for plugins
* Add more unit tests
* Better handling of "bad" plugins
* Force plugin names to lower case
* Fix comparison bugs in some format plugins

2 years agoDRILL-7637: Add an option to retrieve MapR SSL truststore/keystore credentials using...
Anton Gozhiy [Tue, 3 Mar 2020 10:41:22 +0000 (12:41 +0200)] 
DRILL-7637: Add an option to retrieve MapR SSL truststore/keystore credentials using MapR Web Security Manager

2 years agoDRILL-7631: Updates to the Json Structure Parser
Paul Rogers [Mon, 9 Mar 2020 18:34:46 +0000 (11:34 -0700)] 
DRILL-7631: Updates to the Json Structure Parser

Revised how "look-ahead" works. Added support for unknown
types.

closes #2016

2 years agoDRILL-7634: Rollup of code cleanup changes
Paul Rogers [Mon, 10 Feb 2020 02:24:47 +0000 (18:24 -0800)] 
DRILL-7634: Rollup of code cleanup changes

Collection of code cleanup changes. The most significant
is to create constants for function names.

closes #2020

2 years agoDRILL-7603: Allow default schema to be set for HTTP queries
Dobes Vandermeer [Tue, 10 Mar 2020 21:02:27 +0000 (14:02 -0700)] 
DRILL-7603: Allow default schema to be set for HTTP queries

This allows REST API requests and Web UI requests to specify a
default
schema.  Otherwise this is not possible for HTTP clients because the
"USE" command requires a session, which HTTP clients do not have.

closes #1996

2 years agoDRILL-7601: Shift column conversion to reader from scan framework
Paul Rogers [Fri, 21 Feb 2020 19:00:14 +0000 (11:00 -0800)] 
DRILL-7601: Shift column conversion to reader from scan framework

Allows the column writers to be generic, moves scan-specific
conversions into each reader where needed, implemented in
a reader-specific way.

Adds a revised way of handling projections in the result set
loader that is not coupled with conversion, as the prior
design was.

Updates the CSV, Avro, Log and HDF5 readers.

closes #1993

2 years agoDRILL-7635: Mongo tests fail for profiles with the non-file default file system
Volodymyr Vysotskyi [Tue, 10 Mar 2020 19:14:19 +0000 (21:14 +0200)] 
DRILL-7635: Mongo tests fail for profiles with the non-file default file system

2 years agoDRILL-7632: Improve user exception formatting
Paul Rogers [Mon, 9 Mar 2020 18:58:28 +0000 (11:58 -0700)] 
DRILL-7632: Improve user exception formatting

Adds a colon in the "getMessage()" format of a User
Exception between the context name and value:
My Context: value

closes #2017

2 years agoDRILL-7630: Add additional types into SchemaParser for Parquet
Arina Ielchiieva [Tue, 10 Mar 2020 14:06:57 +0000 (16:06 +0200)] 
DRILL-7630: Add additional types into SchemaParser for Parquet

closes #2019

2 years agoDRILL-7628: Fix Mongo tests broken after the fix for DRILL-7547
Volodymyr Vysotskyi [Fri, 6 Mar 2020 18:33:00 +0000 (20:33 +0200)] 
DRILL-7628: Fix Mongo tests broken after the fix for DRILL-7547

closes #2015

2 years agoDRILL-7627: Update MySql version for JdbcStoragePlugin tests and cache ~/.embedmysql...
Arina Ielchiieva [Fri, 6 Mar 2020 13:40:28 +0000 (15:40 +0200)] 
DRILL-7627: Update MySql version for JdbcStoragePlugin tests and cache ~/.embedmysql for GitHub Actions workflow run

closes #2014

2 years agoDRILL-7625: Add options for SslContextFactory
Igor Guzenko [Mon, 2 Mar 2020 15:09:54 +0000 (17:09 +0200)] 
DRILL-7625: Add options for SslContextFactory

closes #2012

2 years agoDRILL-7623: Link error is displayed at the log content page on Web UI
Volodymyr Vysotskyi [Wed, 4 Mar 2020 13:01:32 +0000 (15:01 +0200)] 
DRILL-7623: Link error is displayed at the log content page on Web UI

closes #2011

2 years agoDRILL-7622: Compilation error when using HLL / TDigest with `group by` clause
ozinoviev [Tue, 3 Mar 2020 16:37:27 +0000 (19:37 +0300)] 
DRILL-7622: Compilation error when using HLL / TDigest with `group by` clause

closes #2009

2 years agoDRILL-7615: UNION ALL query returns the wrong result for the decimal value
Volodymyr Vysotskyi [Mon, 2 Mar 2020 12:03:01 +0000 (14:03 +0200)] 
DRILL-7615: UNION ALL query returns the wrong result for the decimal value

closes #2006

2 years agoDRILL-7607: support dynamic credit based flow control
weijie.tong [Thu, 27 Feb 2020 11:34:43 +0000 (19:34 +0800)] 
DRILL-7607: support dynamic credit based flow control

closes #2000

2 years agoDRILL-7203: Accept impersonation userName as form field & fix back button for query...
Dobes Vandermeer [Tue, 25 Feb 2020 19:57:34 +0000 (11:57 -0800)] 
DRILL-7203: Accept impersonation userName as form field & fix back button for query page

Requiring the impersonation username to be sent as an HTTP header made
it difficult to implement the Web UI submission.  This changes it so
that the userName can be sent as a form field instead, allowing the Web
UI to do a "normal" form submission, which fixes the back button, avoids
the use of the deprecated "document.open" API call, and may avoid other
glitches in the future.

closes #1994

2 years agoDRILL-7619: Fixed link to the metrics endpoint
Anton Gozhiy [Tue, 3 Mar 2020 11:03:26 +0000 (13:03 +0200)] 
DRILL-7619: Fixed link to the metrics endpoint

2 years agoDRILL-7617: Disabled plugins not showing in Web UI
Paul Rogers [Tue, 3 Mar 2020 02:57:13 +0000 (18:57 -0800)] 
DRILL-7617: Disabled plugins not showing in Web UI

Fixes a misunderstanding in prior PR: getConfigs()
should return both enabled and disabled configs.

2 years agoDRILL-7592: Add missing licenses and update plugins exclusion list and fix licenses
Volodymyr Vysotskyi [Wed, 19 Feb 2020 11:23:47 +0000 (13:23 +0200)] 
DRILL-7592: Add missing licenses and update plugins exclusion list and fix licenses

closes #1989

2 years agoDRILL-7605: Preserve query form field values between reloads / navigation
Dobes Vandermeer [Tue, 25 Feb 2020 21:58:21 +0000 (13:58 -0800)] 
DRILL-7605: Preserve query form field values between reloads / navigation

It is nice to continue where you left off when returning to the query
form.

closes #1995

2 years agoDRILL-7590: Refactor plugin registry
Paul Rogers [Mon, 10 Feb 2020 19:40:19 +0000 (11:40 -0800)] 
DRILL-7590: Refactor plugin registry

Major cleanup of the plugin registry to split it into components
in preparation for a proper plugin API.

Better coordinates the named and ephemeral plugin caches.
Cleans up the registry API. Sharpens rules for modifying
plugin configs.

closes #1988

2 years agoDRILL-7582: Moved Drillbits REST API communication to the back end layer
Anton Gozhiy [Mon, 17 Feb 2020 15:24:45 +0000 (17:24 +0200)] 
DRILL-7582: Moved Drillbits REST API communication to the back end layer

closes #1999

2 years agoDRILL-7587: Fix ValuesPrule distribution trait type
Arina Ielchiieva [Thu, 27 Feb 2020 15:55:59 +0000 (17:55 +0200)] 
DRILL-7587: Fix ValuesPrule distribution trait type

closes #2002

2 years agoDRILL-7547: Support credentials store for mongo connections
Dobes Vandermeer [Fri, 28 Feb 2020 01:41:07 +0000 (17:41 -0800)] 
DRILL-7547: Support credentials store for mongo connections

This uses the hadoop `Configuration.getPassword` method to retrieve the
username and password for mongo connections.  This allows the user to
supply credentials or credential store configuration in core-site.xml
instead of inlining the credentials in the storage plugin configuration
that is stored in ZooKeeper.

Refer to the CredentialProviderAPI document for more information about
how credential provider plugins work.

closes #2001

2 years agoDRILL-7477: Allow passing table function parameters into ANALYZE statement
Volodymyr Vysotskyi [Thu, 20 Feb 2020 16:39:33 +0000 (18:39 +0200)] 
DRILL-7477: Allow passing table function parameters into ANALYZE statement

- Fix logical dir pruning when table function is used

closes #2005