drill.git
4 years ago[maven-release-plugin] prepare release drill-1.12.0 1.12.0 drill-1.12.0
Arina Ielchiieva [Sun, 10 Dec 2017 14:03:00 +0000 (14:03 +0000)] 
[maven-release-plugin] prepare release drill-1.12.0

4 years agoDRILL-6019: Only admin should be able to access shutdown resources and information...
Arina Ielchiieva [Fri, 8 Dec 2017 11:19:40 +0000 (13:19 +0200)] 
DRILL-6019: Only admin should be able to access shutdown resources and information about process and admin users

1. Only admin should be able to access shutdown resources via REST API.
2. Modified ClusterInfo to show information about process and admin users only when user is logged in and is admin.
3. Added drillbits comparison based on thier adress and ports to check if drillbits are the same (DRILL-6006)

closes #1065

4 years agoDRILL-6007: Use default refresh timeout (10 seconds) if graceful shutdown timeout...
Arina Ielchiieva [Tue, 5 Dec 2017 17:13:09 +0000 (19:13 +0200)] 
DRILL-6007: Use default refresh timeout (10 seconds) if graceful shutdown timeout is set to 0.

closes #1062

4 years agoDRILL-6017: Fix for SHUTDOWN button being visible for non Admin users
karthik [Thu, 7 Dec 2017 04:13:24 +0000 (09:43 +0530)] 
DRILL-6017: Fix for SHUTDOWN button being visible for non Admin users

closes #1064

4 years agoDRILL-5702: Jdbc Driver Class not found
Vitalii Diravka [Wed, 6 Dec 2017 15:31:10 +0000 (17:31 +0200)] 
DRILL-5702: Jdbc Driver Class not found

1. Setting "package.namespace.prefix" to "oadd." by default for all profiles. It can be overridden if necessary within any profile.
2. Removing duplicated and redundant excluding of commons-logging packages.

closes #1063

4 years agoDRILL-6000: Categorized graceful shutdown unit tests as SlowTests
Timothy Farkas [Wed, 29 Nov 2017 18:52:29 +0000 (10:52 -0800)] 
DRILL-6000: Categorized graceful shutdown unit tests as SlowTests

closes #1056

4 years agoDRILL-5989: Categories some tests to speed up smoke tests. Made travis run tests.
Timothy Farkas [Wed, 22 Nov 2017 23:02:07 +0000 (15:02 -0800)] 
DRILL-5989: Categories some tests to speed up smoke tests. Made travis run tests.

closes #1053

4 years agoDRILL-5972: Slow performance for query on INFORMATION_SCHEMA.TABLE
Padma Penumarthy [Thu, 16 Nov 2017 04:31:23 +0000 (20:31 -0800)] 
DRILL-5972: Slow performance for query on INFORMATION_SCHEMA.TABLE

closes #1038

4 years agoDRILL-5694: Do not allow queries to access paths outside the current workspace root
Parth Chandra [Tue, 14 Nov 2017 23:25:33 +0000 (15:25 -0800)] 
DRILL-5694: Do not allow queries to access paths outside the current workspace root

closes #1050

4 years agoDRILL-4286: Graceful shutdown of drillbit
dvjyothsna [Thu, 24 Aug 2017 15:58:00 +0000 (08:58 -0700)] 
DRILL-4286: Graceful shutdown of drillbit

closes #921

4 years agoDRILL-4779: Kafka storage plugin (Kamesh Bhallamudi & Anil Kumar Batchu)
Anil Kumar Batchu [Tue, 28 Nov 2017 02:44:55 +0000 (18:44 -0800)] 
DRILL-4779: Kafka storage plugin (Kamesh Bhallamudi & Anil Kumar Batchu)

closes #1052

4 years agoDRILL-5952: Implement "CREATE TABLE IF NOT EXISTS and CREATE VIEW IF NOT EXISTS"
Prasad Nagaraj Subramanya [Fri, 17 Nov 2017 07:03:43 +0000 (23:03 -0800)] 
DRILL-5952: Implement "CREATE TABLE IF NOT EXISTS and CREATE VIEW IF NOT EXISTS"

closes #1033

4 years agoDRILL-5981: Add syntax highlighting and error checking to plugin configuration page.
cgivre [Wed, 22 Nov 2017 18:48:06 +0000 (13:48 -0500)] 
DRILL-5981: Add syntax highlighting and error checking to plugin configuration page.

closes #1043

4 years agoDRILL-5986: Update jackson-databind version to 2.7.9.1
Volodymyr Vysotskyi [Wed, 22 Nov 2017 15:45:42 +0000 (17:45 +0200)] 
DRILL-5986: Update jackson-databind version to 2.7.9.1

closes #1046

4 years agoDRILL-5987: Use one version of javassist
Timothy Farkas [Wed, 22 Nov 2017 20:31:18 +0000 (12:31 -0800)] 
DRILL-5987: Use one version of javassist

closes #1048

4 years agoDRILL-5980: Making queryType param for REST client case-insensitive
chris [Tue, 21 Nov 2017 20:53:45 +0000 (15:53 -0500)] 
DRILL-5980: Making queryType param for REST client case-insensitive

This closes #1044

4 years agoDRILL-5962: Add function STAsJSON to extend GIS support
chris [Tue, 14 Nov 2017 21:26:21 +0000 (16:26 -0500)] 
DRILL-5962: Add function STAsJSON to extend GIS support

This closes #1036

4 years agoDRILL-5960: Add ST_AsGeoJSON functionality from PostGIS
chris [Tue, 14 Nov 2017 14:28:36 +0000 (09:28 -0500)] 
DRILL-5960: Add ST_AsGeoJSON functionality from PostGIS

This closes  #1034

4 years agoDRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN mechanism
Sorabh Hamirwasia [Tue, 7 Nov 2017 23:27:45 +0000 (15:27 -0800)] 
DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN mechanism

This closes #1028

4 years agoDRILL-5941: Skip header / footer improvements for Hive storage plugin
Arina Ielchiieva [Thu, 9 Nov 2017 08:58:46 +0000 (08:58 +0000)] 
DRILL-5941: Skip header / footer improvements for Hive storage plugin

Overview:
1. When table has header / footer process input splits fo the same file in one reader (bug fix for DRILL-5941).
2. Apply skip header logic during reader initialization only once to avoid checks during reading the data (DRILL-5106).
3. Apply skip footer logic only when footer is more then 0, otherwise default processing will be done without buffering data in queue (DRILL-5106).

Code changes:
1. AbstractReadersInitializer was introduced to factor out common logic during readers intialization.
It will have two implementations:
a. Default (each input split group gets its own reader);
b. Empty (for empty tables);

2. AbstractRecordsInspector was introduced to improve performance when table has footer is less or equals to 0.
It will have two implementations:
a. Default (records will be processed one by one without buffering);
b. SkipFooter (queue will be used to buffer N records that should be skipped in the end of file processing).

3. When text table has header / footer each table file should be read as one unit. When file is being read as several input splits, they should be grouped.
For this purpose LogicalInputSplit class was introduced which replaced InputSplitWrapper class. New class stores list of grouped input splits and returns information about splits on group level.
Please note, during planning input splits are grouped only when data is being read from text table has header / footer each table, otherwise each input split is treated separately.

4. Allow HiveAbstractReader to have multiple input splits instead of one.

This closes #1030

4 years agoDRILL-5936: Refactor MergingRecordBatch based on code inspection
Vlad Rozov [Tue, 7 Nov 2017 01:55:56 +0000 (17:55 -0800)] 
DRILL-5936: Refactor MergingRecordBatch based on code inspection

This closes #1025

4 years agoDRILL-5917: Ban org.json:json library in Drill
Vlad Rozov [Wed, 8 Nov 2017 01:07:38 +0000 (17:07 -0800)] 
DRILL-5917: Ban org.json:json library in Drill

This closes #1031

4 years agoDRILL-5867: List profiles in pages rather than a long verbose listing
Kunal Khatua [Tue, 14 Nov 2017 22:15:28 +0000 (14:15 -0800)] 
DRILL-5867: List profiles in pages rather than a long verbose listing

Leverage existing DataTables libraries to paginate a long pre-fetched list of profiles for listing.
Added benefit of querying through that list (search field) is also available for a user
Minor change made to the display text for prefetching of profiles (DRILL-5259) so that it is not confused with what this commit adds to the UI.

This closes #1029

4 years agoDRILL-5801: Gantt chart (fragment timeline) enhancements
Kunal Khatua [Tue, 14 Nov 2017 18:48:36 +0000 (10:48 -0800)] 
DRILL-5801: Gantt chart (fragment timeline) enhancements

1. Labelled X and Y axes on the Gantt Chart that expresses the fragments' timelines
2. Support mouse hover to reveal major fragment ID

This closes #1035

4 years agoDRILL-5771: Fix serDe errors for format plugins
Arina Ielchiieva [Thu, 26 Oct 2017 13:09:00 +0000 (16:09 +0300)] 
DRILL-5771: Fix serDe errors for format plugins

1. Fix various serde issues for format plugins described in DRILL-5771.
2. Throw meaninful exception instead of NPE when table is not found when table function is used.
3. Added unit tests for all format plugins for ensure serde is checked (physical plan is generated in json format and then submitted).
4. Fix physical plan submission on Windows (DRILL-4640).

This closes #1014

4 years agoDRILL-5089: Dynamically load schema of storage plugin only when needed for every...
chunhui-shi [Fri, 3 Nov 2017 00:06:25 +0000 (17:06 -0700)] 
DRILL-5089: Dynamically load schema of storage plugin only when needed for every query

For each query, loading all storage plugins and loading all workspaces under file system plugins is not needed.

This patch use DynamicRootSchema as the root schema for Drill. Which loads correspondent storage only when needed.

infoschema to read full schema information and load second level schema accordingly.

for workspaces under the same Filesyetm, no need to create FileSystem for each workspace.

use fs.access API to check permission which is available after HDFS 2.6 except for windows + local file system case.

Add unit tests to test with a broken mock storage: with a storage that will throw Exception in regiterSchema method,
all queries even on good storages shall fail without this fix(Drill still load all schemas from all storages).

This closes #1032

4 years agoDRILL-5968: Add support for empty service_host user property
Rob Wu [Wed, 15 Nov 2017 07:27:29 +0000 (23:27 -0800)] 
DRILL-5968: Add support for empty service_host user property

This closes #1037

4 years agoDRILL-5783, DRILL-5841, DRILL-5894: Rationalize test temp directories
Timothy Farkas [Thu, 9 Nov 2017 22:25:53 +0000 (14:25 -0800)] 
DRILL-5783, DRILL-5841, DRILL-5894: Rationalize test temp directories

This change includes:

DRILL-5783:
 - A unit test is created for the priority queue in the TopN operator.
 - The code generation classes passed around a completely unused function registry reference in some places so it is removed.
 - The priority queue had unused parameters for some of its methods so it is removed.

DRILL-5841:
 - Created standardized temp directory classes DirTestWatcher, SubDirTestWatcher, and BaseDirTestWatcher. And updated all unit tests to use them.

DRILL-5894:
 - Removed the dfs_test storage plugin for tests and replaced it with the already existing dfs storage plugin.

Misc:
 - General code cleanup.
 - Removed unnecessary use of String.format in the tests.

This closes #984

4 years agoDRILL-5842: Refactor fragment, operator contexts 978/head
Paul Rogers [Thu, 5 Oct 2017 05:43:44 +0000 (22:43 -0700)] 
DRILL-5842: Refactor fragment, operator contexts

This closes #978

4 years agoDRILL-5832: Change OperatorFixture to use system option manager
Paul Rogers [Mon, 2 Oct 2017 22:45:21 +0000 (15:45 -0700)] 
DRILL-5832: Change OperatorFixture to use system option manager

- Rename FixtureBuilder to ClusterFixtureBuilder
- Provide alternative way to reset system/session options
- Fix for DRILL-5833: random failure in TestParquetWriter
- Provide strict, but clear, errors for missing options

closes #970

4 years agoDRILL-5795: Parquet Filter push down now work at rowgroup level
Damien Profeta [Fri, 15 Sep 2017 18:01:58 +0000 (11:01 -0700)] 
DRILL-5795: Parquet Filter push down now work at rowgroup level

Before this commit, the filter was pruning complete files. When a file
is composed of multiple rowgroups, it was not able to prune one
rowgroup from the file. Now, when the filter find that a rowgroup
doesn't match it will be remove from the scan.

closes #949

4 years agoDRILL-5923: Display name for query state
Prasad Nagaraj Subramanya [Thu, 9 Nov 2017 23:00:15 +0000 (15:00 -0800)] 
DRILL-5923: Display name for query state

closes #1021

4 years agoDRILL-5921: Display counter metrics in table
Prasad Nagaraj Subramanya [Thu, 9 Nov 2017 07:18:42 +0000 (23:18 -0800)] 
DRILL-5921: Display counter metrics in table

closes #1020

4 years agoDRILL-5909: Added new Counter metrics
Prasad Nagaraj Subramanya [Wed, 1 Nov 2017 20:49:43 +0000 (13:49 -0700)] 
DRILL-5909: Added new Counter metrics

closes #1019

4 years agoDRILL-5899: Simple pattern matchers can work with DrillBuf directly
Padma Penumarthy [Wed, 25 Oct 2017 20:37:25 +0000 (13:37 -0700)] 
DRILL-5899: Simple pattern matchers can work with DrillBuf directly

closes #1015

4 years agoDRILL-5896: Handle HBase columns vector creation in the HBaseRecordReader
Prasad Nagaraj Subramanya [Thu, 26 Oct 2017 04:20:07 +0000 (21:20 -0700)] 
DRILL-5896: Handle HBase columns vector creation in the HBaseRecordReader

closes #1005

4 years agoDRILL-5863: Sortable table incorrectly sorts fragments/time lexically
Kunal Khatua [Thu, 12 Oct 2017 04:35:47 +0000 (21:35 -0700)] 
DRILL-5863: Sortable table incorrectly sorts fragments/time lexically

The DataTables jQuery library sorts data based on the value of the element in a column.
However, since Drill publishes sortable items like fragment IDs and time durations as non-numeric text, the sorting is incorrect.
This PR fixes the fragment and duration ordering based on their implicit numeric values (minor ID and millisecond representation, respectively).
Support memory chaining

closes #987

4 years agoDRILL-5822: The query with "SELECT *" with "ORDER BY" clause and `planner.slice_targe...
Vitalii Diravka [Thu, 26 Oct 2017 18:07:33 +0000 (18:07 +0000)] 
DRILL-5822: The query with "SELECT *" with "ORDER BY" clause and `planner.slice_target`=1 doesn't preserve column order

- The commit for DRILL-847 is oudated. There is no need to canonicalize the batch or container since RecordBatchLoader
  swallows the "schema change" for now if two batches have different column ordering.

  closes #1017

4 years agoDRILL-5717: Let some test cases be Local or TimeZone independent.
weijie.tong [Sun, 20 Aug 2017 12:07:41 +0000 (20:07 +0800)] 
DRILL-5717: Let some test cases be Local or TimeZone independent.

closes #904

4 years agoDRILL-5337: OpenTSDB storage plugin
Vlad Storona [Fri, 25 Nov 2016 18:28:02 +0000 (20:28 +0200)] 
DRILL-5337: OpenTSDB storage plugin

closes #774

4 years agoDRILL-5834: Add Networking Functions
cgivre [Wed, 1 Nov 2017 18:15:38 +0000 (14:15 -0400)] 
DRILL-5834: Add Networking Functions

close apache/drill#1018

4 years agoDRILL-5878: TableNotFound exception is being reported for a wrong storage plugin.
Hanumath Rao Maduri [Sat, 16 Sep 2017 23:54:00 +0000 (16:54 -0700)] 
DRILL-5878: TableNotFound exception is being reported for a wrong storage plugin.

Address review comments.

4 years agoDRILL-5864: Selecting a non-existing field from a MapR-DB JSON table fails with NPE.
Hanumath Rao Maduri [Thu, 12 Oct 2017 00:07:22 +0000 (17:07 -0700)] 
DRILL-5864: Selecting a non-existing field from a MapR-DB JSON table fails with NPE.

4 years agoDRILL-5911: Upgrade esri-geometry-api version to 2.0.0 to avoid dependency on org...
Volodymyr Vysotskyi [Fri, 27 Oct 2017 14:45:17 +0000 (14:45 +0000)] 
DRILL-5911: Upgrade esri-geometry-api version to 2.0.0 to avoid dependency on org.json library

closes #1012

4 years agoDRILL-5910: Logging exception when custom AuthenticatorFactory not found
vladimir [Fri, 27 Oct 2017 08:32:32 +0000 (11:32 +0300)] 
DRILL-5910: Logging exception when custom AuthenticatorFactory not found

closes #1013

4 years agoDRILL-5906: java.lang.NullPointerException while quering Hive ORC tables on MapR...
Vitalii Diravka [Wed, 25 Oct 2017 17:59:09 +0000 (17:59 +0000)] 
DRILL-5906: java.lang.NullPointerException while quering Hive ORC tables on MapR cluster

- Upgrade drill to 1.2.0-mapr-1707 hive.version.

closes #1010

4 years agoDRILL-5905: Exclude jdk-tools from project dependencies
Vlad Rozov [Wed, 25 Oct 2017 02:10:37 +0000 (19:10 -0700)] 
DRILL-5905: Exclude jdk-tools from project dependencies

closes #1009

4 years agoDRILL-5895: Add logging mongod exception when failed to close all mongod processes...
Volodymyr Tkach [Mon, 23 Oct 2017 09:10:57 +0000 (09:10 +0000)] 
DRILL-5895: Add logging mongod exception when failed to close all mongod processes during provided timeout

closes #1006

4 years agoDRILL-5887: Display process user/groups info in Drill UI
Prasad Nagaraj Subramanya [Thu, 26 Oct 2017 00:03:26 +0000 (17:03 -0700)] 
DRILL-5887: Display process user/groups info in Drill UI

closes #998

4 years agoDRILL-5874: NPE in AnonWebUserConnection.cleanupSession()
Sorabh Hamirwasia [Wed, 11 Oct 2017 22:57:21 +0000 (15:57 -0700)] 
DRILL-5874: NPE in AnonWebUserConnection.cleanupSession()

closes #993

4 years agoDRILL-5772: Enable UTF-8 support in query string by default
Arina Ielchiieva [Thu, 7 Sep 2017 15:15:14 +0000 (18:15 +0300)] 
DRILL-5772: Enable UTF-8 support in query string by default

1. Bump up Drill Calcite version to in include CALCITE-2014 changes.
2. Add saffron.properties file to the Drill conf folder.
3. Add appopriate unit tests.

closes #936

4 years agoDRILL-5890: Fixed a file descriptor leak in Drill's test-suite
Salim Achouche [Tue, 24 Oct 2017 17:12:19 +0000 (10:12 -0700)] 
DRILL-5890: Fixed a file descriptor leak in Drill's test-suite

This closes #1008

4 years agoDRILL-5876: Use openssl profile to include netty-tcnative dependency with the platfor...
Vlad Rozov [Wed, 18 Oct 2017 22:00:37 +0000 (15:00 -0700)] 
DRILL-5876: Use openssl profile to include netty-tcnative dependency with the platform specific classifier

This closes #1004

4 years agoDRILL-5893: Reverted the number of forked test processes back to 2
Timothy Farkas [Thu, 19 Oct 2017 17:57:05 +0000 (10:57 -0700)] 
DRILL-5893: Reverted the number of forked test processes back to 2

This closes #1003

4 years agoDRILL-5888: Remove dependency of SSLConfig on hadoop.security package. This allows...
Parth Chandra [Wed, 18 Oct 2017 00:14:20 +0000 (17:14 -0700)] 
DRILL-5888: Remove dependency of SSLConfig on hadoop.security package. This allows jdbc-all-jar to be built without hadoop dependencies

This closes #1002

4 years agoDRILL-5873: (C++ Client) Improve SASL error reporting.
Parth Chandra [Fri, 13 Oct 2017 18:00:31 +0000 (11:00 -0700)] 
DRILL-5873: (C++ Client) Improve SASL error reporting.

This closes #992

4 years agoDRILL-5862 Update project parent pom xml to the latest ASF version
Vlad Rozov [Wed, 11 Oct 2017 15:05:25 +0000 (08:05 -0700)] 
DRILL-5862 Update project parent pom xml to the latest ASF version

This closes #985

4 years agoDRILL-5845: Columns returned by select with "ORDER BY" and "LIMIT" clauses are not...
Vitalii Diravka [Mon, 9 Oct 2017 11:27:58 +0000 (11:27 +0000)] 
DRILL-5845: Columns returned by select with "ORDER BY" and "LIMIT" clauses are not in correct order.

This closes #1000

4 years agoDRILL-5582: C++ Client: [Threat Modeling] Drillbit may be spoofed by an attacker...
karthik [Tue, 17 Oct 2017 23:18:45 +0000 (16:18 -0700)] 
DRILL-5582: C++ Client: [Threat Modeling] Drillbit may be spoofed by an attacker and this may lead to data being written to the attacker's target instead of Drillbit

This closes #997

4 years agoDRILL-5881:Java Client: [Threat Modeling] Drillbit may be spoofed by an attacker...
Sorabh Hamirwasia [Mon, 16 Oct 2017 21:58:31 +0000 (14:58 -0700)] 
DRILL-5881:Java Client: [Threat Modeling] Drillbit may be spoofed by an attacker and this may lead to data being written to the attacker's target instead of Drillbit
 Also set connection to null after its closed

This closes #999

4 years agoDRILL-5877: - Fix travis build. Add *.pem and *.p12 files to rat exclusions.
Parth Chandra [Mon, 16 Oct 2017 18:54:53 +0000 (11:54 -0700)] 
DRILL-5877: - Fix travis build. Add *.pem and *.p12 files to rat exclusions.

This closes #995

4 years agoDRILL-5790: Fixed problem with explicit opening a local file
Vlad Storona [Thu, 12 Oct 2017 10:16:19 +0000 (13:16 +0300)] 
DRILL-5790: Fixed problem with explicit opening a local file

closes #989

4 years agoDRILL-5853 : Update Calcite to get NULL direction for sort removal
Gautam Parai [Sat, 7 Oct 2017 01:48:42 +0000 (18:48 -0700)] 
DRILL-5853 : Update Calcite to get NULL direction for sort removal

closes #979

4 years agoDRILL-5743: Handling column family and column scan for hbase
Prasad Nagaraj Subramanya [Sat, 7 Oct 2017 04:17:57 +0000 (21:17 -0700)] 
DRILL-5743: Handling column family and column scan for hbase

closes #975

4 years agoDRILL-5838: Fix MaprDB filter pushdown for the case of nested field (reg. of DRILL...
Volodymyr Vysotskyi [Tue, 26 Sep 2017 16:37:03 +0000 (16:37 +0000)] 
DRILL-5838: Fix MaprDB filter pushdown for the case of nested field (reg. of DRILL-4264)

Use FieldPath.asPathString() method instead of creating custom string representation of SchemaPath

closes #972

4 years agoDRILL-5815: Option to set query memory as percent of total
Paul Rogers [Tue, 26 Sep 2017 00:04:41 +0000 (17:04 -0700)] 
DRILL-5815: Option to set query memory as percent of total

closes #960

4 years agoDRILL-5431: Regenerate protobuf files
Parth Chandra [Wed, 11 Oct 2017 23:18:39 +0000 (16:18 -0700)] 
DRILL-5431: Regenerate protobuf files

This closes #950

4 years agoDRILL-5431: SSL Support (C++) - Fix Sasl on Windows to build from source (instead...
Parth Chandra [Mon, 31 Jul 2017 20:28:24 +0000 (13:28 -0700)] 
DRILL-5431: SSL Support (C++) - Fix Sasl on Windows to build from source (instead of install) directory

4 years agoDRILL-5431: SSL Support (C++) - Update DrillClientImpl to use Channel implementation
Parth Chandra [Mon, 24 Jul 2017 19:55:02 +0000 (12:55 -0700)] 
DRILL-5431: SSL Support (C++) - Update DrillClientImpl to use Channel implementation

Also remove ChannelContextFactory and merge it into ChannelFactory

4 years agoDRILL-5431: SSL Support (C++) - Add (Netty like) socket abstraction that encapsulates...
Parth Chandra [Tue, 25 Jul 2017 16:22:23 +0000 (09:22 -0700)] 
DRILL-5431: SSL Support (C++) - Add (Netty like) socket abstraction that encapsulates a TCP socket or a SSL Stream on TCP.

The testSSL program tests the client connection against a drillbit by sending a drill handshake.

4 years agoDRILL-5431: SSL Support (C++) - Add boost example code for ssl (small change to the...
Parth Chandra [Tue, 11 Jul 2017 00:19:12 +0000 (17:19 -0700)] 
DRILL-5431: SSL Support (C++) - Add boost example code for ssl (small change to the code to pick up the certificate and key files from the test dir). Useful to test the ssl environment.

4 years agoDRILL-5431: SSL Support (C++) - Refactoring of C++ client.
Parth Chandra [Wed, 7 Jun 2017 18:09:10 +0000 (11:09 -0700)] 
DRILL-5431: SSL Support (C++) - Refactoring of C++ client.

    Move classes out of drillclient to their own files
    Fix build on MacOS to suppress warnings from boost code
    Refactoring of user properties to use a map

4 years agoDRILL-5431: SSL Support (Java) - Fix display of client-server encryption status in GUI
Parth Chandra [Wed, 20 Sep 2017 20:35:22 +0000 (13:35 -0700)] 
DRILL-5431: SSL Support (Java) - Fix display of client-server encryption status in GUI

4 years agoDRILL-5431: SSL Support (Java) - Java client server SSL implementation
Parth Chandra [Sat, 10 Jun 2017 05:03:59 +0000 (22:03 -0700)] 
DRILL-5431: SSL Support (Java) - Java client server SSL implementation

Also enable OpenSSL support

Also fix exclusions and java-exec pom file to eliminate netty-tcnative as a transitive dependency on all projects

4 years agoDRILL-5431: Update POM to upgrade to Netty 4.0.48 and add exclusions to all modules...
Parth Chandra [Fri, 16 Jun 2017 23:49:45 +0000 (16:49 -0700)] 
DRILL-5431: Update POM to upgrade to Netty 4.0.48 and add exclusions to all modules that included older versions of Netty

4 years agoDRILL-5431: Upgrade Netty to 4.0.47
Sudheesh Katkam [Tue, 16 May 2017 21:48:57 +0000 (14:48 -0700)] 
DRILL-5431: Upgrade Netty to 4.0.47

4 years agoDRILL-5431: SSL Support (Java) - Add test certificates, keys, keystore, and truststore.
Parth Chandra [Tue, 25 Jul 2017 16:21:02 +0000 (09:21 -0700)] 
DRILL-5431: SSL Support (Java) - Add test certificates, keys, keystore, and truststore.

4 years agoDRILL-5698: Revert unnecessary changes to C++ client
Parth Chandra [Mon, 28 Aug 2017 17:08:15 +0000 (10:08 -0700)] 
DRILL-5698: Revert unnecessary changes to C++ client

4 years agoDRILL-5865: fix build
Parth Chandra [Wed, 11 Oct 2017 23:40:12 +0000 (16:40 -0700)] 
DRILL-5865: fix build

closes #986

4 years agoDRILL-5819: Default value of security.admin.user_groups and security.admin.users...
karthik [Wed, 4 Oct 2017 18:23:04 +0000 (11:23 -0700)] 
DRILL-5819: Default value of security.admin.user_groups and security.admin.users is true

closes #983

4 years agoDRILL-5775: Select * query on a maprdb binary table fails
Vitalii Diravka [Mon, 2 Oct 2017 14:14:54 +0000 (14:14 +0000)] 
DRILL-5775: Select * query on a maprdb binary table fails

- The common HBase/MapR-DB_binary verifyColumns() method;
- MapRDBBinaryTable is introduced for the purpose of expanding the wildcard on the planning stage;
- AbstractHBaseDrillTable class for MapRDBBinaryTable and DrillHBaseTable.

closes #973

4 years agoDRILL-5830: Resolve regressions to MapR DB from DRILL-5546
Paul Rogers [Thu, 28 Sep 2017 16:49:38 +0000 (09:49 -0700)] 
DRILL-5830: Resolve regressions to MapR DB from DRILL-5546

- Back out HBase changes
- Code cleanup
- Test utilities
- Fix for DRILL-5829

closes #968

4 years agoDRILL-5808: Reduce memory allocator strictness for "managed" operators
Paul Rogers [Sun, 24 Sep 2017 19:51:43 +0000 (12:51 -0700)] 
DRILL-5808: Reduce memory allocator strictness for "managed" operators

closes #958

4 years agoDRILL-5859: Fixed queued time calculation
Prasad Nagaraj Subramanya [Tue, 10 Oct 2017 18:12:03 +0000 (11:12 -0700)] 
DRILL-5859: Fixed queued time calculation

closes #982

4 years agoDRILL-5854: IllegalStateException when empty batch with valid schema is received
Padma Penumarthy [Mon, 9 Oct 2017 22:05:17 +0000 (15:05 -0700)] 
DRILL-5854: IllegalStateException when empty batch with valid schema is received

closes #981

4 years agoDRILL-5857: Fix NumberFormatException in Hive unit tests
Volodymyr Vysotskyi [Mon, 9 Oct 2017 14:28:42 +0000 (14:28 +0000)] 
DRILL-5857: Fix NumberFormatException in Hive unit tests

closes #980

4 years agoDRILL-5849: Add freemarker lib to dependencyManagement to ensure proper version is...
Arina Ielchiieva [Fri, 6 Oct 2017 13:58:28 +0000 (16:58 +0300)] 
DRILL-5849: Add freemarker lib to dependencyManagement to ensure proper version is used when resolving dependency version conflicts

closes #977

4 years agoDRILL-5645: negation of expression causes null pointer exception
Josiah Yan [Wed, 2 Aug 2017 14:50:54 +0000 (22:50 +0800)] 
DRILL-5645: negation of expression causes null pointer exception

closes #892

4 years agoDRILL-5716: Queue-driven memory allocation
Paul Rogers [Wed, 30 Aug 2017 21:32:17 +0000 (14:32 -0700)] 
DRILL-5716: Queue-driven memory allocation

* Creates new core resource management and query queue abstractions.
* Adds queue information to the Protobuf layer.
* Foreman and Planner changes

- Abstracts memory management out to the new resource management layer.
This means deferring generating the physical plan JSON to later in the
process after memory planning.

* Web UI changes

* Adds queue information to the main page and the profile page to each
query.
* Also sorts the list of options displayed in the Web UI.

- Added memory reserve

A new config parameter, exec.queue.memory_reserve_ratio, sets aside a
slice of total memory for operators that do not participate in the
memory assignment process. The default is 20% testing will tell us if
that value should be larger or smaller.

* Additional minor fixes

- Code cleanup.
- Added mechanism to abandon lease release during shutdown.
- Log queue configuration only when the config changes, rather than on
every query.
- Apply Boaz’ option to enforce a minimum memory allocation per
operator.
- Additional logging to help testers see what is happening.

closes #928

4 years agoDRILL-5839: Handle Empty Batches in Merge Receiver
Padma Penumarthy [Sun, 1 Oct 2017 00:33:17 +0000 (17:33 -0700)] 
DRILL-5839: Handle Empty Batches in Merge Receiver

closes #974

4 years agoDRILL-5752 this change includes:
Timothy Farkas [Wed, 30 Aug 2017 19:53:49 +0000 (12:53 -0700)] 
DRILL-5752 this change includes:

  1. Increased test parallelism and fixed associated bugs
  2. Added test categories and categorized tests appropriately

- Don't exclude anything by default
- Increase test timeout
- Fixed flakey test

closes #940

4 years agoDRILL-5259: Allow listing a user-defined number of profiles
Kunal Khatua [Mon, 2 Oct 2017 20:07:54 +0000 (13:07 -0700)] 
DRILL-5259: Allow listing a user-defined number of profiles

Added an additional field in the UI allowing a user to specify the max number of profiles to load via Refresh

closes #963

4 years agoDRILL-5802: Provide a sortable table for tables within a query profile
Kunal Khatua [Tue, 3 Oct 2017 04:34:01 +0000 (21:34 -0700)] 
DRILL-5802: Provide a sortable table for tables within a query profile

Using the DataTables jQuery library, we can now sort tables (fragments and operators) to group like values or sort on a column.
In addition, additional tooltips have been provided for these columns

closes #969

4 years agoDRILL-5564: Added finally block for stopWait() to avoid all situations where Drill...
Roman Kulyk [Fri, 29 Sep 2017 17:26:39 +0000 (17:26 +0000)] 
DRILL-5564: Added finally block for stopWait() to avoid all situations where Drill able to miss stopWait() in case of exceptions (it can lead to assertions).

closes #967

4 years agoDRILL-5824: Retain original memory limit for 1st phase HashAgg with 1 partition
Ben-Zvi [Fri, 29 Sep 2017 00:09:53 +0000 (17:09 -0700)] 
DRILL-5824: Retain original memory limit for 1st phase HashAgg with 1 partition

closes #966

4 years agoDRILL-5811 reduced repeated log messages further.
Timothy Farkas [Thu, 28 Sep 2017 19:56:18 +0000 (12:56 -0700)] 
DRILL-5811 reduced repeated log messages further.

closes #965

4 years agoDRILL-5755 Reduced default number of batches kept in memory by the TopN operator.
Timothy Farkas [Thu, 21 Sep 2017 22:59:58 +0000 (15:59 -0700)] 
DRILL-5755 Reduced default number of batches kept in memory by the TopN operator.

closes #964

4 years agoDRILL-5820: Add support for libpam4j Pam Authenticator
Sorabh Hamirwasia [Thu, 21 Sep 2017 00:38:08 +0000 (17:38 -0700)] 
DRILL-5820: Add support for libpam4j Pam Authenticator

closes #962

4 years agoDRILL-5792: CONVERT_FROM_JSON on an empty file throws runtime exception
Vitalii Diravka [Tue, 26 Sep 2017 11:06:45 +0000 (04:06 -0700)] 
DRILL-5792: CONVERT_FROM_JSON on an empty file throws runtime exception

closes #961

4 years agoDRILL-5816: Hash function produces skewed results on String values with same leading...
Sorabh Hamirwasia [Fri, 15 Sep 2017 22:07:50 +0000 (15:07 -0700)] 
DRILL-5816: Hash function produces skewed results on String values with same leading prefix
            Note: Changing hash32 computation to use Murmur3.hash32 instead of int casted version of Murmur3.hash64

closes #959