hive.git
12 months agoUpdate storage-api to 2.8.0 storage-release-2.8.0-rc0
Owen O'Malley [Fri, 18 Jun 2021 17:27:34 +0000 (10:27 -0700)] 
Update storage-api to 2.8.0

12 months agoPreparing for storage-api 2.7.3 release storage-release-2.7.3-rc0
Panagiotis Garefalakis [Mon, 7 Jun 2021 18:16:03 +0000 (19:16 +0100)] 
Preparing for storage-api 2.7.3 release

Change-Id: I62e79331e02d94418999344f786c2dc916d3c241

12 months agoHIVE-25179: Support all partition transforms for Iceberg in create table (#2333)...
László Pintér [Mon, 7 Jun 2021 12:34:10 +0000 (14:34 +0200)] 
HIVE-25179: Support all partition transforms for Iceberg in create table (#2333) (Laszlo Pinter, reviewed by Adam Szita, Marton Bod and Peter Vary)

12 months agoHIVE-24663 : Reduce overhead of partition column stat updation during batch loading...
mahesh kumar behera [Mon, 7 Jun 2021 12:03:39 +0000 (17:33 +0530)] 
HIVE-24663 : Reduce overhead of partition column stat updation during batch loading of partitions. (Mahesh Kumar Behera, reviewed by Denys Kuzmenko)

12 months agoHIVE-25117: Vector PTF ClassCastException with Decimal64 (#2286)
Ramesh Kumar [Mon, 7 Jun 2021 09:33:52 +0000 (02:33 -0700)] 
HIVE-25117: Vector PTF ClassCastException with Decimal64 (#2286)

12 months agoHIVE-25203: HiveQueryResultSet and client operation are not expected to be closed...
Bodor Laszlo [Mon, 7 Jun 2021 09:33:05 +0000 (11:33 +0200)] 
HIVE-25203: HiveQueryResultSet and client operation are not expected to be closed twice (#2353) (Laszlo Bodor reviewed by Prasanth Jayachandran, Panagiotis Garefalakis)

12 months agoHIVE-25180: Update netty to 4.1.60.Final (#2345)
csjuhasz-c [Mon, 7 Jun 2021 08:47:49 +0000 (10:47 +0200)] 
HIVE-25180: Update netty to 4.1.60.Final (#2345)

13 months agoHIVE-25165. Generate & track statistics per event type for incremental load in replic...
Ayush Saxena [Sun, 6 Jun 2021 10:16:52 +0000 (15:46 +0530)] 
HIVE-25165. Generate & track statistics per event type for incremental load in replication metrics. (#2321)(Ayush Saxena, reviewed by Aasha Medhi)

* HIVE-25165. Generate & track statistics per event type for incremental load in replication metrics.

* Add Fallback Value.

* Add NoOpReplStat tracker and thread safety.

13 months agoHIVE-25133. Allow custom configs for database level paths in external table replicati...
Ayush Saxena [Sun, 6 Jun 2021 10:13:03 +0000 (15:43 +0530)] 
HIVE-25133. Allow custom configs for database level paths in external table replication. (#2296)(Ayush Saxena, reviewed by Aasha Medhi)

* HIVE-25133. Allow custom configs for database level paths in external table replication.

* Fix Test.

* Add in description.

13 months agoHIVE-24987: Introduce a exception list to skip incompatible column change check ...
Vihang Karajgaonkar [Fri, 4 Jun 2021 22:23:07 +0000 (15:23 -0700)] 
HIVE-24987: Introduce a exception list to skip incompatible column change check (Vihang Karajgaonkar, reviewed by Yongzhi Chen)

Closes (#2336 )

13 months agoHIVE-25183: Inner Join condition parsing error in subquery (Soumyakanti Das, reviewed...
Soumyakanti Das [Fri, 4 Jun 2021 18:39:08 +0000 (14:39 -0400)] 
HIVE-25183: Inner Join condition parsing error in subquery (Soumyakanti Das, reviewed by Jesus Camacho Rodriguez)

Closes apache/hive#2302

13 months agoHIVE-25104: Backward incompatible timestamp serialization in Parquet for certain...
Stamatis Zampetakis [Fri, 4 Jun 2021 18:36:26 +0000 (20:36 +0200)] 
HIVE-25104: Backward incompatible timestamp serialization in Parquet for certain timezones (Stamatis Zampetakis, reviewed by Jesus Camacho Rodriguez)

Closes apache/hive#2282

13 months agoHIVE-23756: Added more constraints to the package.jdo file (Stephen Carlin, reviewed...
scarlin-cloudera [Fri, 4 Jun 2021 17:48:18 +0000 (10:48 -0700)] 
HIVE-23756: Added more constraints to the package.jdo file (Stephen Carlin, reviewed by Jesus Camacho Rodriguez)

Closes apache/hive#2340

13 months agoHIVE-25163 UnsupportedTemporalTypeException when starting llap (#2322)
Istvan Toth [Fri, 4 Jun 2021 10:52:37 +0000 (12:52 +0200)] 
HIVE-25163 UnsupportedTemporalTypeException when starting llap (#2322)

### What changes were proposed in this pull request?
Use LocalDateTime instead of Instant to generate an llap version string when HIVE_VERSION is not set.

### Why are the changes needed?
The current code throws a  java.time.temporal.UnsupportedTemporalTypeException,
making it impossible to start the llap jobs when HIVE_VERSION  is not set.

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
Built Hive and started llap successfully

13 months agoHIVE-25178 : Reduce number of getPartition calls during loadDynamicPartitions for...
vnhive [Wed, 2 Jun 2021 11:00:19 +0000 (16:30 +0530)] 
HIVE-25178 : Reduce number of getPartition calls during loadDynamicPartitions for External Tables (#2338)(Narayanan Venkateswaran, reviewed by  Rajesh Balamohan)

13 months agoHIVE-25159:Remove support for ordered results in llap external client library (Shubha...
Anishek Agarwal [Wed, 2 Jun 2021 09:51:38 +0000 (15:21 +0530)] 
HIVE-25159:Remove support for ordered results in llap external client library (Shubham Chaurasia, reviewed by Harish JP, Anishek Agarwal)

13 months agoHIVE-25166: Query with multiple count(distinct constant) fails (Krisztian Kasa, revie...
Krisztian Kasa [Wed, 2 Jun 2021 06:57:09 +0000 (08:57 +0200)] 
HIVE-25166: Query with multiple count(distinct constant) fails (Krisztian Kasa, reviewed by Jesus Camacho Rodriguez)

13 months agoHIVE-25161: Implement partitioned CTAS for iceberg tables (#2316) (Marton Bod, review...
Marton Bod [Tue, 1 Jun 2021 14:15:30 +0000 (16:15 +0200)] 
HIVE-25161: Implement partitioned CTAS for iceberg tables (#2316) (Marton Bod, reviewed by Peter Vary and Laszlo Pinter)

13 months agoHIVE-24920: TRANSLATED_TO_EXTERNAL tables may write to the same location (#2191)...
Zoltan Haindrich [Tue, 1 Jun 2021 13:50:22 +0000 (15:50 +0200)] 
HIVE-24920: TRANSLATED_TO_EXTERNAL tables may write to the same location (#2191) (Zoltan Haindrich reviewed by Naveen Gangam)

13 months agoHIVE-25162: Add support for CREATE TABLE ... STORED BY ICEBERG statements (#2317...
László Pintér [Mon, 31 May 2021 07:37:05 +0000 (10:37 +0300)] 
HIVE-25162: Add support for CREATE TABLE ... STORED BY ICEBERG statements (#2317) (Laszlo Pinter, reviewed by Marton Bod and Peter Vary)

13 months agoHIVE-25177: Add Additional Debugging Help for HBase Reader (David Mollitor reviewed...
belugabehr [Sat, 29 May 2021 18:29:26 +0000 (14:29 -0400)] 
HIVE-25177: Add Additional Debugging Help for HBase Reader (David Mollitor reviewed by Miklos Gergely)

13 months agoHIVE-25057: Implement rollback for hive to iceberg migration (#2219) (Laszlo Pinter...
László Pintér [Sat, 29 May 2021 16:56:34 +0000 (19:56 +0300)] 
HIVE-25057: Implement rollback for hive to iceberg migration (#2219) (Laszlo Pinter, reviewed by Marton Bod and Peter Vary)

13 months agoHIVE-25176: Print DAG ID to Console (David Mollitor reviewed by Miklos Gergely)
belugabehr [Sat, 29 May 2021 14:11:01 +0000 (10:11 -0400)] 
HIVE-25176: Print DAG ID to Console (David Mollitor reviewed by Miklos Gergely)

13 months agoHIVE-25102: Cache Iceberg table objects within same query (#2261) (Laszlo Pinter...
László Pintér [Fri, 28 May 2021 16:07:39 +0000 (19:07 +0300)] 
HIVE-25102: Cache Iceberg table objects within same query (#2261) (Laszlo Pinter, reviewed by Marton Bod and Peter Vary)

13 months agoHIVE-25155: Bump ORC to 1.6.8 (#2313)
Panagiotis Garefalakis [Thu, 27 May 2021 16:18:13 +0000 (17:18 +0100)] 
HIVE-25155: Bump ORC to 1.6.8 (#2313)

13 months agoHIVE-25062 Iceberg: Fix date partition transform insert issue (Peter Vary reviewed...
pvary [Thu, 27 May 2021 10:38:27 +0000 (12:38 +0200)] 
HIVE-25062 Iceberg: Fix date partition transform insert issue (Peter Vary reviewed by Marton Bod and Laszlo Pinter)

Closes #2228

13 months agoHIVE-24537: Optimise locking in LlapTaskSchedulerService (#2224)
Panagiotis Garefalakis [Wed, 26 May 2021 13:22:35 +0000 (14:22 +0100)] 
HIVE-24537: Optimise locking in LlapTaskSchedulerService (#2224)

### What changes were proposed in this pull request?
Optimise locking in LlapTaskSchedulerService

### Why are the changes needed?
Perf optimization

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
TestLlapTaskSchedulerService

13 months agoHIVE-25160: Automatically pass on iceberg-handler jar as job dependency (Adam Szita...
Adam Szita [Wed, 26 May 2021 09:34:21 +0000 (11:34 +0200)] 
HIVE-25160: Automatically pass on iceberg-handler jar as job dependency (Adam Szita, reviewed by Laszlo Pinter and Peter Vary)

13 months agoHIVE-24956: Add debug logs for time taken in the incremental event processing (Arko...
ArkoSharma [Wed, 26 May 2021 07:35:06 +0000 (13:05 +0530)] 
HIVE-24956: Add debug logs for time taken in the incremental event processing (Arko Sharma, reviewed by Pravin Kumar Sinha)

13 months agoHIVE-25112: Simplify TXN Compactor Heartbeat Thread (David Mollitor reviewed by Karen...
belugabehr [Tue, 25 May 2021 22:03:12 +0000 (18:03 -0400)] 
HIVE-25112: Simplify TXN Compactor Heartbeat Thread (David Mollitor reviewed by Karen Coppage)

13 months agoHIVE-24761: Support vectorization for bounded windows in PTF (#2099) (Laszlo Bodor...
Bodor Laszlo [Tue, 25 May 2021 21:57:50 +0000 (23:57 +0200)] 
HIVE-24761: Support vectorization for bounded windows in PTF (#2099) (Laszlo Bodor reviewed by Ramesh Kumar Thangarajan)

13 months agoHIVE-25132: HiveOperationType should be ReadDatabases for default policy in ranger...
Sai Hemanth Gantasala [Tue, 25 May 2021 16:31:41 +0000 (09:31 -0700)] 
HIVE-25132: HiveOperationType should be ReadDatabases for default policy in ranger (#2294) (Sai Hemanth Gantasala, reviewed by Yongzhi Chen)

13 months agoHIVE-25113: Connection starvation in TxnHandler.getValidWriteIds (#2272) (Yu-Wen...
hsnusonic [Tue, 25 May 2021 16:29:13 +0000 (09:29 -0700)] 
HIVE-25113: Connection starvation in TxnHandler.getValidWriteIds (#2272) (Yu-Wen Lai, reviewed by Denys Kuzmenko  and Kishen Das )

* Pass dbConn to the function getOpenTxns so that it doesn't request another connection from pool
* Add a test that set connection pool size to 1

13 months agoHIVE-25080: Create metric about oldest entry in "ready for cleaning" state (Antal...
Antal Sinkovits [Tue, 25 May 2021 08:51:46 +0000 (10:51 +0200)] 
HIVE-25080: Create metric about oldest entry in "ready for cleaning" state (Antal Sinkovits, reviewed by Karen Coppage)

Closes #2297.

13 months agoHIVE-24810: Use JDK 8 String Switch in TruncDateFromTimestamp (David Mollitor reviewe...
belugabehr [Mon, 24 May 2021 15:33:36 +0000 (11:33 -0400)] 
HIVE-24810: Use JDK 8 String Switch in TruncDateFromTimestamp (David Mollitor reviewed by Panagiotis Garefalakis)

13 months agoHIVE-25151: Remove Unused Interner from HiveMetastoreChecker (David Mollitor reviewed...
belugabehr [Mon, 24 May 2021 00:34:14 +0000 (20:34 -0400)] 
HIVE-25151: Remove Unused Interner from HiveMetastoreChecker (David Mollitor reviewed by Miklos Gergely)

13 months agoHIVE-25152: Remove Superfluous Logging Code (David Mollitor reviewed by Miklos Gergel...
belugabehr [Mon, 24 May 2021 00:33:10 +0000 (20:33 -0400)] 
HIVE-25152: Remove Superfluous Logging Code (David Mollitor reviewed by Miklos Gergely and Panagiotis Garefalakis)

13 months agoHIVE-25142 : Rehashing in map join fast hash table causing corruption for large keys...
mahesh kumar behera [Sat, 22 May 2021 10:27:48 +0000 (15:57 +0530)] 
HIVE-25142 : Rehashing in map join fast hash table causing corruption for large keys (#2300)

(Mahesh Kumar Behera, reviewed by Pravin Kumar Sinha and Panagiotis Garefalakis)

13 months agoHIVE-25054: Upgrade `jodd-core` dependency to get rid of CVE-2018-21234 (Abhay Chenna...
achennagiri [Fri, 21 May 2021 19:20:40 +0000 (12:20 -0700)] 
HIVE-25054: Upgrade `jodd-core` dependency to get rid of CVE-2018-21234 (Abhay Chennagiri, reviewed by Jesus Camacho Rodriguez)

Closes apache/hive#2217

13 months agoHIVE-25034: Implement unpartitioned CTAS for Iceberg (#2243) (Marton Bod, reviewed...
Marton Bod [Fri, 21 May 2021 09:52:23 +0000 (11:52 +0200)] 
HIVE-25034: Implement unpartitioned CTAS for Iceberg (#2243) (Marton Bod, reviewed by Laszlo Pinter and Peter Vary)

13 months agoHIVE-25139: Filter out null table properties in HiveIcebergMetaHook (#2298) (Laszlo...
László Pintér [Fri, 21 May 2021 09:48:00 +0000 (11:48 +0200)] 
HIVE-25139: Filter out null table properties in HiveIcebergMetaHook (#2298) (Laszlo Pinter, reviewed by Marton Bod and Peter Vary)

13 months agoHIVE-25079: Create new metric about number of writes to tables with manually disabled...
Antal Sinkovits [Fri, 21 May 2021 09:19:35 +0000 (11:19 +0200)] 
HIVE-25079: Create new metric about number of writes to tables with manually disabled compaction (Antal Sinkovits, reviewed by Karen Coppage)

Closes #2281.

13 months agoHIVE-24499: Throw error when connector driver jar is not in classpath(Saihemanth...
saihemanth [Tue, 4 May 2021 17:51:36 +0000 (10:51 -0700)] 
HIVE-24499: Throw error when connector driver jar is not in classpath(Saihemanth Gantasala via Naveen Gangam)

13 months agoHIVE-24911: Metastore: Create index on SDS.CD_ID for Postgres (#2090) (Laszlo Bodor...
Bodor Laszlo [Thu, 20 May 2021 14:31:16 +0000 (16:31 +0200)] 
HIVE-24911: Metastore: Create index on SDS.CD_ID for Postgres (#2090) (Laszlo Bodor reviewed by Panagiotis Garefalakis and Attila Magyar)

13 months agoHIVE-25046: Log CBO plans right after major transformations (Stamatis Zampetakis...
Stamatis Zampetakis [Thu, 20 May 2021 13:26:29 +0000 (15:26 +0200)] 
HIVE-25046: Log CBO plans right after major transformations (Stamatis Zampetakis, reviewed by Jesus Camacho Rodriguez)

Change to avoid the following shortcomings:
1. If there is a failure (exception) in some transformation step
intermediate plans are lost, thus losing track of which plan led to the
problem.
2. Intermediate logs are useful for identifying plan problems while
working on a patch; unfortunately the logs are explicitly disabled in
test mode which means that in order to appear the respective code needs
to change every time we need to see those logs.
3. Logging at the end necessitates keeping additional local variables
which makes the code slightly harder to read.

It also adds some additional logging which was not present at all
before.

Closes apache/hive#2205

13 months agoHIVE-25126: Remove Thrift Exceptions From RawStore getCatalogs (David Mollitor review...
belugabehr [Thu, 20 May 2021 13:25:26 +0000 (09:25 -0400)] 
HIVE-25126: Remove Thrift Exceptions From RawStore getCatalogs (David Mollitor reviewed by Miklos Gergely)

13 months agoHIVE-25109: CBO fails when updating table has constraints defined (Krisztian Kasa...
Krisztian Kasa [Thu, 20 May 2021 10:44:43 +0000 (12:44 +0200)] 
HIVE-25109: CBO fails when updating table has constraints defined (Krisztian Kasa, reviewed by Zoltan Haindrich)

13 months agoHIVE-25037: Create metric: Number of tables with > x aborts (Antal Sinkovits, reviewe...
Antal Sinkovits [Thu, 20 May 2021 08:55:00 +0000 (10:55 +0200)] 
HIVE-25037: Create metric: Number of tables with > x aborts (Antal Sinkovits, reviewed by Karen Coppage)

Closes #2199.

13 months agoHIVE-24909: Skip the repl events from getting logged in notification log (Haymant...
Haymant Mangla [Wed, 19 May 2021 15:44:16 +0000 (21:14 +0530)] 
HIVE-24909: Skip the repl events from getting logged in notification log (Haymant Mangla, reviewed by Pravin Kumar Sinha)

13 months agoHIVE-24924. Optimize checkpointing flow in incremental load. (#2105)(Ayush Saxena...
Ayush Saxena [Wed, 19 May 2021 05:17:10 +0000 (10:47 +0530)] 
HIVE-24924. Optimize checkpointing flow in incremental load. (#2105)(Ayush Saxena, reviewed by Aasha Medhi)

13 months agoHIVE-24852. Add support for Snapshots during external table replication. (#2043)...
Ayush Saxena [Tue, 18 May 2021 16:16:51 +0000 (21:46 +0530)] 
HIVE-24852. Add support for Snapshots during external table replication. (#2043)(Ayush Saxena, reviewed by Aasha Medhi)

* HIVE-24852. Add support for Snapshots during external table replication.

* Address Review Comments.

* Review Comm 2

* Add Filter Check.

* Address Review Comments.

13 months agoHIVE-24974: Create new metrics about the number of delta files in the ACID table...
Denys Kuzmenko [Tue, 18 May 2021 15:02:01 +0000 (18:02 +0300)] 
HIVE-24974: Create new metrics about the number of delta files in the ACID table (Denys Kuzmenko, reviewed by Karen Coppage)

Closes (#2148)

13 months agoHIVE-25088: Create qtest-iceberg module inside itests (#2239) (Laszlo Pinter, reviewe...
László Pintér [Tue, 18 May 2021 13:21:30 +0000 (15:21 +0200)] 
HIVE-25088: Create qtest-iceberg module inside itests (#2239) (Laszlo Pinter, reviewed by Adam Szita)

13 months agoHIVE-24840: Materialized View incremental rebuild produces wrong result set after...
Krisztian Kasa [Tue, 18 May 2021 10:08:54 +0000 (12:08 +0200)] 
HIVE-24840: Materialized View incremental rebuild produces wrong result set after compaction ADDENDUM (Krisztian Kasa, reviewed by Jesus Camacho Rodriguez, Peter Vary, Zoltan Haindrich)

13 months agoHIVE-25075: Hive::loadPartitionInternal establishes HMS connection fo… (#2234)
rbalamohan [Mon, 17 May 2021 23:59:35 +0000 (05:29 +0530)] 
HIVE-25075: Hive::loadPartitionInternal establishes HMS connection fo… (#2234)

13 months agoHIVE-25072: Optimise ObjectStore::alterPartitions (#2235)
rbalamohan [Mon, 17 May 2021 23:56:15 +0000 (05:26 +0530)] 
HIVE-25072: Optimise ObjectStore::alterPartitions (#2235)

13 months agoHIVE-21935: Hive Vectorization : degraded performance with vectorize UDF (Mustafa...
Mustafa Iman [Mon, 3 May 2021 23:23:16 +0000 (16:23 -0700)] 
HIVE-21935: Hive Vectorization : degraded performance with vectorize UDF (Mustafa Iman, reviewed by Laszlo Bodor, Panagiotis Garefalakis and Rajesh Balamohan)

Change-Id: I45e89412a1f50f1ab6a2494bb692ef7f4fc58a7e

13 months agoHIVE-25121: Fix qfile results due to disabling discovery.partitions (#2279) (Yu-Wen...
hsnusonic [Mon, 17 May 2021 16:30:42 +0000 (09:30 -0700)] 
HIVE-25121: Fix qfile results due to disabling discovery.partitions (#2279) (Yu-Wen Lai, reviewed by Yongzhi Chen)

13 months agoHIVE-25107: Classpath logging should be on DEBUG level (#2271) (Laszlo Bodor reviewed...
Bodor Laszlo [Mon, 17 May 2021 10:55:07 +0000 (12:55 +0200)] 
HIVE-25107: Classpath logging should be on DEBUG level (#2271) (Laszlo Bodor reviewed by Panagiotis Garefalakis)

13 months agoHIVE-25092. Add a shell script to fetch the statistics of replication data copy tasks...
Ayush Saxena [Sat, 15 May 2021 12:40:37 +0000 (18:10 +0530)] 
HIVE-25092. Add a shell script to fetch the statistics of replication data copy tasks. (#2249)(Ayush Saxena, reviewed by Aasha Medhi)

* HIVE-25092. Add a shell script to fetch the statistics of replication data copy tasks.

* Make Path Optional.

* Added to packaging.

13 months agoHIVE-24816: Jackson version changed to 2.11.0 in the pom files (#2075) (Sai Hemanth...
Sai Hemanth Gantasala [Fri, 14 May 2021 18:59:10 +0000 (11:59 -0700)] 
HIVE-24816: Jackson version changed to 2.11.0 in the pom files (#2075) (Sai Hemanth Gantasala, reviewed by Yongzhi Chen)

13 months agoHIVE-25039: Disabling discovery.partitions config for external tables (#2201) (Sai...
Sai Hemanth Gantasala [Fri, 14 May 2021 18:57:53 +0000 (11:57 -0700)] 
HIVE-25039: Disabling discovery.partitions config for external tables (#2201) (Sai Hemanth Gantasala, reviewed by Yongzhi Chen)

* HIVE-25039: Disabling discovery.partitions config for external tables

* Generated the output with the patch which removes discover.partitions for tables

* Space missing in the output file

13 months agoHIVE-25105: Support Parquet as MV storage format (Jesus Camacho Rodriguez, reviewed...
Jesús Camacho Rodríguez [Fri, 14 May 2021 15:24:33 +0000 (08:24 -0700)] 
HIVE-25105: Support Parquet as MV storage format (Jesus Camacho Rodriguez, reviewed by Krisztian Kasa)

Closes apache/hive#2263

13 months agoHIVE-25116: Exclude slf4j from hive-exec uber Jar included by avatica (Andras Katona...
Andras Katona [Fri, 14 May 2021 11:32:01 +0000 (13:32 +0200)] 
HIVE-25116: Exclude slf4j from hive-exec uber Jar included by avatica (Andras Katona, reviewed by Denys Kuzmenko)

Closes (#2275)

13 months agoHIVE-24596: Explain DDL For Debugging (#2033)
HarshitGupta11 [Thu, 13 May 2021 23:41:39 +0000 (05:11 +0530)] 
HIVE-24596: Explain DDL For Debugging (#2033)

13 months agoHIVE-25108: Do Not Log and Throw MetaExceptions (David Mollitor reviewed by Miklos...
belugabehr [Thu, 13 May 2021 13:18:11 +0000 (09:18 -0400)] 
HIVE-25108: Do Not Log and Throw MetaExceptions (David Mollitor reviewed by Miklos Gergely)

13 months agoDo not exclude avatica and protobuf for Iceberg (#2260) (Marton Bod, reviewed by...
Marton Bod [Wed, 12 May 2021 10:41:14 +0000 (12:41 +0200)] 
Do not exclude avatica and protobuf for Iceberg (#2260) (Marton Bod, reviewed by Laszlo Pinter)

Co-authored-by: Marton Bod <mbod@cloudera.com>
13 months agoHIVE-25044: Parallel edge fixer may not be able to process semijoin edges (#2207...
Zoltan Haindrich [Wed, 12 May 2021 09:33:12 +0000 (11:33 +0200)] 
HIVE-25044: Parallel edge fixer may not be able to process semijoin edges (#2207) (Zoltan Haindrich reviewed by Krisztian Kasa)

13 months agoHIVE-25100: Use default values of Iceberg client pool configuration. (#2258) (Laszlo...
László Pintér [Wed, 12 May 2021 09:20:29 +0000 (11:20 +0200)] 
HIVE-25100: Use default values of Iceberg client pool configuration. (#2258) (Laszlo Pinter, reviewed by Adam Szita and Marton Bod)

13 months agoHIVE-25066: Show whether a materialized view supports incremental review or not ...
Krisztian Kasa [Wed, 12 May 2021 06:14:53 +0000 (08:14 +0200)] 
HIVE-25066: Show whether a materialized view supports incremental review or not (Krisztian Kasa, reviewed by Jesus Camacho Rodriguez)

13 months agoHIVE-25071: Number of reducers limited to fixed 1 when updating/deleting (Krisztian...
Krisztian Kasa [Wed, 12 May 2021 03:43:18 +0000 (05:43 +0200)] 
HIVE-25071: Number of reducers limited to fixed 1 when updating/deleting (Krisztian Kasa, reviewed by Jesus Camacho Rodriguez)

13 months agoHIVE-24451: Added schema changes for MSSQL in External datasource feature (Saihemanth...
saihemanth [Tue, 4 May 2021 17:16:34 +0000 (10:16 -0700)] 
HIVE-24451: Added schema changes for MSSQL in External datasource feature (Saihemanth Gantasal via Naveen Gangam)

13 months agoHIVE-25083: Extra reviewer pattern (#2237)
Panagiotis Garefalakis [Tue, 11 May 2021 14:33:05 +0000 (15:33 +0100)] 
HIVE-25083: Extra reviewer pattern (#2237)

13 months agoHIVE-24883 : Support ARRAY/STRUCT types in equality SMB and Common merge join (Mahes...
mahesh kumar behera [Tue, 11 May 2021 10:03:44 +0000 (15:33 +0530)] 
HIVE-24883 : Support ARRAY/STRUCT  types in equality SMB and Common merge join (Mahesh Kumar Behera, reviewed by Stamatis Zampetakis)

13 months agoHIVE-24730: Shims classes override values from hive-site.xml and tez-site.xml silentl...
Bodor Laszlo [Mon, 10 May 2021 14:10:36 +0000 (16:10 +0200)] 
HIVE-24730: Shims classes override values from hive-site.xml and tez-site.xml silently (#1941) (Laszlo Bodor reviewed by Peter Vary and Mustafa Iman)

13 months agoHIVE-25021: Divide oldest_open_txn into oldest replication and non-replication transa...
Antal Sinkovits [Mon, 10 May 2021 08:42:05 +0000 (10:42 +0200)] 
HIVE-25021: Divide oldest_open_txn into oldest replication and non-replication transactions (Antal Sinkovits, reviewed by Karen Coppage)

Closes #2195.

14 months agoHIVE-25089: Move Materialized View rebuild code to AlterMaterializedViewRebuildAnalyz...
Krisztian Kasa [Fri, 7 May 2021 05:55:19 +0000 (07:55 +0200)] 
HIVE-25089: Move Materialized View rebuild code to AlterMaterializedViewRebuildAnalyzer (Krisztian Kasa, reviewed by Jesus Camacho Rodriguez)

14 months agoImprove Table#getEmptyTable performance by disabling registerAllFunctionsOnce (#2251)
Yuming Wang [Fri, 7 May 2021 05:31:46 +0000 (13:31 +0800)] 
Improve Table#getEmptyTable performance by disabling registerAllFunctionsOnce (#2251)

14 months agoHIVE-24900: Failed compaction does not cleanup the directories (Ramesh Kumar Thangara...
Ramesh Kumar [Tue, 4 May 2021 17:54:11 +0000 (10:54 -0700)] 
HIVE-24900: Failed compaction does not cleanup the directories (Ramesh Kumar Thangarajan, reviewed by Gopal V, Karen Coppage, Peter Varga, Denys Kuzmenko)

Closes (#2086)

14 months agoHIVE-25076: Get number of write tasks from jobConf for Iceberg commits (#2233) (Marto...
Marton Bod [Fri, 30 Apr 2021 11:13:22 +0000 (13:13 +0200)] 
HIVE-25076: Get number of write tasks from jobConf for Iceberg commits (#2233) (Marton Bod, reviewed by Peter Vary)

14 months agoHIVE-25033. HPL/SQL thrift call fails when returning null (amagyar) (Attila Magyar...
Attila Magyar [Fri, 30 Apr 2021 08:18:03 +0000 (10:18 +0200)] 
HIVE-25033. HPL/SQL thrift call fails when returning null (amagyar) (Attila Magyar, reviewed by Mustafa Iman)

14 months agoHIVE-24806: Compactor: Initiator should lazy evaluate findUserToRunAs() (#2229)
rbalamohan [Thu, 29 Apr 2021 22:44:56 +0000 (04:14 +0530)] 
HIVE-24806: Compactor: Initiator should lazy evaluate findUserToRunAs() (#2229)

14 months agoHIVE-24201: WorkloadManager can support delayed move if destination pool does not...
Dawn2111 [Thu, 29 Apr 2021 16:51:59 +0000 (09:51 -0700)] 
HIVE-24201: WorkloadManager can support delayed move if destination pool does not have enough sessions (Pritha Dawn, reviewed by Nikhil Gupta, Sankar Hariappan)

Signed-off-by: Sankar Hariappan <sankarh@apache.org>
Closes (#2065)

14 months agoHIVE-25065: Implement ALTER TABLE for setting iceberg table properties (#2230) (Laszl...
László Pintér [Thu, 29 Apr 2021 16:18:52 +0000 (18:18 +0200)] 
HIVE-25065: Implement ALTER TABLE for setting iceberg table properties (#2230) (Laszlo Pinter, reviewed by Marton Bod and Peter Vary)

14 months agoHIVE-25064: Create separate shader maven module for Iceberg libraries (Adam Szita...
Adam Szita [Thu, 29 Apr 2021 15:40:02 +0000 (17:40 +0200)] 
HIVE-25064: Create separate shader maven module for Iceberg libraries (Adam Szita, reviewed by Marton Bod, Peter Vary and Laszlo Pinter)

14 months agoHIVE-25059. Alter event is converted to rename during replication. (#2223)(Ayush...
Ayush Saxena [Thu, 29 Apr 2021 09:20:08 +0000 (14:50 +0530)] 
HIVE-25059. Alter event is converted to rename during replication. (#2223)(Ayush Saxena, reviewed by Aasha Medhi)

14 months agoHIVE-24998: IS [NOT] DISTINCT FROM failing with SemanticException (Soumyakanti Das...
Soumyakanti Das [Wed, 28 Apr 2021 15:55:00 +0000 (11:55 -0400)] 
HIVE-24998: IS [NOT] DISTINCT FROM failing with SemanticException (Soumyakanti Das, reviewed by Jesus Camacho Rodriguez)

Closes apache/hive#2163

14 months agoHIVE-24992: Incremental rebuild of MV having aggregate in presence of delete operatio...
Krisztian Kasa [Wed, 28 Apr 2021 15:27:47 +0000 (17:27 +0200)] 
HIVE-24992: Incremental rebuild of MV having aggregate in presence of delete operation (Krisztian Kasa, reviewed by Jesus Camacho Rodriguez)

14 months agoHIVE-25049: LlapDaemon preemption should not be triggered for same Vertex tasks ...
Panagiotis Garefalakis [Wed, 28 Apr 2021 09:20:34 +0000 (10:20 +0100)] 
HIVE-25049: LlapDaemon preemption should not be triggered for same Vertex tasks (#2215)

14 months agoHIVE-24472: Optimize LlapTaskSchedulerService::preemptTasksFromMap (#2123)
Panagiotis Garefalakis [Wed, 28 Apr 2021 09:10:50 +0000 (10:10 +0100)] 
HIVE-24472: Optimize LlapTaskSchedulerService::preemptTasksFromMap (#2123)

Moving the (compute intensive) selection of preemption candidates to a separate thread

14 months agoHIVE-24962: Implement partition pruning for Iceberg tables (Peter Vary reviewed by...
pvary [Tue, 27 Apr 2021 12:45:28 +0000 (14:45 +0200)] 
HIVE-24962: Implement partition pruning for Iceberg tables (Peter Vary reviewed by Laszlo Pinter and Marton Bod)

14 months agoHIVE-25007: Implement insert overwrite for Iceberg tables (#2178) (Marton Bod, review...
Marton Bod [Tue, 27 Apr 2021 10:10:36 +0000 (12:10 +0200)] 
HIVE-25007: Implement insert overwrite for Iceberg tables (#2178) (Marton Bod, reviewed by Peter Vary and Laszlo Pinter)

14 months agoHIVE-24914: Improve LLAP scheduling by only traversing hosts with capacity (#2108)
Panagiotis Garefalakis [Mon, 26 Apr 2021 17:03:30 +0000 (18:03 +0100)] 
HIVE-24914: Improve LLAP scheduling by only traversing hosts with capacity (#2108)

14 months agoHIVE-25047: Remove unused fields/methods and deprecated calls in HiveProject (#2206)
Stamatis Zampetakis [Mon, 26 Apr 2021 14:48:52 +0000 (16:48 +0200)] 
HIVE-25047: Remove unused fields/methods and deprecated calls in HiveProject (#2206)

HiveCalciteUtil#getVirtualCols is no longer used so it is removed as
well.

14 months agoHIVE-25050: Disable 'hive.metastore.acid.truncate.usebase' config as it's introducing...
Denys Kuzmenko [Mon, 26 Apr 2021 07:28:05 +0000 (10:28 +0300)] 
HIVE-25050: Disable 'hive.metastore.acid.truncate.usebase' config as it's introducing backward incompatible change (Denys Kuzmenko, reviewed by Peter Vary)

Closes (#2212)

14 months agoHIVE-25052: Fix issue when inserting empty result set (#2213) (Marton Bod, reviewed...
Marton Bod [Mon, 26 Apr 2021 07:21:22 +0000 (09:21 +0200)] 
HIVE-25052: Fix issue when inserting empty result set (#2213) (Marton Bod, reviewed by Peter Vary)

14 months agoHIVE-25035. Allow creating single copy tasks for configured paths during external...
Ayush Saxena [Mon, 26 Apr 2021 04:39:01 +0000 (10:09 +0530)] 
HIVE-25035. Allow creating single copy tasks for configured paths during external table replication. (#2197)(Ayush Saxena, reviewed by Aasha Medhi)

* HIVE-25035. Allow creating single copy tasks for configured paths during external table replication.

* Refactor code.

14 months agoHIVE-23820: [HS2] Send tableId in request for get_table_request API (Ashish Sharma...
Ashish Kumar Sharma [Sat, 24 Apr 2021 08:07:49 +0000 (13:37 +0530)] 
HIVE-23820: [HS2] Send tableId in request for get_table_request API (Ashish Sharma, reviewed by Kishen Das, Adesh Rao, Sankar Hariappan)

Signed-off-by: Sankar Hariappan <sankarh@apache.org>
Closes (#2153)

14 months agoHIVE-24772: Revamp Server Request Error Logging (David Mollitor reviewed by Aihua...
belugabehr [Fri, 23 Apr 2021 16:44:50 +0000 (12:44 -0400)] 
HIVE-24772: Revamp Server Request Error Logging (David Mollitor reviewed by Aihua Xu, Zoltan Chovan)

14 months agoHIVE-25051: Callers can access uninitialized MessageBuilder instance causing NPE...
csjuhasz-c [Fri, 23 Apr 2021 15:18:27 +0000 (17:18 +0200)] 
HIVE-25051: Callers can access uninitialized MessageBuilder instance causing NPE (#2210)