asterixdb.git
4 months agoMerge branch 'gerrit/log4jfix-5e11053887'
Michael Blow [Tue, 15 Mar 2022 23:10:57 +0000 (19:10 -0400)] 
Merge branch 'gerrit/log4jfix-5e11053887'

Change-Id: I1c7cabca8bb3fc402e0db6b7de1f9715cf4456d8

4 months agoMerge branch 'gerrit/stabilization-5e11053887'
Michael Blow [Tue, 15 Mar 2022 20:33:00 +0000 (16:33 -0400)] 
Merge branch 'gerrit/stabilization-5e11053887'

Change-Id: I63dbfc59393105b7b1c58dcae2efee8ca88314b0

6 months agoMerge branch 'gerrit/stabilization-02ea049d7a'
Michael Blow [Wed, 2 Feb 2022 00:25:44 +0000 (19:25 -0500)] 
Merge branch 'gerrit/stabilization-02ea049d7a'

Change-Id: I92fc9437db11351d904644bfed9b56b825d72e48

6 months agoMerge branch 'gerrit/stabilization-5949a1cb71'
Michael Blow [Tue, 1 Feb 2022 22:32:15 +0000 (17:32 -0500)] 
Merge branch 'gerrit/stabilization-5949a1cb71'

Change-Id: I46c5d89fc13ce9b8f3aec55ece7b5281920c8759

6 months ago[NO ISSUE][MISC] Update log4j2 dependencies 2.15.0 -> 2.17.1
Michael Blow [Tue, 4 Jan 2022 17:07:17 +0000 (12:07 -0500)] 
[NO ISSUE][MISC] Update log4j2 dependencies 2.15.0 -> 2.17.1

(cherry picked from commit 63104696)

Change-Id: I7ecc188266713b9e00828cc3af2b23512e2ca1f3
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/15084
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Tested-by: Michael Blow <mblow@apache.org>
6 months ago[NO ISSUE][OTH] Replace usage of FileUtils.listFiles
Murtadha Hubail [Wed, 3 Nov 2021 10:04:16 +0000 (13:04 +0300)] 
[NO ISSUE][OTH] Replace usage of FileUtils.listFiles

- user model changes: no
- storage format changes: no
- interface changes: no

Details:

- Avoid depending on FileUtils.listFiles in production code
  by replacing it with our own implementation.

(cherry picked from commit f6306265e)

Change-Id: I1ecb6143d5840fc12b35a641e1bc73c40bba3676
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/15083
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Michael Blow <mblow@apache.org>
6 months ago[NO ISSUE]: update azure dependencies
Michael Blow [Sun, 23 Jan 2022 17:38:22 +0000 (12:38 -0500)] 
[NO ISSUE]: update azure dependencies

 - com.azure:azure-storage-blob .......... 12.12.0 -> 12.14.3
 - com.azure:azure-storage-common ........ 12.12.0 -> 12.14.2

Change-Id: I6c0c6bc39031675f606d789d00678bf224f3bbfb
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14944
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Tested-by: Michael Blow <mblow@apache.org>
6 months agoMerge branch 'gerrit/stabilization-02ea049d7a'
Michael Blow [Sun, 23 Jan 2022 15:38:03 +0000 (10:38 -0500)] 
Merge branch 'gerrit/stabilization-02ea049d7a'

Change-Id: Icde6ac90cccb845b4973155eac5a0380e8f6ff58

6 months ago[NO ISSUE][MISC] Update dependencies
Michael Blow [Sat, 22 Jan 2022 13:08:51 +0000 (08:08 -0500)] 
[NO ISSUE][MISC] Update dependencies

 - AWS Java SDK version ................ 2.10.83 -> 2.17.116
 - org.apache.maven.plugin-tools:
       maven-plugin-annotations ............. 3.6.0 -> 3.6.4
 - org.apache.maven.plugins:
       maven-remote-resources-plugin ........ 1.6.0 -> 1.7.0

Change-Id: Icdd8555e595e7d157578621e918c2d176ca86de0
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14923
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
6 months ago[NO ISSUE][HYR][HDFS] Exclude netty-all transitive dependency from hadoop
Michael Blow [Fri, 21 Jan 2022 13:51:39 +0000 (08:51 -0500)] 
[NO ISSUE][HYR][HDFS] Exclude netty-all transitive dependency from hadoop

Change-Id: I659caef68dea27a55c81a38930760b8c9720601b
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14903
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
6 months agoMerge branch 'gerrit/stabilization-5949a1cb71'
Michael Blow [Fri, 21 Jan 2022 02:42:18 +0000 (21:42 -0500)] 
Merge branch 'gerrit/stabilization-5949a1cb71'

Change-Id: I6d9ed728c40d740cdecde440cadce441ce515798

6 months ago[NO ISSUE][MISC] Update dependencies
Michael Blow [Wed, 19 Jan 2022 02:11:26 +0000 (21:11 -0500)] 
[NO ISSUE][MISC] Update dependencies

 - com.fasterxml.jackson.core:jackson-annotations .. 2.13.0 -> 2.13.1
 - com.fasterxml.jackson.core:jackson-core ......... 2.13.0 -> 2.13.1
 - com.fasterxml.jackson.core:jackson-databind ..... 2.13.0 -> 2.13.1
 - commons-io:commons-io ............................ 2.8.0 -> 2.11.0
 - io.netty:netty-buffer ............... 4.1.69.Final -> 4.1.73.Final
 - io.netty:netty-codec ................ 4.1.69.Final -> 4.1.73.Final
 - io.netty:netty-codec-http............ 4.1.69.Final -> 4.1.73.Final
 - io.netty:netty-common ............... 4.1.69.Final -> 4.1.73.Final
 - io.netty:netty-handler .............. 4.1.69.Final -> 4.1.73.Final
 - io.netty:netty-transport ............ 4.1.69.Final -> 4.1.73.Final
 - junit:junit ....................................... 4.13 -> 4.13.2
 - org.apache.maven:maven-artifact ................... 3.8.3 -> 3.8.4
 - org.apache.maven:maven-compat ..................... 3.8.3 -> 3.8.4
 - org.apache.maven:maven-core ....................... 3.8.3 -> 3.8.4
 - org.apache.maven:maven-model ...................... 3.8.3 -> 3.8.4
 - org.apache.maven:maven-plugin-api ................. 3.6.0 -> 3.8.4
 - org.apache.httpcomponents:httpcore .............. 4.4.14 -> 4.4.15
 - org.apache.httpcomponents:httpcore-nio .......... 4.4.10 -> 4.4.15
 - org.freemarker:freemarker ....................... 2.3.29 -> 2.3.31
 - org.slf4j:slf4j-api ............................. 1.7.25 -> 1.7.33
 - org.slf4j:slf4j-simple .......................... 1.7.28 -> 1.7.33

Change-Id: I3d4520195b91630bd75219f0ca23f25589750b31
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14864
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Michael Blow <mblow@apache.org>
6 months ago[NO ISSUE][MISC] Update log4j2 dependencies 2.15.0 -> 2.17.1
Michael Blow [Tue, 4 Jan 2022 17:07:17 +0000 (12:07 -0500)] 
[NO ISSUE][MISC] Update log4j2 dependencies 2.15.0 -> 2.17.1

Change-Id: I7ecc188266713b9e00828cc3af2b23512e2ca1f3
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14863
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Tested-by: Michael Blow <mblow@apache.org>
6 months ago[NO ISSUE][MISC] License plugin enhancement to aggregate overrides
Michael Blow [Wed, 19 Jan 2022 13:10:42 +0000 (08:10 -0500)] 
[NO ISSUE][MISC] License plugin enhancement to aggregate overrides

(partial cherry-pick of 5e44128bc13a93a3cadb12a87ecd691218481447)

Change-Id: Ifc2c719a6dc840d2846d68d1b649e12bec9f22db
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14865
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Tested-by: Michael Blow <mblow@apache.org>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

7 months ago[NO ISSUE] Update log4j2 dependencies 2.14.1 -> 2.15.0
Michael Blow [Fri, 10 Dec 2021 12:27:07 +0000 (07:27 -0500)] 
[NO ISSUE] Update log4j2 dependencies 2.14.1 -> 2.15.0

(cherry picked from commit 641196863c84bf1790e6f885508c8eb78a3e6511)

Change-Id: I685005dfffa27ea50fef15ba8c9466f0b4f812db
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14485
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Tested-by: Michael Blow <mblow@apache.org>
7 months agoMerge branch 'gerrit/stabilization-f69489'
Michael Blow [Fri, 10 Dec 2021 14:22:38 +0000 (09:22 -0500)] 
Merge branch 'gerrit/stabilization-f69489'

Change-Id: Ie67b5c38d267d3e8b01e4b0989f688d155311909

7 months ago[NO ISSUE] Update log4j2 dependencies 2.14.1 -> 2.15.0
Michael Blow [Fri, 10 Dec 2021 12:27:07 +0000 (07:27 -0500)] 
[NO ISSUE] Update log4j2 dependencies 2.14.1 -> 2.15.0

Change-Id: I685005dfffa27ea50fef15ba8c9466f0b4f812db
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14443
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

8 months agoMerge branch 'gerrit/stabilization-02ea049d7a'
Michael Blow [Sun, 5 Dec 2021 03:00:24 +0000 (22:00 -0500)] 
Merge branch 'gerrit/stabilization-02ea049d7a'

Change-Id: I5036734c21343389c7378a06eb9cfb10948af4db

8 months agoMerge branch 'gerrit/stabilization-5949a1cb71'
Michael Blow [Sat, 4 Dec 2021 11:02:34 +0000 (06:02 -0500)] 
Merge branch 'gerrit/stabilization-5949a1cb71'

Change-Id: I25a448cca69e3a90e2ce83a0b64dd253c9ad92f5

8 months ago[NO ISSUE][MISC] Update dependencies
Michael Blow [Fri, 29 Oct 2021 00:11:23 +0000 (20:11 -0400)] 
[NO ISSUE][MISC] Update dependencies

- com.fasterxml.jackson.core:jackson-annotations .. 2.12.3 -> 2.13.0
- com.fasterxml.jackson.core:jackson-core ......... 2.12.3 -> 2.13.0
- com.fasterxml.jackson.core:jackson-databind ..... 2.12.3 -> 2.13.0
- com.google.guava:guava .................... 30.1-jre -> 31.0.1-jre
- it.unimi.dsi:fastutil ............................. 8.3.0 -> 8.5.6
- it.unimi.dsi:fastutil-core ........................ 8.3.0 -> 8.5.6
- org.apache.commons:commons-csv ...................... 1.8 -> 1.9.0
- org.apache.logging.log4j:log4j-1.2-api .......... 2.13.1 -> 2.14.1
- org.apache.maven:maven-artifact ................... 3.6.3 -> 3.8.3
- org.apache.maven:maven-compat ..................... 3.6.3 -> 3.8.3
- org.apache.maven:maven-core ....................... 3.6.3 -> 3.8.3
- org.apache.maven:maven-model ...................... 3.6.3 -> 3.8.3
- org.apache.maven:maven-plugin-api ................. 3.6.3 -> 3.8.3
- org.xerial.snappy:snappy-java ................. 1.1.7.1 -> 1.1.8.4

- io.netty:netty-all:4.1.63.Final
   -> io.netty:netty-buffer:4.1.69.Final
   -> io.netty:netty-codec:4.1.69.Final
   -> io.netty:netty-codec-http:4.1.69.Final
   -> io.netty:netty-common:4.1.69.Final
   -> io.netty:netty-handler:4.1.69.Final
   -> io.netty:netty-resolver:4.1.69.Final
   -> io.netty:netty-transport:4.1.69.Final

(cherry picked from commit 951b9cc768978ec809d68cc49be1fb29b9bc499a)

Change-Id: I9aac58028de1a7c0e228eee3c78a39e7f3d0e431
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14265
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
8 months ago[ASTERIXDB-2949][RUN][FUN] SUBSTR function produces malformed string
Ali Alsuliman [Tue, 17 Aug 2021 15:00:11 +0000 (18:00 +0300)] 
[ASTERIXDB-2949][RUN][FUN] SUBSTR function produces malformed string

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Fix UTF8StringBuilder grow logic

UTF8StringBuilder initially takes an estimated length of the
string to be written and reserves space at the beginning
of the buffer to later store the length of the data written.
When the actual data written happens to be greater than the
estimated length requiring more space to store the length,
the string content needs to be shifted.

This patch is to fix the starting offset of the data to be shifted.
Also, the estimated length calculation of the substring method of
the UTF8StringPointable is modified to account for
SUBSTR(input_string, 0, num_chars_to_substring) with start offset = 0.

(cherry picked from commit cc6143b4ef5bb3f505478ada2bd95350a0758f6a)

Change-Id: If36253ff884a9c19eaa130c4e5e926f2dd9eea1d
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14264
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
8 months agoMerge branch 'gerrit/stabilization-5949a1cb71'
Michael Blow [Wed, 24 Nov 2021 17:07:58 +0000 (12:07 -0500)] 
Merge branch 'gerrit/stabilization-5949a1cb71'

Change-Id: Iaa206a731edf30d598d8b5eb8bd472ab8b9cc9f9

8 months ago[NO ISSUE][HYR][NET] += trust store to sec cfg
Michael Blow [Tue, 23 Nov 2021 21:02:21 +0000 (16:02 -0500)] 
[NO ISSUE][HYR][NET] += trust store to sec cfg

Change-Id: I358eb5b9b0f0f40b1588c12ed473e4e920e8fbbe
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14184
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Ian Maxon <imaxon@uci.edu>
10 months ago[NO ISSUE][ACTIVE] Account for force stop while suspending
Murtadha Hubail [Thu, 9 Sep 2021 22:36:34 +0000 (01:36 +0300)] 
[NO ISSUE][ACTIVE] Account for force stop while suspending

- user model changes: no
- storage format changes: no
- interface changes: no

Details:

- When a failure happens while trying to suspend ingestion,
  we will force stop the active job. If the job completes
  ungracefully, we set the listener state to TEMPORARILY_FAILED.
  However, since force to stop only waits for STOPPED state,
  the thread waiting for ingestion to be suspended will wait
  forever. This change accounts for such case and makes
  the force stop waits for TEMPORARILY_FAILED too.

Change-Id: Ib33f191be2b84d97a08e3bc6d607b0edbf35bed1
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/13144
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
(cherry picked from commit eed8714ae56bd61656750bf543181e7dd68c26c1)
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/13203

11 months agoMerge branch 'gerrit/mad-hatter' into 'gerrit/cheshire-cat'
Ali Alsuliman [Tue, 7 Sep 2021 21:19:26 +0000 (00:19 +0300)] 
Merge branch 'gerrit/mad-hatter' into 'gerrit/cheshire-cat'

Change-Id: I3e700b07781bec8fc5b9eabf15a1249ce2be0272

11 months ago[ASTERIXDB-2949][RUN][FUN] SUBSTR function produces malformed string
Ali Alsuliman [Tue, 17 Aug 2021 15:00:11 +0000 (18:00 +0300)] 
[ASTERIXDB-2949][RUN][FUN] SUBSTR function produces malformed string

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Fix UTF8StringBuilder grow logic

UTF8StringBuilder initially takes an estimated length of the
string to be written and reserves space at the beginning
of the buffer to later store the length of the data written.
When the actual data written happens to be greater than the
estimated length requiring more space to store the length,
the string content needs to be shifted.

This patch is to fix the starting offset of the data to be shifted.
Also, the estimated length calculation of the substring method of
the UTF8StringPointable is modified to account for
SUBSTR(input_string, 0, num_chars_to_substring) with start offset = 0.

Change-Id: If36253ff884a9c19eaa130c4e5e926f2dd9eea1d
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12864
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Ian Maxon <imaxon@uci.edu>
11 months agoMerge branch 'gerrit/stabilization-02ea049d7a'
Michael Blow [Fri, 27 Aug 2021 19:18:21 +0000 (15:18 -0400)] 
Merge branch 'gerrit/stabilization-02ea049d7a'

Change-Id: Ifa83f5d6e9a19bca533538247da67bf5b5c05f8c

11 months agoMerge branch 'gerrit/stabilization-5949a1cb71'
Michael Blow [Fri, 27 Aug 2021 10:50:17 +0000 (06:50 -0400)] 
Merge branch 'gerrit/stabilization-5949a1cb71'

Change-Id: I3739827c79aca29305c79c8d746c435957403e12

11 months agoMerge branch 'gerrit/stabilization-f69489'
Michael Blow [Fri, 27 Aug 2021 00:40:42 +0000 (20:40 -0400)] 
Merge branch 'gerrit/stabilization-f69489'

Change-Id: I0ab93c59080d96fdef8f799dbbdfb1c24fdc273b

11 months ago[NO ISSUE] update Apache Commons Compress
Till Westmann [Fri, 20 Aug 2021 02:57:47 +0000 (19:57 -0700)] 
[NO ISSUE] update Apache Commons Compress

Change-Id: I87531ad5442f2a4012e09dddbd112b7008016ff7
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12924
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ian Maxon <imaxon@uci.edu>
11 months ago[ASTERIXDB-2953][RT] Fix large buffer read bug
Ian Maxon [Mon, 23 Aug 2021 16:44:24 +0000 (09:44 -0700)] 
[ASTERIXDB-2953][RT] Fix large buffer read bug

- user mode changes: no
- storage format changes: no
- interface changes: no

Dereference the memoryview when reallocating the bytearray
instead of just setting it to None.

Also add a test to check it.

Change-Id: Ic95e592b42139b4750af8bb20291f926b3a973e1
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12943
Reviewed-by: Ian Maxon <imaxon@uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
11 months ago[NO ISSUE] Setting No. of partitions in HHJ
Shiva [Thu, 29 Jul 2021 17:33:20 +0000 (10:33 -0700)] 
[NO ISSUE] Setting No. of partitions in HHJ

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Sets the default number of partitions for HHJ to 20
- Sets the minimum number of partitions for HHJ to 20
- Sets the size of build input to -1 so the minimum
  number of partitions are used

Change-Id: Icfbe12c486ccecaefe44f806cc47c8257acbdebf
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12544
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
11 months ago[NO ISSUE] Advance Azure SDK and Azurite versions
Hussain Towaileb [Sun, 15 Aug 2021 13:33:58 +0000 (16:33 +0300)] 
[NO ISSUE] Advance Azure SDK and Azurite versions

Change-Id: I1ad47076c8ed22f3b1a13661605693374fee41bb
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12843
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Reviewed-by: Michael Blow <mblow@apache.org>
Contrib: Michael Blow <mblow@apache.org>

11 months agoMerge branch 'stabilization-3b6982ce7f'
Dmitry Lychagin [Thu, 12 Aug 2021 18:02:40 +0000 (11:02 -0700)] 
Merge branch 'stabilization-3b6982ce7f'

Change-Id: Ic5ceadf6cf4c2f5c2ac942470606823ec85118c5

11 months ago[NO ISSUE][DOC] Documentation for ROLLUP and CUBE
Simon Dew [Thu, 12 Aug 2021 11:06:02 +0000 (12:06 +0100)] 
[NO ISSUE][DOC] Documentation for ROLLUP and CUBE

  - Add documentation for ROLLUP subclause
  - Add documentation for CUBE subclause

Change-Id: I67a63f17ca459e313321bce569056a7f07f3a17f
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12783
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
11 months ago[ASTERIXDB-2947][COMP] Fix internal compiler error
Dmitry Lychagin [Thu, 12 Aug 2021 00:45:33 +0000 (17:45 -0700)] 
[ASTERIXDB-2947][COMP] Fix internal compiler error

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Fixed optimizer sanity check failure caused by
  InlineSubplanInputForNestedTupleSourceRule

Change-Id: If8e50a0909481e98e25d9c12ebe1a8e8f1464c9e
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12785
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
12 months ago[ASTERIXDB-2943][STO] Upgrade Snappy to v1.1.8.4
Wail Alkowaileet [Sat, 7 Aug 2021 23:21:17 +0000 (16:21 -0700)] 
[ASTERIXDB-2943][STO] Upgrade Snappy to v1.1.8.4

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- The current Snappy version v1.1.7.1 has a bug when running on aarch64
- Also, it is not supported by the new Apple Silicon
  - Probably uses the Java-pure version
- v1.1.8.4 solves those two issues

Change-Id: Id82da58edbdee8a80a419fafcd474880a235e3aa
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12703
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
12 months ago[ASTERIXDB-2924][IDX] Multiple INLJs are now recognized.
ggalvizo [Tue, 20 Jul 2021 19:44:37 +0000 (09:44 -1000)] 
[ASTERIXDB-2924][IDX] Multiple INLJs are now recognized.

- user mode changes: no
- storage format changes: no
- interface changes: no

WLOG, two datasets that can be optimized with an INLJ using the same
probe are now recognized and transformed into a double INLJ plan.

Change-Id: I1da6174b07963ec611677d7906c7304c46a2a382
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12424
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
12 months ago[NO ISSUE][HYR][LIC] += <extraDependencies/> to license plugin
Michael Blow [Mon, 26 Jul 2021 17:41:21 +0000 (13:41 -0400)] 
[NO ISSUE][HYR][LIC] += <extraDependencies/> to license plugin

- Add ability to include extra maven dependencies (i.e. those not in the
  project model) in generated license output
- Extra maven dependencies can be the same groupId/artifactId as an
  exisiting dependency

Change-Id: Ic8f37d0eca6f4e745305b31d74682ca7e62ead27
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12524
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Till Westmann <tillw@apache.org>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
12 months ago[ASTERIXDB-2934][COMP] GROUP BY requires FROM clause
Dmitry Lychagin [Fri, 23 Jul 2021 01:55:41 +0000 (18:55 -0700)] 
[ASTERIXDB-2934][COMP] GROUP BY requires FROM clause

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- If GROUP BY clause is present in SELECT
  block then FROM clause should be required
- Update grammar in the documentation
- Add testcases

Change-Id: I92f08c0639e19616de2dbaf70f0223d898e446b3
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12464
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
12 months ago[NO ISSUE] Touch 3rdpartylicenses.txt in skip.npm
Ian Maxon [Wed, 7 Jul 2021 21:55:59 +0000 (14:55 -0700)] 
[NO ISSUE] Touch 3rdpartylicenses.txt in skip.npm

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
(Ab)use antrun to make 'skip.npm' work without having to touch
asterixdb/asterix-dashboard/target/dashboard/static/3rdpartylicenses.txt
before the build.

Change-Id: Ic95e592b42139b4750af8bb20297f926b3c973e4
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12243
Reviewed-by: Ian Maxon <imaxon@uci.edu>
Reviewed-by: Till Westmann <tillw@apache.org>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Contrib: Ian Maxon <imaxon@uci.edu>

12 months agoMerge branch 'gerrit/mad-hatter' into 'gerrit/cheshire-cat'
Hussain Towaileb [Sun, 18 Jul 2021 17:40:54 +0000 (20:40 +0300)] 
Merge branch 'gerrit/mad-hatter' into 'gerrit/cheshire-cat'

Change-Id: I6da7365177ca8f0880a3ae54295164ae8672a157

12 months ago[NO ISSUE] Fix rr diagram generation
Ian Maxon [Thu, 1 Jul 2021 22:02:08 +0000 (15:02 -0700)] 
[NO ISSUE] Fix rr diagram generation

- user model changes: no
- storage format changes: no
- interface changes: no

Details:

Use the proper parameters for antrun plugin 3.0.0

Change-Id: I3f0e749dab55c873a6ec2d5fd101afae9a27413e
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12183
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ian Maxon <imaxon@uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
12 months ago[NO ISSUE][EXT] Rename dataset's dataverse property to dataset-dataverse
Hussain Towaileb [Mon, 12 Jul 2021 23:40:56 +0000 (02:40 +0300)] 
[NO ISSUE][EXT] Rename dataset's dataverse property to dataset-dataverse

Change-Id: I997026fbd8118dd4909e0d868cd36e99c8474a6b
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12304
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
13 months ago[ASTERIXDB-2919] Azure Blob external datasets: add support to anonymous authentication
Hussain Towaileb [Wed, 30 Jun 2021 21:55:25 +0000 (00:55 +0300)] 
[ASTERIXDB-2919] Azure Blob external datasets: add support to anonymous authentication

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Added support to creating external datasets with no
  credentials (anonymous).

Change-Id: I19a161a3613371572fa26c786bab690e332fdd08
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11983
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Till Westmann <tillw@apache.org>
13 months agoMerge branch 'gerrit/mad-hatter' into 'gerrit/cheshire-cat'
Michael Blow [Wed, 30 Jun 2021 14:10:26 +0000 (10:10 -0400)] 
Merge branch 'gerrit/mad-hatter' into 'gerrit/cheshire-cat'

Change-Id: I5c3c2107b79649f0ea5d7505e5dec213e7733b2d

13 months ago[NO ISSUE] Misc utility / cleanup
Michael Blow [Mon, 7 Jun 2021 00:03:47 +0000 (20:03 -0400)] 
[NO ISSUE] Misc utility / cleanup

Change-Id: Iae424fb99220630cb3a240cfef4cbba39b9da06b
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11803
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
13 months ago[NO-ISSUE][MVN] Plugin update (to build on M1 macbooks).
ggalvizo [Tue, 22 Jun 2021 18:30:58 +0000 (11:30 -0700)] 
[NO-ISSUE][MVN] Plugin update (to build on M1 macbooks).

- user mode changes: no
- storage format changes: no
- interface changes: no

Change-Id: Ie947924ddff4da62c5e95f6a93ad827550a6fe67
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12003
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ian Maxon <imaxon@uci.edu>
Contrib: Ian Maxon <imaxon@uci.edu>
(cherry picked from commit 86c18127feda4b189bec024f6c8502e7e6436bf3)
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12123
Reviewed-by: Glenn Galvizo <ggalvizo@uci.edu>
13 months agoMerge branch 'gerrit/mad-hatter'
Dmitry Lychagin [Mon, 28 Jun 2021 22:05:13 +0000 (15:05 -0700)] 
Merge branch 'gerrit/mad-hatter'

Change-Id: I7d5ea9a4967ee571e42ddf92d5f3bfba7f9cc911

13 months ago[ASTERIXDB-2917][COMP] Incorrect result with group by over cross product
Dmitry Lychagin [Mon, 28 Jun 2021 18:03:21 +0000 (11:03 -0700)] 
[ASTERIXDB-2917][COMP] Incorrect result with group by over cross product

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Fix incorrect result caused PushGroupByThroughProduct rule
- Add testcase

Change-Id: I85400289d3096c4da38ed73c7576e7c8b79a4909
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12104
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
13 months agoMerge "Merge branch 'gerrit/mad-hatter'" into cheshire-cat
Apache AsterixDB Gerrit [Mon, 28 Jun 2021 19:06:20 +0000 (19:06 +0000)] 
Merge "Merge branch 'gerrit/mad-hatter'" into cheshire-cat

13 months ago[NO ISSUE] Update maven-antrun-plugin 1.8 -> 3.0.0
Michael Blow [Mon, 28 Jun 2021 10:23:53 +0000 (06:23 -0400)] 
[NO ISSUE] Update maven-antrun-plugin 1.8 -> 3.0.0

Change-Id: Ie014329b3fba3b4c7cb0c094b1d9eb1ae9133486
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12103
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
13 months agoMerge branch 'gerrit/mad-hatter'
Murtadha Hubail [Sun, 27 Jun 2021 17:58:25 +0000 (20:58 +0300)] 
Merge branch 'gerrit/mad-hatter'

Change-Id: I2a3075ab4c6a84fa12fce114cceae2bec46fe04a

13 months ago[NO ISSUE][HYR] Expose getParams/getSourceLocation on IFormattedException,Warning
Michael Blow [Fri, 25 Jun 2021 19:06:14 +0000 (15:06 -0400)] 
[NO ISSUE][HYR] Expose getParams/getSourceLocation on IFormattedException,Warning

Change-Id: Id6c6807bfe727e8164ac69dd8e8a18fcf1840cce
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12064
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
13 months ago[NO ISSUE][MD] Ensure metadata node is initialized
Murtadha Hubail [Tue, 9 Mar 2021 22:06:17 +0000 (01:06 +0300)] 
[NO ISSUE][MD] Ensure metadata node is initialized

- user model changes: no
- storage format changes: no
- interface changes: no

Details:

- Before attempting to being any metadata transaction, ensure
  the metadata node has been bound to avoid NPE.

Change-Id: Ic54314e9da42b4111a1aab53d1ec355ad13922e1
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/10444
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
(cherry picked from commit e8428051a7550578e2b28f5987e87ede41c83832)
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12023

13 months ago[NO ISSUE][STO] Close datasets of flushed indexes after recovery
Murtadha Hubail [Wed, 12 May 2021 13:41:02 +0000 (16:41 +0300)] 
[NO ISSUE][STO] Close datasets of flushed indexes after recovery

- user model changes: no
- storage format changes: no
- interface changes: yes

Details:

- After performing redo of a flush log on any index, close its dataset
  to ensure any cached state that might have been changed during recovery
  is cleared (e.g. the component id generator).
- Fix LSMFlushRecoveryTest total number of records to be inserted.
- Update LSMFlushRecoveryTest to check for duplicate component ids.

Change-Id: I29072f475cc7b4d7d6efde415be0329fc568443e
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11423
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
Reviewed-by: Michael Blow <mblow@apache.org>
(cherry picked from commit 0e7e4bdb2c514fe7469a775c2ffc3d9e78e6a317)
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12024
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
13 months ago[ASTERIXDB-2886][COMP] Fix RemoveRedundantVariablesRule
Dmitry Lychagin [Tue, 20 Apr 2021 21:38:53 +0000 (14:38 -0700)] 
[ASTERIXDB-2886][COMP] Fix RemoveRedundantVariablesRule

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Change RemoveRedundantVariablesRule to
  operate on the whole plan at once instead
  of working incrementally on each operator

Change-Id: Ie948372c53bf42687ffd0ac37eff39bddf7395bc
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11863
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
13 months ago[ASTERIXDB-2843][COMP] Fix type computer for scalar aggregates
Dmitry Lychagin [Thu, 17 Jun 2021 17:34:16 +0000 (10:34 -0700)] 
[ASTERIXDB-2843][COMP] Fix type computer for scalar aggregates

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Align type computation for scalar aggregates with
  regular aggregates

Change-Id: Ic587f29840262f052f15e7d257c3d7dda7e40686
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11984
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Till Westmann <tillw@apache.org>
13 months ago[NO ISSUE][OTH] Extensible QueryServiceServlet
Murtadha Hubail [Mon, 14 Jun 2021 00:41:31 +0000 (03:41 +0300)] 
[NO ISSUE][OTH] Extensible QueryServiceServlet

- user model changes: no
- storage format changes: no
- interface changes: no

Details:

- Set StatementProperties before attempting to execute the statements
  to have any changes reflected in case of statements execution failures.
- Pass execution state when a request fails.

Change-Id: Ic84aa2d7641a0f51c2d2ec13f2900066b225ec5b
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11923
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
Reviewed-by: Michael Blow <mblow@apache.org>
13 months ago[ASTERIXDB-2844][COMP] Fix syntax error with UNNEST
Dmitry Lychagin [Fri, 12 Mar 2021 20:53:15 +0000 (12:53 -0800)] 
[ASTERIXDB-2844][COMP] Fix syntax error with UNNEST

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Do not require AS subclause in UNNEST
- Add testcase

Change-Id: I17f4f7743e873dcb773f7a68b14660637c58aa89
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11824
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
13 months agoReuse/share code for external dataset tests (p1)
Hussain Towaileb [Fri, 21 May 2021 16:29:04 +0000 (19:29 +0300)] 
Reuse/share code for external dataset tests (p1)

Change-Id: Ie5caebd98a3c42536654035d5bc3954eaca6e6d5
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11564
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
13 months ago[NO ISSUE][EXT]: Retry upon failure for S3 retryable errors
Hussain Towaileb [Wed, 9 Jun 2021 16:59:23 +0000 (19:59 +0300)] 
[NO ISSUE][EXT]: Retry upon failure for S3 retryable errors

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Retry upon failure for S3 retryable errors.

Change-Id: I639fd7d43c2a6c28b3cc4247bf9ac5d3a23a387e
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11883
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
14 months ago[ASTERIXDB-2905] Error when window function used in subquery
Dmitry Lychagin [Tue, 25 May 2021 17:43:01 +0000 (10:43 -0700)] 
[ASTERIXDB-2905] Error when window function used in subquery

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Fix ambiguous alias¬†failure when window function
  is used by subquery
- Add testcase

Change-Id: I4011af7e46042b9cb0279d0f182deede8bc178cf
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11624
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
14 months ago[ASTERIXDB-2857][RT] Incorrect result for nested loop outer join
Dmitry Lychagin [Wed, 31 Mar 2021 00:12:27 +0000 (17:12 -0700)] 
[ASTERIXDB-2857][RT] Incorrect result for nested loop outer join

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Fix incorrect number of unmatched tuples emitted
  by nested loop implementation of left outer join
- Add RunFileWriter.eraseClosed() method

Change-Id: Id48c2f25acf85e61bb1112811ecfe544a0edae86
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11825
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
14 months ago[NO ISSUE][REP] Account for SSL socket data transfer behavior
Murtadha Hubail [Tue, 8 Jun 2021 21:21:33 +0000 (00:21 +0300)] 
[NO ISSUE][REP] Account for SSL socket data transfer behavior

- user model changes: no
- storage format changes: no
- interface changes: no

Details:

- Account for the fact that a call to an SSLSocketChannel
  read operation can return 0 read bytes even in a blocking
  socket due to incomplete SSL packet.

Change-Id: I0e1e69cba7336e0cfca5def870ab16334ce8c19f
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11064
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
(cherry picked from commit 94b1306e380dc923a964abf60900d55e545a4e4f)
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11843

14 months ago[NO ISSUE] S3 external datasets: add support to anonymous authentication
Hussain Towaileb [Mon, 7 Jun 2021 01:46:17 +0000 (04:46 +0300)] 
[NO ISSUE] S3 external datasets: add support to anonymous authentication

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Added support to creating external datasets with no
  credentials (anonymous).

Change-Id: I610f5b82d008a661946ae05bb4582d74b4e7161d
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11804
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
14 months ago[ASTERIXDB-2804][FUN] Use pseudo-random for random(seed)
Ali Alsuliman [Thu, 3 Jun 2021 17:43:22 +0000 (20:43 +0300)] 
[ASTERIXDB-2804][FUN] Use pseudo-random for random(seed)

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
Use pseudo-random for random(seed)

Change-Id: I14e81b24933744b136f85bd1218987401830fad9
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11763
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
14 months ago[ASTERIXDB-2732][FUN] Support missing and union type in get_object_field_value
Ali Alsuliman [Thu, 3 Jun 2021 17:50:08 +0000 (20:50 +0300)] 
[ASTERIXDB-2732][FUN] Support missing and union type in get_object_field_value

- user model changes: no
- storage format changes: no
- interface changes: no

Change-Id: I84355e0ae91afd0328e636aa4f3bed6eeb44e055
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11764
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
14 months ago[ASTERIXDB-2797][COMP] Fix casting elements of a list constructor
Ali Alsuliman [Thu, 3 Jun 2021 14:28:29 +0000 (17:28 +0300)] 
[ASTERIXDB-2797][COMP] Fix casting elements of a list constructor

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
Currently, variable elements in a list constructor are always wrapped
in cast() which would cast the variable to open type (when the variable
type is a complex type, e.g. record). The required target type should
be taken into account to decide whether to cast or not.

Change-Id: If18467115e7e497af1b3bc1b76d8ff64adf14c4a
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11743
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
14 months ago[ASTERIXDB-2817][FUN] Fix IndexOutOfBoundsException in get_object_fields()
Ali Alsuliman [Thu, 3 Jun 2021 11:57:55 +0000 (14:57 +0300)] 
[ASTERIXDB-2817][FUN] Fix IndexOutOfBoundsException in get_object_fields()

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Fix IndexOutOfBoundsException in get_object_fields()
- Add test case
- Enable some test case

Change-Id: I36d7915da1193ced12c9185831dc69e3da58517b
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11744
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
14 months agoMerge branch 'mad-hatter' into 'cheshire-cat'
Ian Maxon [Thu, 3 Jun 2021 19:31:18 +0000 (12:31 -0700)] 
Merge branch 'mad-hatter' into 'cheshire-cat'

Change-Id: Ib9aa81fa2e51954a46218e9907562685c8cd09e1

14 months ago[ASTERIXDB-2890] Minimum Java version 8->11
Ian Maxon [Wed, 5 May 2021 09:08:27 +0000 (02:08 -0700)] 
[ASTERIXDB-2890] Minimum Java version 8->11

- user model changes: no
- storage format changes: no
- interface changes: no

Details:

- Update Mockito to unbreak tests and put it under
  dependencyManagement.
- Update HttpTestUtil to avoid inspecting fields that
  are usually invalid in JDK 11
- Enable parallel execution of surefire tests in
  asterix-om to make up for slowdown of ExceptionTest
  under Mockito 2+

Change-Id: Ib9aa81fa2e58954846218e9907562685c8cd09e3
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/5483
Reviewed-by: Ian Maxon <imaxon@uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Michael Blow <mblow@apache.org>
14 months agoMerge branch 'gerrit/stabilization-3b6982ce7f'
Michael Blow [Tue, 1 Jun 2021 14:33:57 +0000 (10:33 -0400)] 
Merge branch 'gerrit/stabilization-3b6982ce7f'

Change-Id: I2ea64b20d39dc9cb4e14f350424f0e4b2e038e2c

14 months ago[NO ISSUE][*DB][MD] Allow '.' in database object names on Windows
Michael Blow [Fri, 28 May 2021 11:48:40 +0000 (07:48 -0400)] 
[NO ISSUE][*DB][MD] Allow '.' in database object names on Windows

Change-Id: I18183e9cf0906a6313b48ee19d48dec6f6ad5549
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11663
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Till Westmann <tillw@apache.org>
Tested-by: Michael Blow <mblow@apache.org>
14 months ago[NO ISSUE][STO] Ignore resource doesn't exist on dataset drop
Murtadha Hubail [Wed, 26 May 2021 22:38:51 +0000 (01:38 +0300)] 
[NO ISSUE][STO] Ignore resource doesn't exist on dataset drop

- user model changes: no
- storage format changes: no
- interface changes: no

Details:

- When attempting to drop a dataset, do not fail the operation
  due to not finding the index on an NC.
- Ignore resource doesn't exist error code when attempting to
  drop a dataset.
- Always invalidate the resource on a delete attempt from the
  PersistentLocalResourceRepository cache.
- Start a new metadata transaction before attempting to execute
  the drop dataset compensating operations.

Change-Id: I591b009f0ffdf348bcfe989424f47a20fff44a1b
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11644
Reviewed-by: Michael Blow <mblow@apache.org>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
14 months ago[NO ISSUE][RT] Fix flush() of subplan runtime
Ali Alsuliman [Wed, 26 May 2021 14:11:48 +0000 (17:11 +0300)] 
[NO ISSUE][RT] Fix flush() of subplan runtime

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
flush() of Subplan runtime should flush its appender
to the next writer.

Change-Id: Ib0d7ff82381e5c6dcea6d26ccbfba71530cc07a7
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11643
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
14 months ago[NO ISSUE][COMP] Fix subplan flush + disable optimization rule
Ali Alsuliman [Tue, 25 May 2021 17:25:45 +0000 (20:25 +0300)] 
[NO ISSUE][COMP] Fix subplan flush + disable optimization rule

- user model changes: no
- storage format changes: no
- interface changes: yes

Details:
- disable IntroJoinInsideSubplanRule when blocking operators are disabled
- fix flush of subplan to flush its frame to next writer

Change-Id: I9269a092aa933327fa6f97dfffcdf888f10dd77b
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11623
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Till Westmann <tillw@apache.org>
14 months ago[NO ISSUE][EXT] enable override of active recovery
Michael Blow [Sat, 22 May 2021 15:27:29 +0000 (11:27 -0400)] 
[NO ISSUE][EXT] enable override of active recovery

Change-Id: I50639d8b61af5d9d0068433ab132d76e363f7bef
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11583
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
14 months ago[NO ISSUE][STO] Add method to init the frame operation call back
Ali Alsuliman [Fri, 21 May 2021 21:43:37 +0000 (00:43 +0300)] 
[NO ISSUE][STO] Add method to init the frame operation call back

- user model changes: no
- storage format changes: no
- interface changes: yes

Details:
Add open() to IFrameOperationCallback to allow for initialization.

Change-Id: Ia9838b4a938271f0de9d8d6c11212fdbd850df27
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11566
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
14 months ago[NO ISSUE][MISC] Fix unwrap(), consolidate exception utils
Michael Blow [Fri, 21 May 2021 12:34:55 +0000 (08:34 -0400)] 
[NO ISSUE][MISC] Fix unwrap(), consolidate exception utils

- ExceptionUtils.unwrap() is supposed to return only instances of IFormattedException,
  but due to a bug was returning the first non-IFormattedException nested exception

Change-Id: Ib26371609d9e1fcd1ff434b8ece04b6d96e4e2f4
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11563
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Till Westmann <tillw@apache.org>
14 months ago[NO ISSUE][HYR][HTTP] http stream handler -> consumer / processor
Michael Blow [Wed, 19 May 2021 12:00:00 +0000 (08:00 -0400)] 
[NO ISSUE][HYR][HTTP] http stream handler -> consumer / processor

Change-Id: I7cd7622dbee880845d0b4233ce3a3b17af15eebc
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11524
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Ian Maxon <imaxon@uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
14 months ago[NO ISSUE][MISC] Improve parser error reporting
Michael Blow [Thu, 20 May 2021 20:43:43 +0000 (16:43 -0400)] 
[NO ISSUE][MISC] Improve parser error reporting

Change-Id: I8707d9e2a952693b6501e9e63aff9162a77541cc
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11543
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Till Westmann <tillw@apache.org>
14 months ago[NO ISSUE][*DB][EXT] Fail with helpful error message on non-JSON object
Michael Blow [Thu, 20 May 2021 00:10:46 +0000 (20:10 -0400)] 
[NO ISSUE][*DB][EXT] Fail with helpful error message on non-JSON object

Change-Id: Ia096e108aa062e87a92f29ad3812f118390f411e
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11525
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Till Westmann <tillw@apache.org>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
14 months ago[ASTERIXDB-2894] Update UDF docs
Ian Maxon [Thu, 29 Apr 2021 19:46:44 +0000 (12:46 -0700)] 
[ASTERIXDB-2894] Update UDF docs

- user model changes: no
- storage format changes: no
- interface changes: no

Details:

- Update API examples to include type
- Include details about typing and execution model

Change-Id: Id9780d72960f9094c29f7f5766185782069fe7cf
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11225
Reviewed-by: Ian Maxon <imaxon@uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
14 months agoMerge branch 'gerrit/mad-hatter'
Michael Blow [Wed, 19 May 2021 11:35:35 +0000 (07:35 -0400)] 
Merge branch 'gerrit/mad-hatter'

Change-Id: I78240c264b37e3d5be3fc40ed1f2b50f20c8689c

14 months ago[NO ISSUE][MISC] Preserve Error instances on retryUntilSuccessOrExhausted
Michael Blow [Sun, 16 May 2021 13:24:27 +0000 (09:24 -0400)] 
[NO ISSUE][MISC] Preserve Error instances on retryUntilSuccessOrExhausted

Prior to this change, InvokeUtil.retryUntilSuccessOrExhausted() would wrap instances of
java.lang.Error with HyracksDataException upon exhaustion of retry attempts.  Errors are
typically handled differently than non-Errors, so preserve the Error when propagating
the failure to the caller.

Change-Id: Idfe1d443addaed342b0c0ed3a0a3835ad226dbe7
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11483
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
14 months ago[ASTERIXDB-2884] Compiler error with nested UDF calls
Dmitry Lychagin [Thu, 13 May 2021 05:25:50 +0000 (22:25 -0700)] 
[ASTERIXDB-2884] Compiler error with nested UDF calls

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Fix invalid plan produced by ExtractBatchableExternalFunctionCallsRule
- IntroduceDynamicTypeCastForExternalFunctionRule should not introduce
  redundant cast if function argument type is ANY
- Add testcase

Change-Id: I472aa8f828cd548d14d7bda9893984cc4bf25737
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11445
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
14 months ago[NO ISSUE][STO] Close datasets of flushed indexes after recovery
Murtadha Hubail [Wed, 12 May 2021 13:41:02 +0000 (16:41 +0300)] 
[NO ISSUE][STO] Close datasets of flushed indexes after recovery

- user model changes: no
- storage format changes: no
- interface changes: yes

Details:

- After performing redo of a flush log on any index, close its dataset
  to ensure any cached state that might have been changed during recovery
  is cleared (e.g. the component id generator).
- Fix LSMFlushRecoveryTest total number of records to be inserted.
- Update LSMFlushRecoveryTest to check for duplicate component ids.

Change-Id: I29072f475cc7b4d7d6efde415be0329fc568443e
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11423
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
Reviewed-by: Michael Blow <mblow@apache.org>
14 months ago[NO ISSUE][MISC] Fix typo on active state log, += HyracksThrowingSupplier
Michael Blow [Wed, 12 May 2021 16:06:33 +0000 (12:06 -0400)] 
[NO ISSUE][MISC] Fix typo on active state log, += HyracksThrowingSupplier

Change-Id: I19ba60f6a362b06451be331449d21f3c37653570
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11443
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Ian Maxon <imaxon@uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
14 months ago[NO ISSUE] Fixed storage unit util false positives + added tests
Hussain Towaileb [Tue, 11 May 2021 14:09:05 +0000 (17:09 +0300)] 
[NO ISSUE] Fixed storage unit util false positives + added tests

Change-Id: Ic263c4fea0de15803811c88e4d6b01df21e083c8
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11303
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
15 months ago[NO ISSUE][TX] Ensure lock manager computes valid indexes for hash table
Ali Alsuliman [Mon, 10 May 2021 16:53:45 +0000 (19:53 +0300)] 
[NO ISSUE][TX] Ensure lock manager computes valid indexes for hash table

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
Given a dataset id and an entity hash value, ensure that the lock
manager computes a valid index for looking up the hash table.

Change-Id: I33d342455a79d0d69b49e126ff6a40c47b07d0dd
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11403
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Michael Blow <mblow@apache.org>
Tested-by: Michael Blow <mblow@apache.org>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

15 months ago[ASTERIXDB-2896] Increase UDF argument buffer size
Ian Maxon [Sun, 2 May 2021 18:23:41 +0000 (11:23 -0700)] 
[ASTERIXDB-2896] Increase UDF argument buffer size

-user model changes: no
-storage format changes: no
-interface changes: yes

Details:

Bump buffer sizes in Python IPC to 1MB for individual
arguments, and in the case of batching, match the
buffer size of the Hyracks IPC layer for deserialization.

Change-Id: If847ac3b09406d1e9e6a976a7e0193b6e81bcc8b
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11243
Reviewed-by: Ian Maxon <imaxon@uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Contrib: Ian Maxon <imaxon@uci.edu>

15 months ago[NO ISSUE][*DB] Enable large parsing resources to be freed on memory pressure
Michael Blow [Thu, 6 May 2021 20:36:30 +0000 (16:36 -0400)] 
[NO ISSUE][*DB] Enable large parsing resources to be freed on memory pressure

Change-Id: Ieaca566f765a5d3531baff8128d6ff03c95956e2
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11365
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Till Westmann <tillw@apache.org>
15 months ago[NO ISSUE][EXT] Refactor JSONDataParser
Michael Blow [Thu, 6 May 2021 20:06:47 +0000 (16:06 -0400)] 
[NO ISSUE][EXT] Refactor JSONDataParser

Change-Id: Ia47f2fe449cfb0ca8e6e3a6308ef01ee6810ec03
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11363
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Till Westmann <tillw@apache.org>
15 months ago[ASTERIXDB-2897][FUN] Fix unknown handling in PyUDF
Ian Maxon [Tue, 4 May 2021 16:35:21 +0000 (09:35 -0700)] 
[ASTERIXDB-2897][FUN] Fix unknown handling in PyUDF

- user model changes: no
- storage format changes: no
- interface changes: no

Details:

Carry the fix from ASTERIXDB-2883 to Python UDFs,
and add a corresponding test for both this new
code in the non-batched execution, as well as
checking that it works the same in batched mode

Change-Id: I64ac16d094caafcc657a21650011ed41d0c3c6d6
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11324
Reviewed-by: Ian Maxon <imaxon@uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
15 months ago[NO ISSUE][OTH] Only order nodes in node group for new datasets
Ali Alsuliman [Wed, 5 May 2021 22:39:41 +0000 (01:39 +0300)] 
[NO ISSUE][OTH] Only order nodes in node group for new datasets

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Revert the change that sorts the cluster partitions.
- Order the nodes in the node group for newly created datasets.
- Make dump index function use the same locations as the index
  split files in the index dataflow helper.

Change-Id: Id90a9c88ed44655631e44155c737459e4501c081
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11343
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
15 months ago[NO ISSUE][MISC] Avoid URI.getHost/Port where hostnames may contain underscore
Michael Blow [Mon, 3 May 2021 20:48:08 +0000 (16:48 -0400)] 
[NO ISSUE][MISC] Avoid URI.getHost/Port where hostnames may contain underscore

Change-Id: Iff58db84cc4d11609e7d7c459003a8a50f058ac6
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11305
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Ian Maxon <imaxon@uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
15 months ago[ASTERIXDB-2883][COMP] Improve null handling in UDF calls
Dmitry Lychagin [Tue, 4 May 2021 00:42:16 +0000 (17:42 -0700)] 
[ASTERIXDB-2883][COMP] Improve null handling in UDF calls

- user model changes: no
- storage format changes: no
- interface changes: no

- IntroduceDynamicTypeCastForExternalFunctionRule
  should not apply twice on the same operator
- Add null-call handling to ExternalTypeComputer
  and ExternalScalarJavaFunctionEvaluator

Change-Id: I9c58e28f673606c5d0413bdc4cd3ba0c7c20eb8d
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11306
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ian Maxon <imaxon@uci.edu>
15 months agoMerge branch 'gerrit/mad-hatter'
Michael Blow [Sun, 2 May 2021 16:32:23 +0000 (12:32 -0400)] 
Merge branch 'gerrit/mad-hatter'

Change-Id: I9fb18d2460cc83005380020c52a294c06c4b264c

15 months agoMerge branch 'gerrit/stabilization-5949a1cb71'
Michael Blow [Sun, 2 May 2021 13:27:39 +0000 (09:27 -0400)] 
Merge branch 'gerrit/stabilization-5949a1cb71'

Change-Id: Id8c5f6de8ce3738a89994e87c3fc6d0ca7150d8e