asterixdb.git
6 months ago [ASTERIXDB-3007][COMP] Fix ConsolidateWindowOperatorsRule
Dmitry Lychagin [Mon, 31 Jan 2022 22:42:57 +0000 (14:42 -0800)] 
 [ASTERIXDB-3007][COMP] Fix ConsolidateWindowOperatorsRule

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Fix ConsolidateWindowOperatorsRule to correclty merge window
  operator with subplans into window operator without subplans
- Fix deep copy visitors for window operator with subplans
- Add compiler sanity check code to verify that each nested tuple
  source operator correctly points to its datasource operator

Change-Id: Ib9077a0331ab57cdd449426be77f05741d0778cc
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/15063
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
6 months ago[ASTERIXDB-2981][EXT] Handle Parquet specialized types
Wail Alkowaileet [Mon, 31 Jan 2022 18:42:20 +0000 (10:42 -0800)] 
[ASTERIXDB-2981][EXT] Handle Parquet specialized types

- user model changes: yes
- storage format changes: no
- interface changes: no

Details:
- Handle parquet specialized types
- Supported types: Date, Time, Timestamp, Binary, JSON,
  BSON (as Binary), Decimal (converted to double), UUID
- By default, type conversion for decimal is not enabled
  - To enable decimal convertion, an option must be passed
    during dataset creation (see parquet-types.1.ddl.sqlpp)
- UTC-adjusted timestamos values can re-adjusted to local
  values by setting the the timezone ID using "timezone"
  option upon creating a dataset.
- Documentation is also included in this patch

Change-Id: I345809e16aeb91f0a28d6592e1b8799e48434051
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/13903
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

6 months agoMerge release 0.9.7
Ian Maxon [Thu, 27 Jan 2022 19:49:12 +0000 (11:49 -0800)] 
Merge release 0.9.7

(cherry picked from commit 4ba929313)

Change-Id:If97ac8dad8df435c9a0c15ef4d7a7ef12bb3acde
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/15043
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
6 months ago[NO ISSUE][CONF] Removed unused active partitions config
Murtadha Hubail [Thu, 27 Jan 2022 20:17:03 +0000 (23:17 +0300)] 
[NO ISSUE][CONF] Removed unused active partitions config

- user model changes: no
- storage format changes: no
- interface changes: no

Details:

- Remove unused active partitions config.
- Improved node partitions logging.
- Logging fixes.

Change-Id: I4f2a611e2846405738401310f485db0e72844031
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/15024
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
6 months ago[NO ISSUE][STO] Skip flush on datasets with no open indexes
Murtadha Hubail [Thu, 27 Jan 2022 22:17:16 +0000 (01:17 +0300)] 
[NO ISSUE][STO] Skip flush on datasets with no open indexes

- user model changes: no
- storage format changes: no
- interface changes: no

Details:

- When attempting to flush a dataset, skip if the dataset has
  no open indexes.
- Halt when no primary index is open while other indexes are
  open to clear the inconsistent memory state.

Change-Id: Ib30f8bbbad03f5563ce27d573553f562d0ae484d
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/15025
Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Tested-by: Murtadha Hubail <mhubail@apache.org>
6 months ago[NO ISSUE][IDX] Do not store source indicators for primary key indexes
Ali Alsuliman [Tue, 25 Jan 2022 21:08:15 +0000 (13:08 -0800)] 
[NO ISSUE][IDX] Do not store source indicators for primary key indexes

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
Since secondary primary key indexes do not have/store SKs, there
should be no matching source indicators.

Change-Id: I6c2b3bb8115b6a079ccde28cb20c28a248b6b95b
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/15004
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
6 months ago[NO ISSUE][STO] Fix search when switching from memory to disk component
Ali Alsuliman [Tue, 25 Jan 2022 04:40:17 +0000 (20:40 -0800)] 
[NO ISSUE][STO] Fix search when switching from memory to disk component

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- When searching the index and making the switch from the memory
  components to the disk components, keep the states of the queue and
  the cursors on the switched-to disk components the same as their
  states were on the memory components. If a cursor was the one who
  produced the outputElement, then do not push the next element into
  the queue from the cursor since there should not be an element in
  the queue from this cursor. Restart the search operation at the
  elements that the cursors were at and consume them since they were
  already consumed before we make the switch.

- add test case.

Change-Id: I647641f6044c1edf1477049be1c5d1b697f404c1
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14885
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
6 months ago[NO ISSUE][TEST] Introduce helper methods in TestExecutor
Dmitry Lychagin [Fri, 21 Jan 2022 05:47:06 +0000 (21:47 -0800)] 
[NO ISSUE][TEST] Introduce helper methods in TestExecutor

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Extract helper methods to list dataverses,
  datasets and to drop a dataverse

Change-Id: If347992216958d72eab5d8f38c9373f78121bd66
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14887
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
6 months agoMerge branch 'gerrit/stabilization-5e11053887'
Michael Blow [Mon, 24 Jan 2022 15:18:28 +0000 (10:18 -0500)] 
Merge branch 'gerrit/stabilization-5e11053887'

Change-Id: I62fe3d7d27eb7906fd0922eb5e36f42aeabcde27

6 months ago[NO ISSUE]: update azure dependencies
Michael Blow [Sun, 23 Jan 2022 17:38:22 +0000 (12:38 -0500)] 
[NO ISSUE]: update azure dependencies

 - com.azure:azure-storage-blob .......... 12.12.0 -> 12.14.3
 - com.azure:azure-storage-common ........ 12.12.0 -> 12.14.2

Change-Id: I6c0c6bc39031675f606d789d00678bf224f3bbfb
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14944
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Tested-by: Michael Blow <mblow@apache.org>
6 months agoMerge branch 'gerrit/stabilization-02ea049d7a'
Michael Blow [Sun, 23 Jan 2022 15:38:03 +0000 (10:38 -0500)] 
Merge branch 'gerrit/stabilization-02ea049d7a'

Change-Id: Icde6ac90cccb845b4973155eac5a0380e8f6ff58

6 months ago[NO ISSUE][MISC] Update dependencies
Michael Blow [Sat, 22 Jan 2022 13:08:51 +0000 (08:08 -0500)] 
[NO ISSUE][MISC] Update dependencies

 - AWS Java SDK version ................ 2.10.83 -> 2.17.116
 - org.apache.maven.plugin-tools:
       maven-plugin-annotations ............. 3.6.0 -> 3.6.4
 - org.apache.maven.plugins:
       maven-remote-resources-plugin ........ 1.6.0 -> 1.7.0

Change-Id: Icdd8555e595e7d157578621e918c2d176ca86de0
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14923
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
6 months ago[NO ISSUE][HYR][HDFS] Exclude netty-all transitive dependency from hadoop
Michael Blow [Fri, 21 Jan 2022 13:51:39 +0000 (08:51 -0500)] 
[NO ISSUE][HYR][HDFS] Exclude netty-all transitive dependency from hadoop

Change-Id: I659caef68dea27a55c81a38930760b8c9720601b
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14903
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
6 months agoMerge branch 'gerrit/stabilization-5949a1cb71'
Michael Blow [Fri, 21 Jan 2022 02:42:18 +0000 (21:42 -0500)] 
Merge branch 'gerrit/stabilization-5949a1cb71'

Change-Id: I6d9ed728c40d740cdecde440cadce441ce515798

6 months ago[NO ISSUE][MISC] Update dependencies
Michael Blow [Wed, 19 Jan 2022 02:11:26 +0000 (21:11 -0500)] 
[NO ISSUE][MISC] Update dependencies

 - com.fasterxml.jackson.core:jackson-annotations .. 2.13.0 -> 2.13.1
 - com.fasterxml.jackson.core:jackson-core ......... 2.13.0 -> 2.13.1
 - com.fasterxml.jackson.core:jackson-databind ..... 2.13.0 -> 2.13.1
 - commons-io:commons-io ............................ 2.8.0 -> 2.11.0
 - io.netty:netty-buffer ............... 4.1.69.Final -> 4.1.73.Final
 - io.netty:netty-codec ................ 4.1.69.Final -> 4.1.73.Final
 - io.netty:netty-codec-http............ 4.1.69.Final -> 4.1.73.Final
 - io.netty:netty-common ............... 4.1.69.Final -> 4.1.73.Final
 - io.netty:netty-handler .............. 4.1.69.Final -> 4.1.73.Final
 - io.netty:netty-transport ............ 4.1.69.Final -> 4.1.73.Final
 - junit:junit ....................................... 4.13 -> 4.13.2
 - org.apache.maven:maven-artifact ................... 3.8.3 -> 3.8.4
 - org.apache.maven:maven-compat ..................... 3.8.3 -> 3.8.4
 - org.apache.maven:maven-core ....................... 3.8.3 -> 3.8.4
 - org.apache.maven:maven-model ...................... 3.8.3 -> 3.8.4
 - org.apache.maven:maven-plugin-api ................. 3.6.0 -> 3.8.4
 - org.apache.httpcomponents:httpcore .............. 4.4.14 -> 4.4.15
 - org.apache.httpcomponents:httpcore-nio .......... 4.4.10 -> 4.4.15
 - org.freemarker:freemarker ....................... 2.3.29 -> 2.3.31
 - org.slf4j:slf4j-api ............................. 1.7.25 -> 1.7.33
 - org.slf4j:slf4j-simple .......................... 1.7.28 -> 1.7.33

Change-Id: I3d4520195b91630bd75219f0ca23f25589750b31
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14864
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Michael Blow <mblow@apache.org>
6 months ago[NO ISSUE][MISC] Update log4j2 dependencies 2.15.0 -> 2.17.1
Michael Blow [Tue, 4 Jan 2022 17:07:17 +0000 (12:07 -0500)] 
[NO ISSUE][MISC] Update log4j2 dependencies 2.15.0 -> 2.17.1

Change-Id: I7ecc188266713b9e00828cc3af2b23512e2ca1f3
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14863
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Tested-by: Michael Blow <mblow@apache.org>
6 months ago[NO ISSUE][MISC] License plugin enhancement to aggregate overrides
Michael Blow [Wed, 19 Jan 2022 13:10:42 +0000 (08:10 -0500)] 
[NO ISSUE][MISC] License plugin enhancement to aggregate overrides

(partial cherry-pick of 5e44128bc13a93a3cadb12a87ecd691218481447)

Change-Id: Ifc2c719a6dc840d2846d68d1b649e12bec9f22db
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14865
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Tested-by: Michael Blow <mblow@apache.org>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

6 months ago[ASTERIXDB-2950][COMP] Improve error message on type mismatch
Dmitry Lychagin [Mon, 17 Jan 2022 22:19:11 +0000 (14:19 -0800)] 
[ASTERIXDB-2950][COMP] Improve error message on type mismatch

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Change NonTaggedGetItemResultType.getResultType() to
  raise ASX1002 instead of failng with ClassCastException

Change-Id: Ie5ce017b4927ea08e102af096a5d2b69e8bef550
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14844
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
6 months ago[ASTERIXDB-3006][COMP] Change translation of inner joins in subplans
Dmitry Lychagin [Sat, 15 Jan 2022 02:49:50 +0000 (18:49 -0800)] 
[ASTERIXDB-3006][COMP] Change translation of inner joins in subplans

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Translate inner join inside subplan into unnest/subplan
  operators instead of a join operator. The join will be
  introduced later by the optimizer
- This translation matches expectations of
  InlineSubplanInputForNestedTupleSourceRule
- Add testcase

Change-Id: I46d6ca1bfaa9f76012adaa21a2aeca56b4d93afb
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14825
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
6 months ago[ASTERIXDB-3004][RT] Improve hash join performance
Dmitry Lychagin [Thu, 13 Jan 2022 01:03:52 +0000 (17:03 -0800)] 
[ASTERIXDB-3004][RT] Improve hash join performance

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Improve hash join performance when joined values are NULL/MISSING
- Add SqlppHashJoinRQJTest to test different hash join scenarios

Change-Id: I8f0afb05908e8281f2865775e074d459964fe989
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14784
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
6 months ago[ASTERIXDB-3005][EXT]: Ignore byte order mark when reading ext data
Hussain Towaileb [Thu, 13 Jan 2022 20:34:51 +0000 (23:34 +0300)] 
[ASTERIXDB-3005][EXT]: Ignore byte order mark when reading ext data

Change-Id: Ic7a863097ec4a6adad018785011f0d26d540f2a5
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14785
Tested-by: Hussain Towaileb <hussainht@gmail.com>
Integration-Tests: Hussain Towaileb <hussainht@gmail.com>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Reviewed-by: Michael Blow <mblow@apache.org>
6 months agoMerge "Merge branch 'gerrit/mad-hatter'"
Apache AsterixDB Gerrit [Wed, 12 Jan 2022 18:11:39 +0000 (18:11 +0000)] 
Merge "Merge branch 'gerrit/mad-hatter'"

6 months agoMerge branch 'gerrit/mad-hatter'
Michael Blow [Wed, 12 Jan 2022 13:42:37 +0000 (08:42 -0500)] 
Merge branch 'gerrit/mad-hatter'

Change-Id: I3bc19fae68eba9316d8b750e2c8b296de8677b06

6 months ago[No ISSUE] Update notices years
Wail Alkowaileet [Sun, 9 Jan 2022 18:01:04 +0000 (10:01 -0800)] 
[No ISSUE] Update notices years

Update notices years to include 2022

Change-Id: I0f0a21833557b6ff882822dec1b734009350ac53
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14763
Reviewed-by: Wael Alkowaileet <wael.y.k@gmail.com>
Reviewed-by: Ian Maxon <imaxon@uci.edu>
Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
7 months ago[NO ISSUE][COMP] Implement SQL-compat mode for UNION ALL
Dmitry Lychagin [Wed, 5 Jan 2022 02:26:15 +0000 (18:26 -0800)] 
[NO ISSUE][COMP] Implement SQL-compat mode for UNION ALL

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- SQL-compat mode: make UNION ALL follow SQL semantics
  (only named projections are supported, other projection
  kinds fail if used with UNION ALL in this mode)
- Add testcases

Change-Id: Ifb519ff7e6475f11ca5a3d2dc246396ea34886bb
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14684
Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
7 months ago[ASTERIXDB-2988][COMP] Fix compile-time error with indexnl hint
Dmitry Lychagin [Thu, 6 Jan 2022 19:36:52 +0000 (11:36 -0800)] 
[ASTERIXDB-2988][COMP] Fix compile-time error with indexnl hint

- user model changes: no
- storage format changes: no
- interface changes: no

- Fixed internal compiler error (ASX1030) when indexnl hint
  is specified and the probe branch does not have a primary
  key. For now ingore the hint in this case

Change-Id: Ic31d9fdc870b4d19a375cab0d2c8d7a452600c55
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14724
Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
7 months ago[NO ISSUE][IDX] Clean up validating the indexed fields types
Ali Alsuliman [Thu, 6 Jan 2022 00:32:18 +0000 (16:32 -0800)] 
[NO ISSUE][IDX] Clean up validating the indexed fields types

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
When checking the type of the indexed field, the actual type
is checked. Remove UNION type from valid types of indexed field.

Change-Id: Ib70a3550411617c752b3acead778e2958e61dbb9
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14703
Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
7 months ago[NO ISSUE] Update log4j2 dependencies 2.17.0 -> 2.17.1
Michael Blow [Tue, 4 Jan 2022 17:07:17 +0000 (12:07 -0500)] 
[NO ISSUE] Update log4j2 dependencies 2.17.0 -> 2.17.1

Change-Id: I7ecc188266713b9e00828cc3af2b23512e2ca1f3
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14683
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
7 months ago[ASTERIXDB-3001][MVN] Grammarix not finding all productions
ggalvizo [Mon, 27 Dec 2021 13:58:51 +0000 (06:58 -0700)] 
[ASTERIXDB-3001][MVN] Grammarix not finding all productions

- user model changes: no
- storage format changes: no
- interface changes: no

Grammarix was mishandling the '"' case for quotes, making nearly
all productions after LiteralExpression not extensible.

Change-Id: Ib5d840237ee1224a4225cb67c795f3ac08452a76
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14663
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
7 months ago[NO ISSUE][HYR][UTL] Add methods to extract query params from a uri
Michael Blow [Tue, 21 Dec 2021 02:42:49 +0000 (21:42 -0500)] 
[NO ISSUE][HYR][UTL] Add methods to extract query params from a uri

Change-Id: Ifac17d25b72b5a550a626325fcd6f9d5fe91407e
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14623
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
7 months ago[NO ISSUE][HYR][MISC] Add option to provide tracer args via Suppliers
Michael Blow [Wed, 22 Dec 2021 14:36:02 +0000 (09:36 -0500)] 
[NO ISSUE][HYR][MISC] Add option to provide tracer args via Suppliers

Change-Id: I040523a73e65a0fd86fff3fff38d2278d83ef65f
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14643
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
7 months ago[NO ISSUE][TEST] Share CAST modifier tests
Ali Alsuliman [Wed, 22 Dec 2021 07:58:32 +0000 (23:58 -0800)] 
[NO ISSUE][TEST] Share CAST modifier tests

- user model changes: no
- storage format changes: no
- interface changes: no

Details:

Change-Id: If1371f2cd6229e9c3841148f2304e88e5419191d
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14563
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Michael Blow <mblow@apache.org>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
7 months ago[NO ISSUE] Update log4j2 dependencies 2.15.0 -> 2.17.0
Ian Maxon [Fri, 17 Dec 2021 01:09:53 +0000 (17:09 -0800)] 
[NO ISSUE] Update log4j2 dependencies 2.15.0 -> 2.17.0

Change-Id: I132118b602908d28ce559a3a32ed1688b1ce5a29
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14584
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
7 months ago[NO ISSUE] Update log4j2 dependencies 2.16.0 -> 2.17.0
Michael Blow [Sun, 19 Dec 2021 11:36:40 +0000 (06:36 -0500)] 
[NO ISSUE] Update log4j2 dependencies 2.16.0 -> 2.17.0

Change-Id: I09895d2514f7e67f080b6b3523da02be0b03a15f
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14603
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Michael Blow <mblow@apache.org>
7 months ago[NO ISSUE] Update log4j2 dependencies 2.15.0 -> 2.16.0
Ian Maxon [Fri, 17 Dec 2021 01:09:53 +0000 (17:09 -0800)] 
[NO ISSUE] Update log4j2 dependencies 2.15.0 -> 2.16.0

Change-Id: I132118b602908d28ce559a3a32ed1688b1ce5a29
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14564
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ian Maxon <imaxon@uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
7 months ago[NO ISSUE][EXT][AZDL]: Skip instead of failing when json file not found
Hussain Towaileb [Fri, 17 Dec 2021 14:25:11 +0000 (17:25 +0300)] 
[NO ISSUE][EXT][AZDL]: Skip instead of failing when json file not found

Details:
- When a JSON file is not found while reading external azure
  datalake dataset, skip the file and continue reading, do
  not fail.

Change-Id: Ic9b04e418483cc245379e35c9a20f1a4c4389e87
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14583
Tested-by: Hussain Towaileb <hussainht@gmail.com>
Integration-Tests: Hussain Towaileb <hussainht@gmail.com>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
7 months ago[ASTERIXDB-3000] Incorrect result in SQL-compat mode
Dmitry Lychagin [Thu, 16 Dec 2021 01:29:17 +0000 (17:29 -0800)] 
[ASTERIXDB-3000] Incorrect result in SQL-compat mode

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Fix incorrect subquery coercion rewriting in SQL-compat
  mode if the subquery has an ORDER BY clause
- Add tests

Change-Id: Ia852f20864c2098221011dee4f2c738a52dc8368
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14543
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
7 months ago[ASTERIXDB-2999][RT] Round towards zero when convering floating-point to integer
Dmitry Lychagin [Mon, 13 Dec 2021 20:50:10 +0000 (12:50 -0800)] 
[ASTERIXDB-2999][RT] Round towards zero when convering floating-point to integer

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Remove use of Math.floor() during floating-point to integer conversion.
  The conversion code now rounds both positivie and negative values towards zero
- Update index selection code to account for this change
- Add SqlppNumericIndexRQGTest to randomly test different combinations
  of indexes on numeric fields

Change-Id: I1c92d6235e16e6c5d9dadd7a09cd9703781eadb6
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14525
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
7 months ago[NO ISSUE][FUN] Code refactoring of StringJsonParseDescriptor
Ali Alsuliman [Fri, 10 Dec 2021 00:37:41 +0000 (16:37 -0800)] 
[NO ISSUE][FUN] Code refactoring of StringJsonParseDescriptor

- user model changes: no
- storage format changes: no
- interface changes: no

Details:

Change-Id: I3e2dbade466d1a534af39d42a0414ba287d31933
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14423
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
7 months ago[NO ISSUE] Update log4j2 dependencies 2.14.1 -> 2.15.0
Michael Blow [Fri, 10 Dec 2021 12:27:07 +0000 (07:27 -0500)] 
[NO ISSUE] Update log4j2 dependencies 2.14.1 -> 2.15.0

(cherry picked from commit 641196863c84bf1790e6f885508c8eb78a3e6511)

Change-Id: I685005dfffa27ea50fef15ba8c9466f0b4f812db
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14463
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ian Maxon <imaxon@uci.edu>
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14523
Reviewed-by: Michael Blow <mblow@apache.org>
Tested-by: Michael Blow <mblow@apache.org>
7 months agoMerge branch 'gerrit/log4jfix-5e11053887'
Michael Blow [Sat, 11 Dec 2021 16:42:42 +0000 (11:42 -0500)] 
Merge branch 'gerrit/log4jfix-5e11053887'

Change-Id: I7d35496c98ddd528667dd0582659f2f9eb9fe5de

7 months ago[NO ISSUE] Update log4j2 dependencies 2.14.1 -> 2.15.0
Michael Blow [Fri, 10 Dec 2021 12:27:07 +0000 (07:27 -0500)] 
[NO ISSUE] Update log4j2 dependencies 2.14.1 -> 2.15.0

(cherry picked from commit 641196863c84bf1790e6f885508c8eb78a3e6511)

Change-Id: I685005dfffa27ea50fef15ba8c9466f0b4f812db
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14485
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Tested-by: Michael Blow <mblow@apache.org>
8 months agoMerge branch 'gerrit/stabilization-f69489'
Michael Blow [Fri, 10 Dec 2021 14:22:38 +0000 (09:22 -0500)] 
Merge branch 'gerrit/stabilization-f69489'

Change-Id: Ie67b5c38d267d3e8b01e4b0989f688d155311909

8 months ago[NO ISSUE] Update log4j2 dependencies 2.14.1 -> 2.15.0
Michael Blow [Fri, 10 Dec 2021 12:27:07 +0000 (07:27 -0500)] 
[NO ISSUE] Update log4j2 dependencies 2.14.1 -> 2.15.0

Change-Id: I685005dfffa27ea50fef15ba8c9466f0b4f812db
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14443
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

8 months ago[NO ISSUE][IDX] Disable index only plan when index includes UNKNOWNs
Ali Alsuliman [Fri, 10 Dec 2021 01:20:13 +0000 (17:20 -0800)] 
[NO ISSUE][IDX] Disable index only plan when index includes UNKNOWNs

- user model changes: no
- storage format changes: no
- interface changes: no

Details:

Change-Id: I330aaaa1792ad7fe1b264f6e10577c3defe8eeec
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14405
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
8 months ago[NO ISSUE][FUN] extend object_concat to support an input array
Ali Alsuliman [Thu, 9 Dec 2021 00:11:42 +0000 (16:11 -0800)] 
[NO ISSUE][FUN] extend object_concat to support an input array

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
object_concat() should support an array of objects as
a signle input.

Change-Id: I2bf24229b5390106d06049c43af972734c6f9fd2
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14404
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
8 months ago[NO ISSUE][COMP] Align SecondaryCorrelatedBTreeOperationsHelper with SecondaryBTreeOp...
Ali Alsuliman [Wed, 8 Dec 2021 00:33:30 +0000 (16:33 -0800)] 
[NO ISSUE][COMP] Align SecondaryCorrelatedBTreeOperationsHelper with SecondaryBTreeOperationsHelper

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
Align SecondaryCorrelatedBTreeOperationsHelper with SecondaryBTreeOperationsHelper
in terms of handling CAST modifier. Cast only the indexed fields and
remove casting the whole dataset record similar to SecondaryBTreeOperationsHelper.
Similarly, Handle INCLUDE/EXCLUDE UNKNOWN KEY when bulk loading secondary indexes on
correlated datasets.

- Refactor methods for sharing:
  createFieldAccessor(), createFieldCast(), createConstructorFunction(), excludeUnknownKeys()
- Make the built type for the overridden fields with CAST modifier nullable

Change-Id: Ieff55b1a3e3dbc965f7108f7e2ca86f92d5a8a55
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14385
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
8 months agoMerge "Merge branch 'gerrit/stabilization-5e11053887'"
Apache AsterixDB Gerrit [Wed, 8 Dec 2021 19:21:07 +0000 (19:21 +0000)] 
Merge "Merge branch 'gerrit/stabilization-5e11053887'"

8 months ago[NO ISSUE] Updates to enable build w/ Java 17
Michael Blow [Tue, 7 Dec 2021 19:51:36 +0000 (14:51 -0500)] 
[NO ISSUE] Updates to enable build w/ Java 17

Change-Id: I83cc3d52ec4c683848ed24648eb1f277b0bca543
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14384
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
8 months agoMerge branch 'gerrit/stabilization-5e11053887'
Michael Blow [Wed, 8 Dec 2021 15:06:12 +0000 (10:06 -0500)] 
Merge branch 'gerrit/stabilization-5e11053887'

Change-Id: I1cb9c41981ac7f143591a7fad58ef86b0285eafb

8 months agoMerge branch 'gerrit/stabilization-02ea049d7a'
Michael Blow [Sun, 5 Dec 2021 03:00:24 +0000 (22:00 -0500)] 
Merge branch 'gerrit/stabilization-02ea049d7a'

Change-Id: I5036734c21343389c7378a06eb9cfb10948af4db

8 months ago[ASTERIXDB-2994][EXT]: Fix broken parquet format for azure datalake
Hussain Towaileb [Mon, 6 Dec 2021 11:27:35 +0000 (14:27 +0300)] 
[ASTERIXDB-2994][EXT]: Fix broken parquet format for azure datalake

Change-Id: I990c4b749d43ebafa4f25450b05c9f27dfd5e632
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14363
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Wael Alkowaileet <wael.y.k@gmail.com>
8 months ago[ASTERIXDB-2972][RT] Properly set UDF distribution host
Ian Maxon [Thu, 2 Dec 2021 19:25:53 +0000 (11:25 -0800)] 
[ASTERIXDB-2972][RT] Properly set UDF distribution host

    - user model changes: no
    - storage format changes: no
    - interface changes: no

    Details:

    - Set the download host for UDF distribution to be
      the node that recieved the UDF
    - Fix incorrect message response class for error
      conditions during UDF deployment

Change-Id: I7de293d236909da67c98306250d4bda5e65f7110
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/13587
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
8 months ago[NO ISSUE][COMP] Support overrding type of closed field with CAST
Ali Alsuliman [Sat, 4 Dec 2021 03:24:21 +0000 (19:24 -0800)] 
[NO ISSUE][COMP] Support overrding type of closed field with CAST

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
When creating a secondary index on a field that is part of the
schema, allow overriding its type only when CAST modifier is
specified. This is to support views created on fields that are
part of the schema and need to utilize a secondary index.

Change-Id: I63cb476577c746e9b49906f4fb9f284a23e99cd1
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14323
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
8 months agoMerge branch 'gerrit/stabilization-5949a1cb71'
Michael Blow [Sat, 4 Dec 2021 11:02:34 +0000 (06:02 -0500)] 
Merge branch 'gerrit/stabilization-5949a1cb71'

Change-Id: I25a448cca69e3a90e2ce83a0b64dd253c9ad92f5

8 months ago[NO ISSUE][MISC] Update dependencies
Michael Blow [Fri, 29 Oct 2021 00:11:23 +0000 (20:11 -0400)] 
[NO ISSUE][MISC] Update dependencies

- com.fasterxml.jackson.core:jackson-annotations .. 2.12.3 -> 2.13.0
- com.fasterxml.jackson.core:jackson-core ......... 2.12.3 -> 2.13.0
- com.fasterxml.jackson.core:jackson-databind ..... 2.12.3 -> 2.13.0
- com.google.guava:guava .................... 30.1-jre -> 31.0.1-jre
- it.unimi.dsi:fastutil ............................. 8.3.0 -> 8.5.6
- it.unimi.dsi:fastutil-core ........................ 8.3.0 -> 8.5.6
- org.apache.commons:commons-csv ...................... 1.8 -> 1.9.0
- org.apache.logging.log4j:log4j-1.2-api .......... 2.13.1 -> 2.14.1
- org.apache.maven:maven-artifact ................... 3.6.3 -> 3.8.3
- org.apache.maven:maven-compat ..................... 3.6.3 -> 3.8.3
- org.apache.maven:maven-core ....................... 3.6.3 -> 3.8.3
- org.apache.maven:maven-model ...................... 3.6.3 -> 3.8.3
- org.apache.maven:maven-plugin-api ................. 3.6.3 -> 3.8.3
- org.xerial.snappy:snappy-java ................. 1.1.7.1 -> 1.1.8.4

- io.netty:netty-all:4.1.63.Final
   -> io.netty:netty-buffer:4.1.69.Final
   -> io.netty:netty-codec:4.1.69.Final
   -> io.netty:netty-codec-http:4.1.69.Final
   -> io.netty:netty-common:4.1.69.Final
   -> io.netty:netty-handler:4.1.69.Final
   -> io.netty:netty-resolver:4.1.69.Final
   -> io.netty:netty-transport:4.1.69.Final

(cherry picked from commit 951b9cc768978ec809d68cc49be1fb29b9bc499a)

Change-Id: I9aac58028de1a7c0e228eee3c78a39e7f3d0e431
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14265
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
8 months agoASTERIXDB-2993: Proper error message for "parquet" on datalake and gcs
Hussain Towaileb [Thu, 2 Dec 2021 17:16:41 +0000 (20:16 +0300)] 
ASTERIXDB-2993: Proper error message for "parquet" on datalake and gcs

Details:
- Parquet format external datasets are not supported for azure
  datalake and google cloud storage, this change ensure
  failing with a proper error message.

Change-Id: Id178275eec09d64582149f33d1f8e9c0cf79fc4a
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14303
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
8 months ago[NO ISSUE][COMP] Make LeftOuterJoin produce NULL in SQL-compat mode
Dmitry Lychagin [Tue, 30 Nov 2021 00:25:40 +0000 (16:25 -0800)] 
[NO ISSUE][COMP] Make LeftOuterJoin produce NULL in SQL-compat mode

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- SQL-compat mode: make Left Outer Join emit NULL instead of
  MISSING for non-matching values
- SQL-compat mode: make Left Outer Unnest emit NULL instead of
  MISSING if there are no items in the input list
- Fix comparison of AsterixConstantValue with
  IAlgebricksConstantValue which is NULL/MISSING or BOOLEAN
- Add testcases

Change-Id: Ib39bd4e704015bbd38a2bf0b8d3a54bdbd7cd7e1
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14244
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
8 months ago[ASTERIXDB-2992][FUN] Integer type constructors should accept non-integers
Dmitry Lychagin [Wed, 1 Dec 2021 04:34:16 +0000 (20:34 -0800)] 
[ASTERIXDB-2992][FUN] Integer type constructors should accept non-integers

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Make integer type constructors accept non-integer
  numbers and convert them to integers
- Add testcases

Change-Id: Iba39eaa04a70cdb6cc50f2399263459197af2820
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14283
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
8 months ago[ASTERIXDB-2949][RUN][FUN] SUBSTR function produces malformed string
Ali Alsuliman [Tue, 17 Aug 2021 15:00:11 +0000 (18:00 +0300)] 
[ASTERIXDB-2949][RUN][FUN] SUBSTR function produces malformed string

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Fix UTF8StringBuilder grow logic

UTF8StringBuilder initially takes an estimated length of the
string to be written and reserves space at the beginning
of the buffer to later store the length of the data written.
When the actual data written happens to be greater than the
estimated length requiring more space to store the length,
the string content needs to be shifted.

This patch is to fix the starting offset of the data to be shifted.
Also, the estimated length calculation of the substring method of
the UTF8StringPointable is modified to account for
SUBSTR(input_string, 0, num_chars_to_substring) with start offset = 0.

(cherry picked from commit cc6143b4ef5bb3f505478ada2bd95350a0758f6a)

Change-Id: If36253ff884a9c19eaa130c4e5e926f2dd9eea1d
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14264
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
8 months ago[NO ISSUE][COMP] Change SqlppStatementUtil to specify CAST option
Ali Alsuliman [Tue, 30 Nov 2021 05:19:07 +0000 (21:19 -0800)] 
[NO ISSUE][COMP] Change SqlppStatementUtil to specify CAST option

- user model changes: no
- storage format changes: no
- interface changes: no

Details:

Change-Id: I7a2d6dbd0d25cf3e2b5edc0c6aa26810fceb09f1
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14245
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
8 months ago[NO ISSUE][COMP] Add datetime format for CREATE INDEX
Ali Alsuliman [Wed, 24 Nov 2021 20:51:32 +0000 (12:51 -0800)] 
[NO ISSUE][COMP] Add datetime format for CREATE INDEX

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
Add datetime format for CREATE INDEX statement:
CREATE INDEX ...
CAST (DEFAULT NULL datetime 'format' date 'format' time 'format').

- Add the datetime format to the index metadata.
- Refactor methods from ViewUtil to DateTimeFormatUtils.

Change-Id: I087bb2bd79ba1ccfb9a6bbc910dfdb854b75dc9b
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14164
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
8 months agoMerge branch 'gerrit/stabilization-5949a1cb71'
Michael Blow [Wed, 24 Nov 2021 17:07:58 +0000 (12:07 -0500)] 
Merge branch 'gerrit/stabilization-5949a1cb71'

Change-Id: Iaa206a731edf30d598d8b5eb8bd472ab8b9cc9f9

8 months ago[NO ISSUE][HYR][NET] += trust store to sec cfg
Michael Blow [Tue, 23 Nov 2021 21:02:21 +0000 (16:02 -0500)] 
[NO ISSUE][HYR][NET] += trust store to sec cfg

Change-Id: I358eb5b9b0f0f40b1588c12ed473e4e920e8fbbe
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14184
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Ian Maxon <imaxon@uci.edu>
8 months ago[ASTERIXDB-2991][EXT] Update Azure Blob & Datalake SDKs
Hussain Towaileb [Tue, 23 Nov 2021 12:34:55 +0000 (15:34 +0300)] 
[ASTERIXDB-2991][EXT] Update Azure Blob & Datalake SDKs

com.azure:azure-core........................... 1.17.0 -> 1.22.0
com.azure:azure-core-http-netty................ 1.10.0 -> 1.11.2
com.azure:azure-storage-blob................... 12.12.0 -> 12.14.2
com.azure:azure-storage-common................. 12.12.0 -> 12.14.1
com.azure:azure-storage-internal-avro.......... 12.0.5 -> 12.1.2
com.azure:azure-storage-file-datalake.......... 12.7.0 -> 12.7.2
io.projectreactor.netty:reactor-netty-core..... 1.0.7 -> 1.0.11
io.projectreactor.netty:reactor-netty-http..... 1.0.7 -> 1.0.11
io.projectreactor:reactor-core................. 3.4.6 -> 3.4.10
jackson-datatype-jsr310........................ 2.12.3 -> 2.12.5

Change-Id: Ie034686c8882147359307f8405f6ad10c91d7214
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14143
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Tested-by: Hussain Towaileb <hussainht@gmail.com>
Integration-Tests: Hussain Towaileb <hussainht@gmail.com>

8 months ago[ASTERIXDB-2990][FUN] Introduce parse_json()
Wail Alkowaileet [Tue, 23 Nov 2021 05:54:11 +0000 (21:54 -0800)] 
[ASTERIXDB-2990][FUN] Introduce parse_json()

- user model changes: yes
- storage format changes: no
- interface changes: no

Details:
Introduce parse_json() function to parse string values as ADM

Change-Id: I1be6eb2a5abaffa4b4dffba93d5bf91d46f4fcb8
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14123
Reviewed-by: Wael Alkowaileet <wael.y.k@gmail.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

8 months ago[ASTERIXDB-2987] Fixes the wrong order of record descriptors for spatial and interval...
Akil Sevim [Fri, 19 Nov 2021 21:34:17 +0000 (13:34 -0800)] 
[ASTERIXDB-2987] Fixes the wrong order of record descriptors for spatial and interval joins

- user model changes: no
- storage format changes: no
- interface changes: no

Details:

- Fixes the wrong order of record descriptors in optimized spatial and interval join which causes empty results when the projected fields from both sides does not yield the same schema.
- Adds tests for the corresponding fix

Change-Id: I4f7186459a490beaac08624e7a5cbe09734a82ad
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14124
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Contrib: Ian Maxon <imaxon@uci.edu>
Reviewed-by: Ian Maxon <imaxon@uci.edu>
8 months ago[NO ISSUE][CONF] Make partitions related config visible
Murtadha Hubail [Mon, 22 Nov 2021 15:18:36 +0000 (18:18 +0300)] 
[NO ISSUE][CONF] Make partitions related config visible

- user model changes: no
- storage format changes: no
- interface changes: no

Change-Id: Ia1c6a3a0a6e4ac94351c9ef314482e2f224276c9
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14163
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
8 months ago[NO ISSUE][COMP] No subquery coercion in EXISTS clause
Dmitry Lychagin [Fri, 19 Nov 2021 22:30:16 +0000 (14:30 -0800)] 
[NO ISSUE][COMP] No subquery coercion in EXISTS clause

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- In SQL-compat mode do not perform subquery coecrion
  if the subquery is in EXISTS or NOT EXISTS clause
- Add testscases

Change-Id: If4ae567fc449e5fa6bb040555325f429e8953256
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14145
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
8 months ago[NO ISSUE][HYR][MISC] += ThrowingBi[Consumer|Function] ifaces
Michael Blow [Fri, 19 Nov 2021 12:43:32 +0000 (07:43 -0500)] 
[NO ISSUE][HYR][MISC] += ThrowingBi[Consumer|Function] ifaces

Change-Id: I6c884bc92ef6773bd17d127dc208bd09f5ce6808
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14144
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
8 months ago[ASTERIXDB-2989][LIC] Update S3 dependencies
Hussain Towaileb [Wed, 17 Nov 2021 13:15:26 +0000 (16:15 +0300)] 
[ASTERIXDB-2989][LIC] Update S3 dependencies

com.amazonaws:aws-java-sdk-dynamodb ............... 1.12.1 -> 1.12.109
com.amazonaws:aws-java-sdk-s3 ..................... 1.12.1 -> 1.12.109
software.amazon.awssdk:auth ....................... 2.10.83 -> 2.17.79
software.amazon.awssdk:aws-core ................... 2.10.83 -> 2.17.79
software.amazon.awssdk:http-client-spi ............ 2.10.83 -> 2.17.79
software.amazon.awssdk:regions .................... 2.10.83 -> 2.17.79
software.amazon.awssdk:s3 ......................... 2.10.83 -> 2.17.79
software.amazon.awssdk:sdk-core ................... 2.10.83 -> 2.17.79
org.reactivestreams:reactive-streams .............. 1.0.2 -> 1.0.3
com.typesafe.netty:netty-reactive-streams ......... 2.0.4 -> 2.0.5

Change-Id: Ibbb9d8032a465f044198d1252963abf88c961ff4
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14023
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Reviewed-by: Michael Blow <mblow@apache.org>
Tested-by: Hussain Towaileb <hussainht@gmail.com>
Integration-Tests: Hussain Towaileb <hussainht@gmail.com>

8 months ago[NO ISSUE][HYR][LIC] Configurable multiple LICENSE/NOTICE handling
Michael Blow [Wed, 17 Nov 2021 02:51:24 +0000 (21:51 -0500)] 
[NO ISSUE][HYR][LIC] Configurable multiple LICENSE/NOTICE handling

- += license.onMultipleEmbedded[License|Notice] flag, with gav:[concat|first] values
- 'concat' takes the contents of all LICENSE/NOTICE files, and concatenates them
  with delimiters indicating the source of each content
- 'first' selects the first match encountered in the 'jar'

The default behavior without flag is 'concat', with a WARNING emitted

Change-Id: I0cd5a008f71f80ac99eaf29f1e286eb222640480
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14104
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Michael Blow <mblow@apache.org>
8 months ago[NO ISSUE][FUN] Make default-null functions type computers always nullable
Ali Alsuliman [Tue, 16 Nov 2021 20:34:04 +0000 (12:34 -0800)] 
[NO ISSUE][FUN] Make default-null functions type computers always nullable

- user model changes: no
- storage format changes: no
- interface changes: no

Change-Id: I8060c98e992d6c8e8dbb15173e35b3c3b58a2a3a
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14084
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
8 months ago[NO ISSUE][REP] Send correct component ID on bulkload
Murtadha Hubail [Tue, 16 Nov 2021 17:18:21 +0000 (20:18 +0300)] 
[NO ISSUE][REP] Send correct component ID on bulkload

- user model changes: no
- storage format changes: no
- interface changes: yes

Details:

- When a secondary index is created, send the correct component id
  to the replica.
- Update the component id on replicas when receiving a bulkloaded
  component.

Change-Id: I5575cf9a61477636efc7e1291189a59e0a5266ae
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14103
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
8 months ago[NO ISSUE][COMP] Make views utilize secondary indexes
Ali Alsuliman [Tue, 16 Nov 2021 03:34:10 +0000 (19:34 -0800)] 
[NO ISSUE][COMP] Make views utilize secondary indexes

- user model changes: no
- storage format changes: no
- interface changes: yes

Details:
- For B-Tree access method, when analyzing the arguments of an optimizable
  function like LT (e.g $var < 8), allow function call expressions in
  addition to variable expressions.
- For B-Tree access method, accept only the default-null constructors as
  function call expressions.
- keep track of all the function calls that the logical variable $var is going
  through.
- set the position of the $var (or function call) in the optimizable function
  correctly.
- don't consider an index as a candidate when it does not match the access method.

Change-Id: I7ae50a7ccad9dc4dd2df221c4c643a4af04367b9
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14043
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
8 months ago[ASTERIXDB-2986][COMP] Fix bug in ExtractFunctionsFromJoinConditionRule
Dmitry Lychagin [Mon, 15 Nov 2021 22:28:01 +0000 (14:28 -0800)] 
[ASTERIXDB-2986][COMP] Fix bug in ExtractFunctionsFromJoinConditionRule

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Fix NullPointerException in ExtractFunctionsFromJoinConditionRule
  when one condition could be extracted but another could not
- Add testcase

Change-Id: Ib2cca56f36c9270fc337aab97f5c29fbcbb51543
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14083
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
8 months ago[ASTERIXDB-2983][EXT] Warn on no-files for Parquet instead of failing
Wail Alkowaileet [Mon, 15 Nov 2021 00:46:37 +0000 (16:46 -0800)] 
[ASTERIXDB-2983][EXT] Warn on no-files for Parquet instead of failing

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Parquet adapter fails (IOException) if no files were returned
- We should warn instead of failing to be consistent with other
  file formats (e.g., JSON)
- This patch also fixes inappropriate calls to
  IWarningCollector#shouldWarn()

Change-Id: Ie929046ef01ea5eee60d23f6e4665ac6727e2d1e
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14063
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Wael Alkowaileet <wael.y.k@gmail.com>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
8 months ago[NO ISSUE][FUN] Add cast-null functions for constructors
Ali Alsuliman [Thu, 11 Nov 2021 20:55:18 +0000 (12:55 -0800)] 
[NO ISSUE][FUN] Add cast-null functions for constructors

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Add cast-null type constructors that produce null for missing input.
- Make views use these types of constructors.
- Make secondary indexes with CAST (DEFAULT NULL) modifier use
  these types of constructors.

Change-Id: I120d18c4c7bbcf098fceaa6784cce265a2811e3b
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14027
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
8 months ago[NO ISSUE][CLUS] Interrupt global recovery on node failure
Murtadha Hubail [Wed, 10 Nov 2021 19:29:34 +0000 (22:29 +0300)] 
[NO ISSUE][CLUS] Interrupt global recovery on node failure

- user model changes: no
- storage format changes: no
- interface changes: no

Details:

- When a node fails while global recovery is on-going, interrupt
  recovery to avoid unnecessary waiting.

Change-Id: I58852e046ff4021f4c5d115f5c3488b249fc61a2
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14025
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
8 months ago[NO ISSUE][COMP] Automatically adjust primary key field type
Dmitry Lychagin [Thu, 11 Nov 2021 01:25:28 +0000 (17:25 -0800)] 
[NO ISSUE][COMP] Automatically adjust primary key field type

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Automatically set type quantifier to NOT UKNOWN for
  primary key fields in CREATE DATASET / VIEW with
  inline type definition

Change-Id: Id01e3a1a30a44964d5a2a71305b3e3d14ecacfb9
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14026
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
8 months ago[NO ISSUE][COMP] Disallow duplicate field names in CREATE TYPE
Dmitry Lychagin [Wed, 10 Nov 2021 19:15:50 +0000 (11:15 -0800)] 
[NO ISSUE][COMP] Disallow duplicate field names in CREATE TYPE

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Disallow duplicate field names in types created
  by CREATE TYPE and inline type definitions in
  CREATE DATASET/VIEW

Change-Id: I437c94054eb5019b57d9f20a02a688ffaed937e2
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14024
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
8 months ago[NO ISSUE][COMP] Subquery coercion in SQL-compat mode
Dmitry Lychagin [Sat, 6 Nov 2021 00:12:19 +0000 (17:12 -0700)] 
[NO ISSUE][COMP] Subquery coercion in SQL-compat mode

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Implement subquery coercion rules in SQL-compat mode
- Add runtime for scalar-first-element()
- Change LogicalComplexBinaryComparator to compare multisets
  using array comparator instead of raw byte comparator
- Add tests

Change-Id: I44c50eda32e6e235fe92de10687cb90398040286
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/13964
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
9 months ago[ASTERIXDB-2895][RT] Vsize buffers in PyUDF IPC
Ian Maxon [Tue, 26 Oct 2021 07:15:48 +0000 (00:15 -0700)] 
[ASTERIXDB-2895][RT] Vsize buffers in PyUDF IPC

- user mode changes: no
- storage format changes: no
- interface changes: no

Details:

- Convert most uses of ByteBuffer to ArrayBackedValueStorage
  so that the size of the buffer can grow arbitrarily with
  the data
- Convert ADM-to-Msgpack serialiation to use IVisitablePointable
- Convert all serialization interfaces that used ByteBuffer
  to use DataOutput instead
- Fix UTF8 encoding bugs by using StandardToModifiedUTF8DataOutput
- Adapt some of the UTF8 printing code to be used for
  UTF8 output to msgpack
- Fix CSV output printer to not ignore surrogate pairs
- Fix ASTERIXDB-29773 (returned records from PyUDF aren't sorted)

Change-Id: Ic95e592b42139b4750af8bb20291f926b3c973e2
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/12643
Reviewed-by: Wael Alkowaileet <wael.y.k@gmail.com>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Contrib: Ian Maxon <imaxon@uci.edu>

9 months ago[NO ISSUE][*DB][LIC] Strip html tags from spongycastle license
Michael Blow [Mon, 8 Nov 2021 14:03:25 +0000 (09:03 -0500)] 
[NO ISSUE][*DB][LIC] Strip html tags from spongycastle license

Change-Id: I2358a7c5deb2cde45aeb1d6b4ee12f2190461109
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/14003
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Till Westmann <tillw@apache.org>
Tested-by: Michael Blow <mblow@apache.org>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

9 months ago[NO ISSUE][*DB][EXT] Consume JSR-250 annotations from tomcat-annotations-api
Michael Blow [Sat, 6 Nov 2021 18:40:13 +0000 (14:40 -0400)] 
[NO ISSUE][*DB][EXT] Consume JSR-250 annotations from tomcat-annotations-api

Change-Id: Ia27b1a21b0adf433b1c3f81caf1dcea3bcf6e225
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/13983
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Till Westmann <tillw@apache.org>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
9 months ago[NO ISSUE][*DB][EXT] += netty libraries needed for azure
Michael Blow [Fri, 5 Nov 2021 15:49:19 +0000 (11:49 -0400)] 
[NO ISSUE][*DB][EXT] += netty libraries needed for azure

- netty-transport-native-unix-common
- netty-resolver-dns
- netty-codec-dns
- netty-codec-http2

Change-Id: Ibb79c24d939b1c2929d5b3d13a7e249c6e6575f2
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/13963
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Till Westmann <tillw@apache.org>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
9 months ago[NO ISSUE][MISC] Update commons-io 2.8.0 -> 2.11.0
Michael Blow [Thu, 4 Nov 2021 16:23:38 +0000 (12:23 -0400)] 
[NO ISSUE][MISC] Update commons-io 2.8.0 -> 2.11.0

Change-Id: Ia9b83b383e0b07ea205a9831bb65a14ad99aeeb8
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/13943
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
Tested-by: Michael Blow <mblow@apache.org>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

9 months ago[NO ISSUE][TEST] Fix nested partitions in test harness
Ian Maxon [Mon, 1 Nov 2021 23:19:17 +0000 (16:19 -0700)] 
[NO ISSUE][TEST] Fix nested partitions in test harness

This got changed on accident. nc_1 and nc_2 shouldn't be
sharing a partition folder.

Change-Id: I345819e1aaec21f0a28d6592e1b8799e48434051
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/13904
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ian Maxon <imaxon@uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
9 months ago[NO ISSUE][OTH] Replace usage of FileUtils.listFiles
Murtadha Hubail [Wed, 3 Nov 2021 10:04:16 +0000 (13:04 +0300)] 
[NO ISSUE][OTH] Replace usage of FileUtils.listFiles

- user model changes: no
- storage format changes: no
- interface changes: no

Details:

- Avoid depending on FileUtils.listFiles in production code
  by replacing it with our own implementation.

Change-Id: I1ecb6143d5840fc12b35a641e1bc73c40bba3676
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/13923
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
9 months ago[ASTERIXDB-2839] Fix a bug of Optmized Spatial Join
Tin Vu [Tue, 2 Nov 2021 00:50:17 +0000 (17:50 -0700)] 
[ASTERIXDB-2839] Fix a bug of Optmized Spatial Join

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- This merge request fixes a bug in which the Optimized Spatial Join plan is not triggered when the join input type is ARectangle.

Change-Id: I16b0a3ef81214433331aeef364eccdff7d1027bb
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/13905
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
9 months ago[ASTERIXDB-2980][*DB][IDX] Add the option "CAST (DEFAULT NULL)" to CREATE INDEX statement
Ali Alsuliman [Mon, 1 Nov 2021 22:00:16 +0000 (15:00 -0700)] 
[ASTERIXDB-2980][*DB][IDX] Add the option "CAST (DEFAULT NULL)" to CREATE INDEX statement

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
Add the option "CAST (DEFAULT NULL)" to CREATE INDEX statement.

- when CAST (DEFAULT NULL) is specified in CREATE INDEX, use
  constructor types to cast the input type to the indexed field type as
  follows: CONSTRUCTOR(IF_MISSING(indexed_field, NULL)).
- in index bulk load path, cast only the indexed fields instead of the
  whole dataset record.
- allow CAST (DEFAULT NULL) only for b-trees.
- add tests.

Change-Id: I3a3ffd3735f1b311bd532dda955e08bf150ced31
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/13883
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
9 months ago[NO ISSUE][*DB][COMP] JSON record can only have expressions [%1$s, %2$s, %3$s]
Michael Blow [Thu, 28 Oct 2021 19:42:04 +0000 (15:42 -0400)] 
[NO ISSUE][*DB][COMP] JSON record can only have expressions [%1$s, %2$s, %3$s]

Change-Id: Ie11c29b12e0719d50c09a80a49376883f248c683
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/13844
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
9 months ago[NO ISSUE] Remove unused code from asterix-active
Cameron Samak [Tue, 15 Jun 2021 17:28:36 +0000 (17:28 +0000)] 
[NO ISSUE] Remove unused code from asterix-active

- user model changes: no
- storage format changes: no
- interface changes: yes

Details:
There are more unused methods exist that I don't plan to touch.

Change-Id: I3f0e749dab55c873a6ec2d5fd101afde8a27413d
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11963
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
Tested-by: Michael Blow <mblow@apache.org>
9 months ago[NO ISSUE] Cleanup: replace classes w/method refs
Cameron Samak [Mon, 14 Jun 2021 00:53:27 +0000 (00:53 +0000)] 
[NO ISSUE] Cleanup: replace classes w/method refs

- user model changes: no
- storage format changes: no
- interface changes: no

Details:

Cleanup to replace anonymous classes with method references.
No change in behavior intended.
Unnecessary anonymous classes remain, but keeping those separate since
this change is large.

Change-Id: I7a813cacbdc5724fe9583ea9128dbabae19ef691
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/11926
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mblow@apache.org>
9 months ago[NO ISSUE][MISC] Update dependencies
Michael Blow [Fri, 29 Oct 2021 00:11:23 +0000 (20:11 -0400)] 
[NO ISSUE][MISC] Update dependencies

- com.fasterxml.jackson.core:jackson-annotations .. 2.12.3 -> 2.13.0
- com.fasterxml.jackson.core:jackson-core ......... 2.12.3 -> 2.13.0
- com.fasterxml.jackson.core:jackson-databind ..... 2.12.3 -> 2.13.0
- com.google.guava:guava .................... 30.1-jre -> 31.0.1-jre
- it.unimi.dsi:fastutil ............................. 8.5.4 -> 8.5.6
- it.unimi.dsi:fastutil-core ........................ 8.5.4 -> 8.5.6
- org.apache.commons:commons-csv ...................... 1.8 -> 1.9.0
- org.apache.logging.log4j:log4j-1.2-api .......... 2.13.1 -> 2.14.1
- org.apache.maven:maven-artifact ................... 3.6.3 -> 3.8.3
- org.apache.maven:maven-compat ..................... 3.6.3 -> 3.8.3
- org.apache.maven:maven-core ....................... 3.6.3 -> 3.8.3
- org.apache.maven:maven-model ...................... 3.6.3 -> 3.8.3
- org.apache.maven:maven-plugin-api ................. 3.6.3 -> 3.8.3

- io.netty:netty-all:4.1.63.Final
   -> io.netty:netty-buffer:4.1.69.Final
   -> io.netty:netty-codec:4.1.69.Final
   -> io.netty:netty-codec-http:4.1.69.Final
   -> io.netty:netty-common:4.1.69.Final
   -> io.netty:netty-handler:4.1.69.Final
   -> io.netty:netty-resolver:4.1.69.Final
   -> io.netty:netty-transport:4.1.69.Final

Change-Id: I9aac58028de1a7c0e228eee3c78a39e7f3d0e431
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/13845
Reviewed-by: Michael Blow <mblow@apache.org>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
9 months ago[NO ISSUE][TEST] Prepare SqlppRQG tests
Dmitry Lychagin [Wed, 27 Oct 2021 03:22:59 +0000 (20:22 -0700)] 
[NO ISSUE][TEST] Prepare SqlppRQG tests

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Prepare SqlppRQG tests to be included into integration tests

Change-Id: I07955646125d26103bd0e9eb4b07435720b3a074
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/13804
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ian Maxon <imaxon@uci.edu>
9 months ago[ASTERIXDB-2976][API] Infra to ignore query parameters on POST/DELETE/PUT requests
Ali Alsuliman [Mon, 25 Oct 2021 23:22:25 +0000 (16:22 -0700)] 
[ASTERIXDB-2976][API] Infra to ignore query parameters on POST/DELETE/PUT requests

- user model changes: no
- storage format changes: no
- interface changes: yes

Change-Id: Ib084b583bae914ae5bde5c7a70e0b8e5699407de
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/13664
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>
9 months ago[ASTERIXDB-2978][FUN] Fix substr1() handling of offset 0
Dmitry Lychagin [Tue, 26 Oct 2021 17:27:39 +0000 (10:27 -0700)] 
[ASTERIXDB-2978][FUN] Fix substr1() handling of offset 0

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Fix substr1(x,0) to return input string instead of null

Change-Id: I5c313c163165f03b2c55d730438a2723f15dcc3d
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/13803
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
9 months ago[NO ISSUE][COMP] Support IN scalar in SQL-compat mode
Dmitry Lychagin [Mon, 18 Oct 2021 22:08:37 +0000 (15:08 -0700)] 
[NO ISSUE][COMP] Support IN scalar in SQL-compat mode

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Support NOT? IN scalar when evaluated in SQL-compatible mode
- Add tests

Change-Id: I660ac9d6cbdf1ea6dcf25fd2b046aa75c5e7c3e9
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/13743
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>
Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>
9 months ago[ATERIXDB-2975][EXT] Add support to Azure Data Lake external dataset
Hussain Towaileb [Fri, 15 Oct 2021 06:30:01 +0000 (09:30 +0300)] 
[ATERIXDB-2975][EXT] Add support to Azure Data Lake external dataset

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Add suppor to azure data lake as external datasets

Change-Id: Idd6a414d6f412e541ad66cffe7a7d2e02abf3695
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/13643
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Hussain Towaileb <hussainht@gmail.com>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>