avro.git
8 months agoPreparing for 1.11.0 release-1.11.0-rc1
Ryan Skraba [Wed, 6 Oct 2021 15:50:19 +0000 (17:50 +0200)] 
Preparing for 1.11.0

8 months agoAVRO-3222: Fix ruby interop scripts (#1353)
RyanSkraba [Wed, 6 Oct 2021 15:31:34 +0000 (17:31 +0200)] 
AVRO-3222: Fix ruby interop scripts (#1353)

8 months agoAVRO-3171: Use Active LTS Node.js 14 (#1351)
RyanSkraba [Wed, 6 Oct 2021 15:06:35 +0000 (17:06 +0200)] 
AVRO-3171: Use Active LTS Node.js 14 (#1351)

8 months agoAVRO-3203: Fix the Ruby distribution build to work (#1330)
Kengo Seki [Wed, 6 Oct 2021 15:06:14 +0000 (00:06 +0900)] 
AVRO-3203: Fix the Ruby distribution build to work (#1330)

8 months agoAVRO-2633: C# include schema doc (#1070)
tom-j-irvine [Wed, 6 Oct 2021 10:47:52 +0000 (04:47 -0600)] 
AVRO-2633: C# include schema doc (#1070)

* AVRO-2633 - csharp include schema doc

* AVRO-2633 - update tests for doc attribute

updated TestRecordDoc to test both the parsing and reserializtion - thanks @BarryDahlberg
updated the doc serialization logic to preserve empty strings (and only eliminate nulls)

Co-authored-by: Tom Irvine <tom@simplement.us>
Co-authored-by: RyanSkraba <ryan@skraba.com>
8 months agoAVRO-2863: Create an avro-android artifact (#1347)
RyanSkraba [Wed, 6 Oct 2021 09:49:08 +0000 (11:49 +0200)] 
AVRO-2863: Create an avro-android artifact (#1347)

* AVRO-2863: Create a shaded jar for Android compatibility

* AVRO-2863: Use MapEntry from outside reflect package

* AVRO-2863: Override ClassValue in the android implmementation

* AVRO-3862: Override ThreadLocal.withInitial in the android implementation

* AVRO-2863: Reorder data members before constructors

* AVRO-2863: Remove unwanted .class file

8 months agoAVRO-3095 Handle "classpath" resources only if resourceLoader is not null (#1349)
Martin Grigorov [Wed, 6 Oct 2021 09:22:01 +0000 (12:22 +0300)] 
AVRO-3095 Handle "classpath" resources only if resourceLoader is not null (#1349)

8 months agoAVRO-3095: Handle relative imports in resources (#1157)
Anatoly Kupriyanov [Tue, 5 Oct 2021 13:52:48 +0000 (14:52 +0100)] 
AVRO-3095: Handle relative imports in resources (#1157)

* AVRO-3095: Handle relative imports in resources

* AVRO-3095: Clean up code warnings

8 months agoAVRO-3186: Use consistent logic to find SpecificData by class (#1304)
Yubao Liu [Tue, 5 Oct 2021 12:26:59 +0000 (20:26 +0800)] 
AVRO-3186: Use consistent logic to find SpecificData by class (#1304)

SpecificDatumReader.SpecificDatumReader(Schema writer, Schema reader)
  -> SpecificData.getForSchema(reader)
     // It breaks if system class loader fails to load generated class,
     // thus returns an empty SpecificData.

SpecificDatumReader.readField()
  -> datum = readWithoutConversion(oldDatum, field.schema(), in);
     // conversion is null for union field
    -> GenericDatumReader.read(Object old, Schema expected, ResolvingDecoder in)
      -> Conversion<?> conversion = getData().getConversionFor(logicalType);
         // returns null wrongly

Without this patch, the unit test fails:

java.lang.ClassCastException: class java.lang.Long cannot be cast to class java.time.Instant (java.lang.Long and java.time.Instant are in module java.base of loader 'bootstrap')
at foo.Bar.put(Bar.java:113)
at org.apache.avro.generic.GenericData.setField(GenericData.java:826)
at org.apache.avro.specific.SpecificDatumReader.readField(SpecificDatumReader.java:139)
at org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:247)
at org.apache.avro.specific.SpecificDatumReader.readRecord(SpecificDatumReader.java:123)
at org.apache.avro.generic.GenericDatumReader.readWithoutConversion(GenericDatumReader.java:179)
at org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:160)
at org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:153)
at org.apache.avro.specific.TestSpecificData$1.run(TestSpecificData.java:75)

The separate class loader scenario probably happens in OSGi module and Java 9 module too.

9 months agoAVRO-3208: Utf8 datum are Serializable (#1339)
RyanSkraba [Tue, 28 Sep 2021 14:24:04 +0000 (16:24 +0200)] 
AVRO-3208: Utf8 datum are Serializable (#1339)

9 months agorefactor printinVisitor to improve testing logic (#1341)
wx930910 [Tue, 28 Sep 2021 14:18:41 +0000 (10:18 -0400)] 
refactor printinVisitor to improve testing logic (#1341)

9 months agoAVRO-3042: Make MODEL$ final (#1089)
Ryan Skraba [Mon, 27 Sep 2021 13:08:24 +0000 (15:08 +0200)] 
AVRO-3042: Make MODEL$ final (#1089)

Squashed commit of the following:

commit 60ed8856be320f093420e4e668d1d6b48b64cd2a
Author: Ryan Skraba <ryan@skraba.com>
Date:   Mon Sep 27 14:40:01 2021 +0200

    AVRO-3042: Update test resources on changed record template

commit 3fbbf3b6ee41aa893805fe04d425ace0da6ee037
Merge: 53ff955f6 c5ffd6e4f
Author: Ryan Skraba <ryan@skraba.com>
Date:   Mon Sep 27 12:34:25 2021 +0200

    Merge remote-tracking branch 'apache/master' into fd-make-model-final

commit 53ff955f687f4fd0bc2d7935899070e6d05cb6b5
Author: Fokko Driesprong <fokko@apache.org>
Date:   Thu Feb 11 21:55:27 2021 +0100

    Make MODEL$ final

Closes #1089

Co-authored-by: Fokko Driesprong <fokko@apache.org>
Co-authored-by: Ryan Skraba <ryan@skraba.com>
9 months agoAVRO-3167: Simplify Codec Buffer Allocation (#1275)
belugabehr [Wed, 22 Sep 2021 15:50:17 +0000 (11:50 -0400)] 
AVRO-3167: Simplify Codec Buffer Allocation (#1275)

* AVRO-3167: Simplify DeflateCodec Buffer Allocation

* Updated other codecs as well

9 months agoAVRO-2840 maven custom logical types (#885)
Matthew McMahon [Tue, 21 Sep 2021 15:31:10 +0000 (01:31 +1000)] 
AVRO-2840 maven custom logical types (#885)

* AVRO-2840 Maven allow custom logical types

Add to maven mojo to allow custom logical types
to be added via a name + logical type factory
and these can then be considered by the compiler
and at runtime

* AVRO-2840 Maven allow custom logical types

Addressed some PR feedback and swap to
use the Registered Type logicalTypeName when
registering in the Specific class

9 months agoAVRO-3212: fix specification to allow doc in fixed types (#1342)
Radai Rosenblatt [Tue, 21 Sep 2021 09:49:54 +0000 (02:49 -0700)] 
AVRO-3212: fix specification to allow doc in fixed types (#1342)

The currect specification omits the doc property on fixed types, even
though the implementation allows for it.
The spec is also wrong in the number of recognized properties on
records and fixed types - exact counts have been replaced with
"the following" to be more future proof (this is the wording
used for enums already, for example).
also aligned formatting for "namespace" attribute with the other
attributs for record and fixed

9 months agoAVRO-3206 Provide more information in the serialization error messages in SpecificDat...
Gyula Komlossi [Tue, 14 Sep 2021 15:30:09 +0000 (17:30 +0200)] 
AVRO-3206 Provide more information in the serialization error messages in SpecificDatumWriter

9 months agoFix python lint
Daniel Kulp [Wed, 15 Sep 2021 20:51:32 +0000 (16:51 -0400)] 
Fix python lint

9 months agoAttempt to get multiple versions of python installed in docker. Import "time" to...
Daniel Kulp [Wed, 15 Sep 2021 20:46:59 +0000 (16:46 -0400)] 
Attempt to get multiple versions of python installed in docker.  Import "time" to hopefully resolve test issue.

9 months agoAVRO-3184: Cache Datum Type Strings in Resolve Union (#1301)
belugabehr [Wed, 15 Sep 2021 08:15:08 +0000 (04:15 -0400)] 
AVRO-3184: Cache Datum Type Strings in Resolve Union (#1301)

* AVRO-3184: Cache Datum Type Strings in Resolve Union

* Fix typo

* Address Long type

* Updated based on GitHub feedback

* Revert Map cache entry

* Remove testing artifact

* Add Avro UTF8 class to primitive cache

9 months agoUpdate num-bigint requirement from 0.3.3 to 0.4.2 in /lang/rust
dependabot[bot] [Tue, 14 Sep 2021 16:01:53 +0000 (16:01 +0000)] 
Update num-bigint requirement from 0.3.3 to 0.4.2 in /lang/rust

Updates the requirements on [num-bigint](https://github.com/rust-num/num-bigint) to permit the latest version.
- [Release notes](https://github.com/rust-num/num-bigint/releases)
- [Changelog](https://github.com/rust-num/num-bigint/blob/master/RELEASES.md)
- [Commits](https://github.com/rust-num/num-bigint/compare/num-bigint-0.3.3...num-bigint-0.4.2)

---
updated-dependencies:
- dependency-name: num-bigint
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
9 months agoAVRO-3204 Rust: Update dependencies
Martin Tzvetanov Grigorov [Tue, 14 Sep 2021 09:33:33 +0000 (12:33 +0300)] 
AVRO-3204 Rust: Update dependencies

Update all prod and dev dependencies to their latest versions.

Add an entry for Rust to Dependabot config

9 months agoEnhance json parsing exception text to make it easier to locate problem
jmccl [Fri, 30 Apr 2021 17:52:55 +0000 (10:52 -0700)] 
Enhance json parsing exception text to make it easier to locate problem

9 months agoAVRO-3082: Improve interop test traceability for C# and Perl on CI
Kengo Seki [Thu, 18 Mar 2021 08:09:37 +0000 (17:09 +0900)] 
AVRO-3082: Improve interop test traceability for C# and Perl on CI

9 months agoAVRO-3075: add licences.
dc154p [Wed, 10 Mar 2021 17:25:29 +0000 (17:25 +0000)] 
AVRO-3075: add licences.

9 months agoAVRO-3075: fix finding mangled types
dc154p [Wed, 10 Mar 2021 16:23:00 +0000 (16:23 +0000)] 
AVRO-3075: fix finding mangled types

9 months agoAdd license header
Daniel Kulp [Mon, 13 Sep 2021 18:38:46 +0000 (14:38 -0400)] 
Add license header

9 months ago* Add RecurseTest
Ebere Abanonu [Sun, 9 May 2021 07:06:54 +0000 (08:06 +0100)] 
* Add RecurseTest
*  check the return value of TryAdd

9 months agoFix: Infinite Recursion
Ebere Abanonu [Mon, 12 Apr 2021 12:23:04 +0000 (13:23 +0100)] 
Fix: Infinite Recursion

9 months agoAVRO-3134: Fix ArgumentOutOfRangeException in method ToString of AvroDecimal
Thiago Froes [Sat, 8 May 2021 22:27:24 +0000 (19:27 -0300)] 
AVRO-3134: Fix ArgumentOutOfRangeException in method ToString of AvroDecimal

The method ToString of class AvroDecimal causes ArgumentOutOfRangeException
when Scale is greater than Unscaled number size.
The method ToString of class AvroDecimal returns a wrong result when Scale
is equal to the Unscaled number size because is missing a "0"

9 months agoBump libthrift from 0.14.2 to 0.15.0 in /lang/java
dependabot[bot] [Sun, 12 Sep 2021 17:02:18 +0000 (17:02 +0000)] 
Bump libthrift from 0.14.2 to 0.15.0 in /lang/java

Bumps [libthrift](https://github.com/apache/thrift) from 0.14.2 to 0.15.0.
- [Release notes](https://github.com/apache/thrift/releases)
- [Changelog](https://github.com/apache/thrift/blob/master/CHANGES.md)
- [Commits](https://github.com/apache/thrift/compare/v0.14.2...v0.15.0)

---
updated-dependencies:
- dependency-name: org.apache.thrift:libthrift
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
9 months ago[AVRO-3150] Allow different lf styles.
Daniel Kulp [Mon, 13 Sep 2021 18:29:04 +0000 (14:29 -0400)] 
[AVRO-3150] Allow different lf styles.

9 months agoFix c++ windows build. IN and OUT are predefined macros.
Leander Schulten [Mon, 31 May 2021 23:26:09 +0000 (01:26 +0200)] 
Fix c++ windows build. IN and OUT are predefined macros.

9 months agoBump coveralls from 3.1.0 to 3.1.1 in /lang/js
dependabot[bot] [Sun, 4 Jul 2021 17:06:41 +0000 (17:06 +0000)] 
Bump coveralls from 3.1.0 to 3.1.1 in /lang/js

Bumps [coveralls](https://github.com/nickmerwin/node-coveralls) from 3.1.0 to 3.1.1.
- [Release notes](https://github.com/nickmerwin/node-coveralls/releases)
- [Commits](https://github.com/nickmerwin/node-coveralls/compare/v3.1.0...3.1.1)

---
updated-dependencies:
- dependency-name: coveralls
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
9 months agoOptimize memory allocations #1302
Daniel Kulp [Mon, 13 Sep 2021 18:16:55 +0000 (14:16 -0400)] 
Optimize memory allocations #1302
Merge meni-braun:master

9 months agoBump netty-bom from 4.1.67.Final to 4.1.68.Final in /lang/java
dependabot[bot] [Sun, 12 Sep 2021 17:02:47 +0000 (17:02 +0000)] 
Bump netty-bom from 4.1.67.Final to 4.1.68.Final in /lang/java

Bumps [netty-bom](https://github.com/netty/netty) from 4.1.67.Final to 4.1.68.Final.
- [Release notes](https://github.com/netty/netty/releases)
- [Commits](https://github.com/netty/netty/compare/netty-4.1.67.Final...netty-4.1.68.Final)

---
updated-dependencies:
- dependency-name: io.netty:netty-bom
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
9 months agoAVRO-3172 Since there is no read on the Readable there is no 'end' event
Martin Tzvetanov Grigorov [Fri, 10 Sep 2021 11:51:39 +0000 (14:51 +0300)] 
AVRO-3172 Since there is no read on the Readable there is no 'end' event

Calling writeable.end() emits 'finish' event

9 months agoAVRO-3201: Remove non-existent directory from lang/c++/build.sh (#1329)
Kengo Seki [Mon, 13 Sep 2021 09:02:03 +0000 (18:02 +0900)] 
AVRO-3201: Remove non-existent directory from lang/c++/build.sh (#1329)

9 months agoAVRO-3199 Try to run Rust audit checks
Martin Tzvetanov Grigorov [Fri, 10 Sep 2021 12:08:56 +0000 (15:08 +0300)] 
AVRO-3199 Try to run Rust audit checks

9 months agoAVRO-3200 Fix some new lint errors
Martin Tzvetanov Grigorov [Fri, 10 Sep 2021 13:22:27 +0000 (16:22 +0300)] 
AVRO-3200 Fix some new lint errors

Reported by a the latest version of cargo-clippy

9 months agoSince the workflow really wants to use cmake 3.21, but that breaks cppcheck, just...
Daniel Kulp [Thu, 9 Sep 2021 21:32:28 +0000 (17:32 -0400)] 
Since the workflow really wants to use cmake 3.21, but that breaks cppcheck, just cppcheck the directories where we have C++/H files.

9 months agocmake Actions aren't verified so cannot use them.
Daniel Kulp [Thu, 9 Sep 2021 21:05:18 +0000 (17:05 -0400)] 
cmake Actions aren't verified so cannot use them.

9 months agoDifferent attempt to get the same cmake
Daniel Kulp [Thu, 9 Sep 2021 20:58:10 +0000 (16:58 -0400)] 
Different attempt to get the same cmake

9 months agoTry locking version of cmake to match what docker is using
Daniel Kulp [Thu, 9 Sep 2021 20:52:32 +0000 (16:52 -0400)] 
Try locking version of cmake to match what docker is using

9 months agoUpdate docker to use ubuntu 20.04 base to match the base that the github actions...
Daniel Kulp [Thu, 9 Sep 2021 20:06:34 +0000 (16:06 -0400)] 
Update docker to use ubuntu 20.04 base to match the base that the github actions are using.  Hopefully allow easier duplication of issues.

9 months agoAVRO-3198: Include venv module in ubertool (#1325)
RyanSkraba [Thu, 9 Sep 2021 11:39:53 +0000 (13:39 +0200)] 
AVRO-3198: Include venv module in ubertool (#1325)

9 months agoAVRO-3081: Fix Java interop test on CI to read files generated by other languages
Kengo Seki [Thu, 18 Mar 2021 07:11:23 +0000 (16:11 +0900)] 
AVRO-3081: Fix Java interop test on CI to read files generated by other languages

9 months agoMemory optimization in SchemaName.Fullname
Meni Braun (MSFT) [Mon, 2 Aug 2021 13:44:15 +0000 (16:44 +0300)] 
Memory optimization in SchemaName.Fullname

FullName property is being called by `ClassCache.GetClass` for each property:
```csharp
public DotnetClass GetClass(RecordSchema schema)
{
DotnetClass result;
if (!this._nameClassMap.TryGetValue(schema.Fullname, ref result))
.
.
```

This allocates TONS of strings on a scenario which calls `Avro.Reflect.ReflectDefaultWriter.WriteRecord` on large amount of entities (millions) + large amount of fields (tens).

9 months agoBump grpc.version from 1.39.0 to 1.40.1 in /lang/java (#1323)
dependabot[bot] [Wed, 8 Sep 2021 15:32:48 +0000 (17:32 +0200)] 
Bump grpc.version from 1.39.0 to 1.40.1 in /lang/java (#1323)

Bumps `grpc.version` from 1.39.0 to 1.40.1.

Updates `grpc-core` from 1.39.0 to 1.40.1
- [Release notes](https://github.com/grpc/grpc-java/releases)
- [Commits](https://github.com/grpc/grpc-java/compare/v1.39.0...v1.40.1)

Updates `grpc-stub` from 1.39.0 to 1.40.1
- [Release notes](https://github.com/grpc/grpc-java/releases)
- [Commits](https://github.com/grpc/grpc-java/compare/v1.39.0...v1.40.1)

Updates `grpc-netty` from 1.39.0 to 1.40.1
- [Release notes](https://github.com/grpc/grpc-java/releases)
- [Commits](https://github.com/grpc/grpc-java/compare/v1.39.0...v1.40.1)

---
updated-dependencies:
- dependency-name: io.grpc:grpc-core
  dependency-type: direct:production
  update-type: version-update:semver-minor
- dependency-name: io.grpc:grpc-stub
  dependency-type: direct:production
  update-type: version-update:semver-minor
- dependency-name: io.grpc:grpc-netty
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
9 months agoBump plexus-utils from 3.4.0 to 3.4.1 in /lang/java (#1324)
dependabot[bot] [Tue, 7 Sep 2021 07:49:56 +0000 (09:49 +0200)] 
Bump plexus-utils from 3.4.0 to 3.4.1 in /lang/java (#1324)

Bumps [plexus-utils](https://github.com/codehaus-plexus/plexus-utils) from 3.4.0 to 3.4.1.
- [Release notes](https://github.com/codehaus-plexus/plexus-utils/releases)
- [Commits](https://github.com/codehaus-plexus/plexus-utils/compare/plexus-utils-3.4.0...plexus-utils-3.4.1)

---
updated-dependencies:
- dependency-name: org.codehaus.plexus:plexus-utils
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
9 months agoAVRO-3182 fix union schema ToString() has an extra type property (#1303)
ShawnWu [Mon, 6 Sep 2021 13:23:24 +0000 (21:23 +0800)] 
AVRO-3182 fix union schema ToString() has an extra type property (#1303)

* AVRO-3182 fix union schema ToString() has an extra type property

* AVRO-3182 add unit test

* AVRO-3182 fix code scanning warning to avoid introducing a dependency cycle

* AVRO-3182 fix code scanning warning that missing dispose call on local IDisposable

Co-authored-by: Shawn Wu <Shawn.wu@grapecity.com>
9 months agoBump jackson.version from 2.12.4 to 2.12.5 in /lang/java (#1322)
dependabot[bot] [Mon, 6 Sep 2021 13:18:24 +0000 (15:18 +0200)] 
Bump jackson.version from 2.12.4 to 2.12.5 in /lang/java (#1322)

Bumps `jackson.version` from 2.12.4 to 2.12.5.

Updates `jackson-core` from 2.12.4 to 2.12.5
- [Release notes](https://github.com/FasterXML/jackson-core/releases)
- [Commits](https://github.com/FasterXML/jackson-core/compare/jackson-core-2.12.4...jackson-core-2.12.5)

Updates `jackson-databind` from 2.12.4 to 2.12.5
- [Release notes](https://github.com/FasterXML/jackson/releases)
- [Commits](https://github.com/FasterXML/jackson/commits)

---
updated-dependencies:
- dependency-name: com.fasterxml.jackson.core:jackson-core
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: com.fasterxml.jackson.core:jackson-databind
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
9 months agoAVRO-3195: Include rust in the docker build image (#1321)
RyanSkraba [Fri, 3 Sep 2021 13:37:15 +0000 (15:37 +0200)] 
AVRO-3195: Include rust in the docker build image (#1321)

* AVRO-3195: Include rust in the docker build image

* AVRO-3195: Use minimum required rust in docker

9 months agoBump netty-bom from 4.1.66.Final to 4.1.67.Final in /lang/java (#1319)
dependabot[bot] [Thu, 2 Sep 2021 07:35:17 +0000 (09:35 +0200)] 
Bump netty-bom from 4.1.66.Final to 4.1.67.Final in /lang/java (#1319)

Bumps [netty-bom](https://github.com/netty/netty) from 4.1.66.Final to 4.1.67.Final.
- [Release notes](https://github.com/netty/netty/releases)
- [Commits](https://github.com/netty/netty/compare/netty-4.1.66.Final...netty-4.1.67.Final)

---
updated-dependencies:
- dependency-name: io.netty:netty-bom
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
9 months agoAVRO-3007: Standardize Building Python Packages (#1239)
Michael A. Smith [Tue, 31 Aug 2021 10:54:08 +0000 (06:54 -0400)] 
AVRO-3007: Standardize Building Python Packages (#1239)

9 months agoAVRO-3191: Example of custom logical types with annotations in IDL (#1315)
RyanSkraba [Tue, 31 Aug 2021 08:14:24 +0000 (10:14 +0200)] 
AVRO-3191: Example of custom logical types with annotations in IDL (#1315)

9 months agoAVRO-3067: Bump validation times for PyPy (#1316)
RyanSkraba [Tue, 31 Aug 2021 02:12:16 +0000 (04:12 +0200)] 
AVRO-3067: Bump validation times for PyPy (#1316)

9 months agoAVRO-3162: Use Argparse to Manage Arguments (#1270)
Michael A. Smith [Mon, 30 Aug 2021 02:34:27 +0000 (22:34 -0400)] 
AVRO-3162: Use Argparse to Manage Arguments (#1270)

Improve the python cli, consisting mainly of scripts/avro and avro.tool, by implementing argparse, and a `__main__.py` module.

- argparse handles arity and type exceptions more fluently at invocation time than can easily be done with sys.argv.
- argparse handles sub-commands natively, especially in python 3.7 and up.
- `__main__.py` dispatch (along with setuptools `entry_points.console_scripts` at install time) allows the cli to be invoked with both `python -m avro` and just `avro` without having an out-of-band `scripts/avro` directory.
- Just in case someone is still using scripts/avro, I've kept that around with a deprecation warning.
- I added type hints as best I can; however, the avro script has an `eval` call that we might want to get rid of, some day.

10 months agoAVRO-3193: Add Rust Checks to Readme (#1317)
Michael A. Smith [Sun, 29 Aug 2021 03:29:08 +0000 (23:29 -0400)] 
AVRO-3193: Add Rust Checks to Readme (#1317)

The README has not been updated since the adoption of the Rust
component. Even though the rust checks aren't passing, having them
present will make it clear to people exploring the repo in GitHub that
there is a rust implementation, and provides guidance about what needs
to be addressed.

10 months agoAVRO-3190: Error when trying to read 0 bytes at eof (#1314)
RyanSkraba [Fri, 27 Aug 2021 09:39:19 +0000 (11:39 +0200)] 
AVRO-3190: Error when trying to read 0 bytes at eof (#1314)

* fix error when trying to read 0 bytes at eof

When reading an avro file record for record each time when reading the last record DataFileReader tries to get the next block but (of course) fails. This fixes the issue.

* AVRO-3190: Return quickly on eof

* AVRO-3190: Unit test for EOF.

* AVRO-3190: Fix unit test to demonstrate problem

Co-authored-by: Stephan Hradek <stephan.hradek@eco.de>
10 months agoAVRO-2648: Incorrect validation of numeric default values (#739)
Jeffrey Mullins [Thu, 26 Aug 2021 16:28:18 +0000 (12:28 -0400)] 
AVRO-2648: Incorrect validation of numeric default values (#739)

* AVRO-2648: Incorrect validation of numeric default values

Validation of numeric default values in Java is incorrect and results
in API inconsistencies. Consider the following examples:

Double values as int field default values:
public void testDoubleAsIntDefaultValue() {
  Schema.Field field = new Schema.Field("myField",
          Schema.create(Schema.Type.INT), "doc", 1.1);
  field.hasDefaultValue(); // true
  field.defaultValue(); // internal DoubleNode (1.1)
  field.defaultVal(); // null
  GenericData.get().getDefaultValue(field); // Integer (1)

  field = new Schema.Field("myField",
          Schema.create(Schema.Type.INT), "doc", 1.0);
  field.hasDefaultValue(); // true
  field.defaultValue(); // internal DoubleNode (1.0)
  field.defaultVal(); // null
  GenericData.get().getDefaultValue(field); // Integer (1)
}

Invalid long value as int field default value:
public void testInvalidLongAsIntDefault() {
  Schema.Field field = new Schema.Field("myField",
         Schema.create(Schema.Type.INT), "doc", Integer.MAX_VALUE + 1L);
  field.hasDefaultValue(); // true
  field.defaultValue(); // internal LongNode (2147483648)
  field.defaultVal(); // Long (2147483648)
  GenericData.get().getDefaultValue(field); // Integer (-2147483648)
}

This PR makes changes to invalidate incorrect default values for INT and
LONG schemas, including all floating point values, e.g. 1.0.
Additionally it contains changes to try and return the appropriate
Object type given the schema type.

This change is necessary for correctness and consitency but also
because users cannot disable default value validation and handle
these cases on their own since the underlying Field.defaultValue()
is no longer public. Users only have access to default values
mutated by Field.defaultVal() and GenericData.getDefaultValue().

Notes on JacksonUtils.toObject():
 - This method is used to convert the underlying JsonNode default value
  to an Object when Field.defaultVal() is called. This method is
  invoked regardless of whether default value validation is true or
  false.
 - For LongNode values we continue to return Long values for INT
   schemas in the case we cannot safely convert to an Integer.
   This behavior, while maintained, is inconsistent with that
   of FloatNode / DoubleNode where null is returned for INT
   and LONG schemas. Additional changes may be needed for
   further consistency.

* AVRO-2648: Fix testLongDefaultValue()

Co-authored-by: Jeffrey Mullins <jmullins31@bloomberg.net>
Co-authored-by: Fokko Driesprong <fokko@apache.org>
10 months agoAVRO-2923: GenericDatum::logicalType() api should return correct type with union...
Yang [Thu, 26 Aug 2021 14:27:49 +0000 (10:27 -0400)] 
AVRO-2923: GenericDatum::logicalType() api should return correct type with union (#949)

* AVRO-2923: logicalType() api should return correct type with union

logicalType() should behave like type() to return correct logical type corresponing to one of the constituent types of the union

* adding test

10 months agoBump Microsoft.NET.Test.Sdk from 16.9.4 to 16.11.0 in /lang/csharp (#1305)
dependabot[bot] [Tue, 17 Aug 2021 12:24:21 +0000 (14:24 +0200)] 
Bump Microsoft.NET.Test.Sdk from 16.9.4 to 16.11.0 in /lang/csharp (#1305)

Bumps [Microsoft.NET.Test.Sdk](https://github.com/microsoft/vstest) from 16.9.4 to 16.11.0.
- [Release notes](https://github.com/microsoft/vstest/releases)
- [Commits](https://github.com/microsoft/vstest/compare/v16.9.4...v16.11.0)

---
updated-dependencies:
- dependency-name: Microsoft.NET.Test.Sdk
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
10 months agoBump jmh.version from 1.32 to 1.33 in /lang/java (#1307)
dependabot[bot] [Mon, 16 Aug 2021 11:11:39 +0000 (13:11 +0200)] 
Bump jmh.version from 1.32 to 1.33 in /lang/java (#1307)

Bumps `jmh.version` from 1.32 to 1.33.

Updates `jmh-core` from 1.32 to 1.33

Updates `jmh-generator-annprocess` from 1.32 to 1.33

---
updated-dependencies:
- dependency-name: org.openjdk.jmh:jmh-core
  dependency-type: direct:production
  update-type: version-update:semver-minor
- dependency-name: org.openjdk.jmh:jmh-generator-annprocess
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
10 months ago1. Fix memory leak by not calling .Dispose
Meni Braun [Mon, 9 Aug 2021 06:41:53 +0000 (09:41 +0300)] 
1. Fix memory leak by not calling .Dispose
2. Make memory efficiency fixes, by reducing unnecessary allocations

10 months agoAVRO-3175 Rust: fix lint/clippy errors (#1286)
Martin Grigorov [Sat, 7 Aug 2021 08:26:12 +0000 (11:26 +0300)] 
AVRO-3175 Rust: fix lint/clippy errors (#1286)

* AVRO-3175 Rust: fix lint/clippy errors

Fix all linting/clippy errors & warnings.
Add build.sh for Rust that currently supports clean, dist, lint and test targets

* INFRA-22085 Test actions-rs

* AVRO-3175 Build with all features enabled

* AVRO-3175 Change working folder to lang/rust

* AVRO-3175 Set working folder to lang/avro for GHA

* [squash] Debug pwd

* AVRO-3175 Workaround https://github.com/actions-rs/cargo/issues/86

Use --manifest-path to specify the path to Cargo.yaml

* AVRO-3175 Format the code with `cargo fmt --all --"

This should fix the Github Actions CI workflow

* AVRO-3175 Specify the path to Cargo.yaml for clippy

10 months agoAVRO-3183: Do Not Double Buffer Data in DataFileWriter (#1300)
belugabehr [Fri, 6 Aug 2021 13:43:19 +0000 (09:43 -0400)] 
AVRO-3183: Do Not Double Buffer Data in DataFileWriter (#1300)

10 months agoBump plexus-utils from 3.3.0 to 3.4.0 in /lang/java (#1297)
dependabot[bot] [Mon, 2 Aug 2021 08:56:47 +0000 (10:56 +0200)] 
Bump plexus-utils from 3.3.0 to 3.4.0 in /lang/java (#1297)

Bumps [plexus-utils](https://github.com/codehaus-plexus/plexus-utils) from 3.3.0 to 3.4.0.
- [Release notes](https://github.com/codehaus-plexus/plexus-utils/releases)
- [Commits](https://github.com/codehaus-plexus/plexus-utils/compare/plexus-utils-3.3.0...plexus-utils-3.4.0)

---
updated-dependencies:
- dependency-name: org.codehaus.plexus:plexus-utils
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
10 months agoAVRO-3180: Interop tests fail on force_encoding (#1296)
Tim Perkins [Sat, 31 Jul 2021 07:08:47 +0000 (03:08 -0400)] 
AVRO-3180: Interop tests fail on force_encoding (#1296)

11 months agoBump zstd-jni from 1.5.0-2 to 1.5.0-4 in /lang/java (#1294)
dependabot[bot] [Tue, 27 Jul 2021 14:51:09 +0000 (16:51 +0200)] 
Bump zstd-jni from 1.5.0-2 to 1.5.0-4 in /lang/java (#1294)

Bumps [zstd-jni](https://github.com/luben/zstd-jni) from 1.5.0-2 to 1.5.0-4.
- [Release notes](https://github.com/luben/zstd-jni/releases)
- [Commits](https://github.com/luben/zstd-jni/compare/v1.5.0-2...v1.5.0-4)

---
updated-dependencies:
- dependency-name: com.github.luben:zstd-jni
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
11 months agoAVRO-3174 JavaScript: Do not use deprecated constructors of Buffer (#1285)
Martin Grigorov [Mon, 26 Jul 2021 16:30:55 +0000 (19:30 +0300)] 
AVRO-3174 JavaScript: Do not use deprecated constructors of Buffer (#1285)

Use Buffer.alloc(), allocUnsafeSlow() and from() factory methods instead

11 months agoBump slf4j.version from 1.7.31 to 1.7.32 in /lang/java (#1293)
dependabot[bot] [Mon, 26 Jul 2021 08:15:27 +0000 (10:15 +0200)] 
Bump slf4j.version from 1.7.31 to 1.7.32 in /lang/java (#1293)

Bumps `slf4j.version` from 1.7.31 to 1.7.32.

Updates `slf4j-api` from 1.7.31 to 1.7.32
- [Release notes](https://github.com/qos-ch/slf4j/releases)
- [Commits](https://github.com/qos-ch/slf4j/commits)

Updates `slf4j-simple` from 1.7.31 to 1.7.32
- [Release notes](https://github.com/qos-ch/slf4j/releases)
- [Commits](https://github.com/qos-ch/slf4j/commits)

Updates `slf4j-log4j12` from 1.7.31 to 1.7.32
- [Release notes](https://github.com/qos-ch/slf4j/releases)
- [Commits](https://github.com/qos-ch/slf4j/commits)

---
updated-dependencies:
- dependency-name: org.slf4j:slf4j-api
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: org.slf4j:slf4j-simple
  dependency-type: direct:development
  update-type: version-update:semver-patch
- dependency-name: org.slf4j:slf4j-log4j12
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
11 months agoBump netty-bom from 4.1.65.Final to 4.1.66.Final in /lang/java (#1292)
dependabot[bot] [Tue, 20 Jul 2021 09:02:30 +0000 (11:02 +0200)] 
Bump netty-bom from 4.1.65.Final to 4.1.66.Final in /lang/java (#1292)

Bumps [netty-bom](https://github.com/netty/netty) from 4.1.65.Final to 4.1.66.Final.
- [Release notes](https://github.com/netty/netty/releases)
- [Commits](https://github.com/netty/netty/compare/netty-4.1.65.Final...netty-4.1.66.Final)

---
updated-dependencies:
- dependency-name: io.netty:netty-bom
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
11 months agoBump ant from 1.10.10 to 1.10.11 in /lang/java (#1291)
dependabot[bot] [Mon, 19 Jul 2021 08:27:30 +0000 (10:27 +0200)] 
Bump ant from 1.10.10 to 1.10.11 in /lang/java (#1291)

Bumps ant from 1.10.10 to 1.10.11.

---
updated-dependencies:
- dependency-name: org.apache.ant:ant
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
11 months agoUpdate apache/commons-compress to 1.21 (#1290)
Anderson de Borba [Fri, 16 Jul 2021 10:29:20 +0000 (11:29 +0100)] 
Update apache/commons-compress to 1.21 (#1290)

A bunch of vulnerabilities have been disclosed recently for the version 1.20:

https://snyk.io/vuln/SNYK-JAVA-ORGAPACHECOMMONS-1316638
https://snyk.io/vuln/SNYK-JAVA-ORGAPACHECOMMONS-1316640
https://snyk.io/vuln/SNYK-JAVA-ORGAPACHECOMMONS-1316641
https://snyk.io/vuln/SNYK-JAVA-ORGAPACHECOMMONS-1316639

11 months agoBump jetty.version in /lang/java (#1288)
dependabot[bot] [Tue, 13 Jul 2021 09:22:52 +0000 (11:22 +0200)] 
Bump jetty.version in /lang/java (#1288)

Bumps `jetty.version` from 9.4.42.v20210604 to 9.4.43.v20210629.

Updates `jetty-server` from 9.4.42.v20210604 to 9.4.43.v20210629
- [Release notes](https://github.com/eclipse/jetty.project/releases)
- [Commits](https://github.com/eclipse/jetty.project/compare/jetty-9.4.42.v20210604...jetty-9.4.43.v20210629)

Updates `jetty-servlet` from 9.4.42.v20210604 to 9.4.43.v20210629
- [Release notes](https://github.com/eclipse/jetty.project/releases)
- [Commits](https://github.com/eclipse/jetty.project/compare/jetty-9.4.42.v20210604...jetty-9.4.43.v20210629)

Updates `jetty-util` from 9.4.42.v20210604 to 9.4.43.v20210629
- [Release notes](https://github.com/eclipse/jetty.project/releases)
- [Commits](https://github.com/eclipse/jetty.project/compare/jetty-9.4.42.v20210604...jetty-9.4.43.v20210629)

---
updated-dependencies:
- dependency-name: org.eclipse.jetty:jetty-server
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: org.eclipse.jetty:jetty-servlet
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: org.eclipse.jetty:jetty-util
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
11 months agoAVRO-2720: Enhance AvroTypeException message to include field name (#1287)
Subhash Bhushan [Tue, 13 Jul 2021 01:56:31 +0000 (18:56 -0700)] 
AVRO-2720: Enhance AvroTypeException message to include field name (#1287)

* AVRO-2720: Enhance AvroTypeException message to include field name

The exception message now includes the field name on which the type exception
was raised.

Closes: AVRO-2720

* Increase Pypy 3.6 minimum speed to 5 secs
* Increase benchmark timings for both READ and WRITE
* Remove unnecessary sys import
* Change the global warnings filter to catch IgnoredLogicalType: With this change, the ResourceWarning would just get messaged, and not raised as an error, but the IgnoredLogicalType would get raised and then caught, and we can test for it.

11 months agoBump jackson.version from 2.12.3 to 2.12.4 in /lang/java (#1289)
dependabot[bot] [Mon, 12 Jul 2021 12:59:14 +0000 (14:59 +0200)] 
Bump jackson.version from 2.12.3 to 2.12.4 in /lang/java (#1289)

Bumps `jackson.version` from 2.12.3 to 2.12.4.

Updates `jackson-core` from 2.12.3 to 2.12.4
- [Release notes](https://github.com/FasterXML/jackson-core/releases)
- [Commits](https://github.com/FasterXML/jackson-core/compare/jackson-core-2.12.3...jackson-core-2.12.4)

Updates `jackson-databind` from 2.12.3 to 2.12.4
- [Release notes](https://github.com/FasterXML/jackson/releases)
- [Commits](https://github.com/FasterXML/jackson/commits)

---
updated-dependencies:
- dependency-name: com.fasterxml.jackson.core:jackson-core
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: com.fasterxml.jackson.core:jackson-databind
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
11 months agoFix a small typo in documentation (#1284)
Martin Grigorov [Wed, 7 Jul 2021 12:52:11 +0000 (15:52 +0300)] 
Fix a small typo in documentation (#1284)

11 months agoBump grpc.version from 1.38.1 to 1.39.0 in /lang/java (#1281)
dependabot[bot] [Tue, 6 Jul 2021 15:43:04 +0000 (17:43 +0200)] 
Bump grpc.version from 1.38.1 to 1.39.0 in /lang/java (#1281)

Bumps `grpc.version` from 1.38.1 to 1.39.0.

Updates `grpc-core` from 1.38.1 to 1.39.0
- [Release notes](https://github.com/grpc/grpc-java/releases)
- [Commits](https://github.com/grpc/grpc-java/compare/v1.38.1...v1.39.0)

Updates `grpc-stub` from 1.38.1 to 1.39.0
- [Release notes](https://github.com/grpc/grpc-java/releases)
- [Commits](https://github.com/grpc/grpc-java/compare/v1.38.1...v1.39.0)

Updates `grpc-netty` from 1.38.1 to 1.39.0
- [Release notes](https://github.com/grpc/grpc-java/releases)
- [Commits](https://github.com/grpc/grpc-java/compare/v1.38.1...v1.39.0)

---
updated-dependencies:
- dependency-name: io.grpc:grpc-core
  dependency-type: direct:production
  update-type: version-update:semver-minor
- dependency-name: io.grpc:grpc-stub
  dependency-type: direct:production
  update-type: version-update:semver-minor
- dependency-name: io.grpc:grpc-netty
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
11 months agoAVRO-3144 Support for enabling and disabling default value validation through SchemaB...
Andreas Hailu [Fri, 2 Jul 2021 20:29:40 +0000 (16:29 -0400)] 
AVRO-3144 Support for enabling and disabling default value validation through SchemaBuilder (#1276)

* AVRO-3144 Support for enabling and disabling default value validation through SchemaBuilder

* AVRO-3144 Fix spotless violations

11 months agoAVRO-3165: Fix NettyTransceiver workerGroup leak (#1274)
Benjamin Leber [Wed, 30 Jun 2021 15:45:05 +0000 (17:45 +0200)] 
AVRO-3165: Fix NettyTransceiver workerGroup leak (#1274)

12 months agoAlign maven versions (#1218)
Ismaël Mejía [Mon, 28 Jun 2021 15:54:02 +0000 (17:54 +0200)] 
Align maven versions (#1218)

12 months agoAVRO-3163: Delete gen-cppcode.py
Michael A. Smith [Thu, 24 Jun 2021 00:54:30 +0000 (20:54 -0400)] 
AVRO-3163: Delete gen-cppcode.py

Per conversation on mailing list, this file is no longer used.

12 months agoAVRO-2921: Type Fixes for avro.io (#1264)
Michael A. Smith [Wed, 23 Jun 2021 12:04:34 +0000 (08:04 -0400)] 
AVRO-2921: Type Fixes for avro.io (#1264)

12 months agoNot setting policy CMP0042 for version prior to CMake 3.0 (#1271)
Thiruvalluvan M G [Tue, 22 Jun 2021 03:31:10 +0000 (09:01 +0530)] 
Not setting policy CMP0042 for version prior to CMake 3.0 (#1271)

12 months agoBump slf4j.version from 1.7.30 to 1.7.31 in /lang/java (#1266)
dependabot[bot] [Mon, 21 Jun 2021 08:06:02 +0000 (10:06 +0200)] 
Bump slf4j.version from 1.7.30 to 1.7.31 in /lang/java (#1266)

Bumps `slf4j.version` from 1.7.30 to 1.7.31.

Updates `slf4j-api` from 1.7.30 to 1.7.31
- [Release notes](https://github.com/qos-ch/slf4j/releases)
- [Commits](https://github.com/qos-ch/slf4j/commits)

Updates `slf4j-simple` from 1.7.30 to 1.7.31
- [Release notes](https://github.com/qos-ch/slf4j/releases)
- [Commits](https://github.com/qos-ch/slf4j/commits)

Updates `slf4j-log4j12` from 1.7.30 to 1.7.31
- [Release notes](https://github.com/qos-ch/slf4j/releases)
- [Commits](https://github.com/qos-ch/slf4j/commits)

---
updated-dependencies:
- dependency-name: org.slf4j:slf4j-api
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: org.slf4j:slf4j-simple
  dependency-type: direct:development
  update-type: version-update:semver-patch
- dependency-name: org.slf4j:slf4j-log4j12
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
12 months agoBump grpc.version from 1.38.0 to 1.38.1 in /lang/java (#1265)
dependabot[bot] [Mon, 21 Jun 2021 08:03:18 +0000 (10:03 +0200)] 
Bump grpc.version from 1.38.0 to 1.38.1 in /lang/java (#1265)

Bumps `grpc.version` from 1.38.0 to 1.38.1.

Updates `grpc-core` from 1.38.0 to 1.38.1
- [Release notes](https://github.com/grpc/grpc-java/releases)
- [Commits](https://github.com/grpc/grpc-java/compare/v1.38.0...v1.38.1)

Updates `grpc-stub` from 1.38.0 to 1.38.1
- [Release notes](https://github.com/grpc/grpc-java/releases)
- [Commits](https://github.com/grpc/grpc-java/compare/v1.38.0...v1.38.1)

Updates `grpc-netty` from 1.38.0 to 1.38.1
- [Release notes](https://github.com/grpc/grpc-java/releases)
- [Commits](https://github.com/grpc/grpc-java/compare/v1.38.0...v1.38.1)

---
updated-dependencies:
- dependency-name: io.grpc:grpc-core
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: io.grpc:grpc-stub
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: io.grpc:grpc-netty
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
12 months agoBump hadoop-client from 3.3.0 to 3.3.1 in /lang/java (#1267)
dependabot[bot] [Mon, 21 Jun 2021 08:02:13 +0000 (10:02 +0200)] 
Bump hadoop-client from 3.3.0 to 3.3.1 in /lang/java (#1267)

Bumps hadoop-client from 3.3.0 to 3.3.1.

---
updated-dependencies:
- dependency-name: org.apache.hadoop:hadoop-client
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
12 months agoBump libthrift from 0.14.1 to 0.14.2 in /lang/java (#1268)
dependabot[bot] [Mon, 21 Jun 2021 08:01:31 +0000 (10:01 +0200)] 
Bump libthrift from 0.14.1 to 0.14.2 in /lang/java (#1268)

Bumps [libthrift](https://github.com/apache/thrift) from 0.14.1 to 0.14.2.
- [Release notes](https://github.com/apache/thrift/releases)
- [Changelog](https://github.com/apache/thrift/blob/master/CHANGES.md)
- [Commits](https://github.com/apache/thrift/compare/v0.14.1...v0.14.2)

---
updated-dependencies:
- dependency-name: org.apache.thrift:libthrift
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
12 months agoAVRO-2921: Type Fixes for avro.datafile (#1262)
Michael A. Smith [Fri, 18 Jun 2021 23:18:46 +0000 (19:18 -0400)] 
AVRO-2921: Type Fixes for avro.datafile (#1262)

...and other small modules

- Type hint and refactor avro.datafile
- Type hint avro.test.mock_tether_parent
- Type hint avro.timezones

Also implements `__slots__` on avro.datafile to reduce the memory footprint of instances.

12 months agoAVRO-3152: Correct CodeQL Links in Readme (#1261)
Michael A. Smith [Fri, 18 Jun 2021 11:29:13 +0000 (07:29 -0400)] 
AVRO-3152: Correct CodeQL Links in Readme (#1261)

* AVRO-3152: Correct CodeQL Links in Readme

The original work in AVRO-3152 did not update the README.

* fixup! AVRO-3152: Correct CodeQL Links in Readme

* fixup! fixup! AVRO-3152: Correct CodeQL Links in Readme

* fixup! fixup! fixup! AVRO-3152: Correct CodeQL Links in Readme

12 months agoAVRO-2921: Type Fixes for avro.codecs (#1260)
Michael A. Smith [Wed, 16 Jun 2021 23:28:10 +0000 (19:28 -0400)] 
AVRO-2921: Type Fixes for avro.codecs (#1260)

* AVRO-2921: Fixup Test Coverage

Ensure test coverage is good before adding more type hints.

* AVRO-2921: Type Fixes for avro.codecs

12 months agoAVRO-2921: Type Hints for avro.schema and avro.protocol (#1259)
Michael A. Smith [Mon, 14 Jun 2021 13:11:10 +0000 (09:11 -0400)] 
AVRO-2921: Type Hints for avro.schema and avro.protocol (#1259)

* More Type Hints for avro.schema
* Type Fixes for avro.protocol

Adds a dependency to [typing-extensions](https://github.com/python/typing/blob/master/typing_extensions/README.rst), which has an [Apache Compatible 3rd Party License](https://www.apache.org/legal/resolved.html).
  - The dependency only applies to installations with Python versions earlier than 3.8.
  - It is licensed under the [Python Software Foundation License](https://github.com/python/typing/blob/master/LICENSE).

12 months agoBump jetty.version in /lang/java (#1255)
dependabot[bot] [Sun, 13 Jun 2021 12:02:22 +0000 (14:02 +0200)] 
Bump jetty.version in /lang/java (#1255)

Bumps `jetty.version` from 9.4.41.v20210516 to 9.4.42.v20210604.

Updates `jetty-server` from 9.4.41.v20210516 to 9.4.42.v20210604
- [Release notes](https://github.com/eclipse/jetty.project/releases)
- [Commits](https://github.com/eclipse/jetty.project/compare/jetty-9.4.41.v20210516...jetty-9.4.42.v20210604)

Updates `jetty-servlet` from 9.4.41.v20210516 to 9.4.42.v20210604
- [Release notes](https://github.com/eclipse/jetty.project/releases)
- [Commits](https://github.com/eclipse/jetty.project/compare/jetty-9.4.41.v20210516...jetty-9.4.42.v20210604)

Updates `jetty-util` from 9.4.41.v20210516 to 9.4.42.v20210604
- [Release notes](https://github.com/eclipse/jetty.project/releases)
- [Commits](https://github.com/eclipse/jetty.project/compare/jetty-9.4.41.v20210516...jetty-9.4.42.v20210604)

---
updated-dependencies:
- dependency-name: org.eclipse.jetty:jetty-server
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: org.eclipse.jetty:jetty-servlet
  dependency-type: direct:production
  update-type: version-update:semver-patch
- dependency-name: org.eclipse.jetty:jetty-util
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
12 months agoBump protobuf-java from 3.17.2 to 3.17.3 in /lang/java (#1257)
dependabot[bot] [Sun, 13 Jun 2021 12:01:59 +0000 (14:01 +0200)] 
Bump protobuf-java from 3.17.2 to 3.17.3 in /lang/java (#1257)

Bumps [protobuf-java](https://github.com/protocolbuffers/protobuf) from 3.17.2 to 3.17.3.
- [Release notes](https://github.com/protocolbuffers/protobuf/releases)
- [Changelog](https://github.com/protocolbuffers/protobuf/blob/master/generate_changelog.py)
- [Commits](https://github.com/protocolbuffers/protobuf/compare/v3.17.2...v3.17.3)

---
updated-dependencies:
- dependency-name: com.google.protobuf:protobuf-java
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
12 months agoBump zstd-jni from 1.4.9-5 to 1.5.0-2 in /lang/java (#1258)
dependabot[bot] [Sun, 13 Jun 2021 12:01:35 +0000 (14:01 +0200)] 
Bump zstd-jni from 1.4.9-5 to 1.5.0-2 in /lang/java (#1258)

Bumps [zstd-jni](https://github.com/luben/zstd-jni) from 1.4.9-5 to 1.5.0-2.
- [Release notes](https://github.com/luben/zstd-jni/releases)
- [Commits](https://github.com/luben/zstd-jni/compare/v1.4.9-5...v1.5.0-2)

---
updated-dependencies:
- dependency-name: com.github.luben:zstd-jni
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
12 months agoAVRO-3149: Add Rust based Implementation of Avro
Ismaël Mejía [Fri, 11 Jun 2021 14:58:52 +0000 (16:58 +0200)] 
AVRO-3149: Add Rust based Implementation of Avro

12 months agoAddress Rust PR review comments
Ismaël Mejía [Fri, 11 Jun 2021 12:09:50 +0000 (14:09 +0200)] 
Address Rust PR review comments

12 months agoAVRO-2921: Type Hints for avro.schema (#1252)
Michael A. Smith [Thu, 10 Jun 2021 02:09:54 +0000 (22:09 -0400)] 
AVRO-2921: Type Hints for avro.schema (#1252)

12 months agoAVRO-2921: Add Type Hints for avro.name (#1251)
Michael A. Smith [Wed, 9 Jun 2021 00:58:01 +0000 (20:58 -0400)] 
AVRO-2921: Add Type Hints for avro.name (#1251)

Refactor name registry into avro.name and add type hints.