avro.git
15 hours agoFix undefined variable field_desc_list in RecordSchema._MakeFieldMap (#355) master
Stefaan Lippens [Tue, 11 Dec 2018 20:33:26 +0000 (21:33 +0100)] 
Fix undefined variable field_desc_list in RecordSchema._MakeFieldMap (#355)

16 hours agoRemove version numbers from test poms, fix checkstyle
Daniel Kulp [Tue, 11 Dec 2018 20:07:56 +0000 (15:07 -0500)] 
Remove version numbers from test poms, fix checkstyle

16 hours agoAVRO-1749 Java: Introduce induce Maven plugin goal (#70)
Matheus Santana [Tue, 11 Dec 2018 20:04:42 +0000 (17:04 -0300)] 
AVRO-1749 Java: Introduce induce Maven plugin goal (#70)

16 hours agoUpdate package.json version
Daniel Kulp [Tue, 11 Dec 2018 19:13:54 +0000 (14:13 -0500)] 
Update package.json version

17 hours agoImproved conversions handling + pluggable conversions support [AVRO-1891, AVRO-2065...
Katrin Skoglund [Tue, 11 Dec 2018 19:07:08 +0000 (20:07 +0100)] 
Improved conversions handling + pluggable conversions support [AVRO-1891, AVRO-2065] (#329)

* Added end-to-end test that reproduces union with logical types problem

* Adding required conversions to SpecificData in generated class
(same as in SpecificCompiler)

* Added test with BigDecimal

* Added test with BigDecimal

* Introduced customizable conversions in compiler and Maven plugin.

* Fixed bug

* Fixed Maven plugin classpath

* Get the correct SpecificData whenever possible, to get the right conversions

* No need to expose the map of conversions so expose only the values.

* Better tests

* Default values and conversions

* Cleanup of some changes in Maven plugin

* Fixed equals() for classes with nested logical types. Improved tests

* Added missing copyright statement

* Fixed compile error after rebase

* Fixed problem with logical types in nested records.

* Fixed failing test.

* Fixed serialization problem when creating SpecificDatumReader from a class

17 hours agoAVRO-1777: Select best matching record when writing a union in python (#95)
shiraeeshi [Tue, 11 Dec 2018 18:28:03 +0000 (00:28 +0600)] 
AVRO-1777: Select best matching record when writing a union in python (#95)

* make numeric schemas not valid for boolean datums

* fix formatting

* fix int and long schemas

* fix brackets

* fix brackets

* add GenericRecord type

17 hours agoFix rat tests
Daniel Kulp [Tue, 11 Dec 2018 18:16:57 +0000 (13:16 -0500)] 
Fix rat tests

17 hours ago[AVRO-2034] Remove conditions that will always be true/false
Daniel Kulp [Tue, 11 Dec 2018 18:14:29 +0000 (13:14 -0500)] 
[AVRO-2034] Remove conditions that will always be true/false

17 hours agoAVRO-2034 Nested schema types with unexpected fields causes json parse failure (...
Todd Nine [Tue, 11 Dec 2018 18:13:31 +0000 (11:13 -0700)] 
AVRO-2034 Nested schema types with unexpected fields causes json parse failure (#224)

* AVRO-2034 Created test to prove issue

* AVRO-2034. Updates test to show a working record vs a failing record in the simplest possible scheme.

* AVRO-2034 Fixes advance logic to skip unrecognized fields at record end

17 hours agoAVRO-2184: Unable to decode JSON data file if a property is renamed in reader schema...
nandorKollar [Tue, 11 Dec 2018 18:10:29 +0000 (19:10 +0100)] 
AVRO-2184: Unable to decode JSON data file if a property is renamed in reader schema (#316)

* AVRO-2184: Unable to decode JSON data file if a property is renamed in reader schema

JsonDecoder doesn't honor aliases

* No need to wrap aliases to unmodifiableSet, since getter Schema#aliases already does it

* Remove unused import to pass Checkstyle check

38 hours agoSquashed commit of the following:
Daniel Kulp [Mon, 10 Dec 2018 21:53:29 +0000 (16:53 -0500)] 
Squashed commit of the following:
This closes #243

commit b2a5607578652f203e117c5b80d228618dd101f1
Merge: 500c28c2 54fc3f53
Author: Daniel Kulp <dan@kulp.com>
Date:   Mon Dec 3 14:46:47 2018 -0500

    Merge branch 'master' into master

commit 500c28c212d20e40fe48b6229cfc7764631f56e8
Author: Daniil Guitelson <dguitelson@openwaygroup.com>
Date:   Fri Sep 1 17:37:10 2017 +0300

    AVRO-2069: Use primitive fields in generated getters & setters in Java code

    Fix broken unit tests in TestSpecificCompilerTool after migrating to org.junit.Test

commit 35b891ebf868cea12f278641229807c1e2a35db2
Merge: c642adaf 189368ed
Author: Daniil Gitelson <daniil.guit@gmail.com>
Date:   Fri Sep 1 17:33:13 2017 +0300

    Merge pull request #1 from apache/master

    Sync up with origin repository

commit c642adaf3d29183049cd4ad2e0012b002d95d7c6
Author: Daniil Guitelson <dguitelson@openwaygroup.com>
Date:   Wed Aug 30 18:37:41 2017 +0300

    AVRO-2069: Use primitive fields in generated getters & setters in Java code

    Fix broken unit tests in TestSpecificCompilerTool

commit 3414eae643517591015e3a6154c726c31f2d3095
Author: Daniil Guitelson <dguitelson@openwaygroup.com>
Date:   Tue Aug 29 12:13:42 2017 +0300

    AVRO-2069: Use primitive fields in generated getters & setters in Java code

39 hours agoAVRO-2004: changed Protovis javascript functions to be compatible with Chrome.
Ken Dombeck [Fri, 3 Mar 2017 21:54:52 +0000 (15:54 -0600)] 
AVRO-2004: changed Protovis javascript functions to be compatible with Chrome.
http://stackoverflow.com/questions/6831655/protovis-what-are-these-functions-with-no-curly-braces

39 hours agoAVRO-2004: moved CSS and JS files to a directory where they will be included in the...
Ken Dombeck [Fri, 3 Mar 2017 21:52:48 +0000 (15:52 -0600)] 
AVRO-2004: moved CSS and JS files to a directory where they will be included in the final jar

39 hours agoadd ivy profile to generate ivy.xml desriptors for java artifacts
radai-rosenblatt [Thu, 13 Apr 2017 16:41:16 +0000 (09:41 -0700)] 
add ivy profile to generate ivy.xml desriptors for java artifacts

39 hours agoAVRO-1844: set correct header searching path for zlib, snappy & jansson.
yangyingchao [Thu, 18 May 2017 08:07:51 +0000 (16:07 +0800)] 
AVRO-1844: set correct header searching path for zlib, snappy & jansson.

This may be a typo. But according to cmake document,
"<XPREFIX>_INCLUDE_DIRS" will be set after module was found, instead of
"<XPREFIX>_INCLUDE_DIR".

39 hours agoavro-c: Fix build with clang compiler
Khem Raj [Mon, 10 Apr 2017 16:15:04 +0000 (09:15 -0700)] 
avro-c: Fix build with clang compiler

Clang advertizes itself to be compatible with gcc 4.2.1
while that was true several years ago, it now supports
a lot more newer features, the test to just check gcc
version should be supplanted with clang check as well
so atomic support in clang can be asserted as well

Fixes

lang/c/src/avro/refcount.h:301:2: error: "No atomic implementation!"

Signed-off-by: Khem Raj <raj.khem@gmail.com>
39 hours ago[AVRO-2058] Fix issues with Utf8 keys maps being treated as non-strings
Daniel Kulp [Mon, 10 Dec 2018 20:13:30 +0000 (15:13 -0500)] 
[AVRO-2058] Fix issues with Utf8 keys maps being treated as non-strings
This closes #237

commit 8852da40e7a0ee58d9b027173a4972e7e71b432d
Author: Sam Schlegel <git@lutin.us>
Date:   Wed Jul 26 19:20:51 2017 -0700

    Add failing test

40 hours agochange the error module to be thread-safe on Windows as well as on UNIX (depended...
Eliyahu-Machluf [Sun, 27 Nov 2016 10:09:02 +0000 (12:09 +0200)] 
change the error module to be thread-safe on Windows as well as on UNIX (depended on defining the macro THREADSAFE).
add appropriate test which launch several threads and validate the errors they set/add are thread-safe.

40 hours agoAVRO-2063. C: VERSION, SOVERSION not set correctly for shared library (#239)
Daniel Kulp [Mon, 10 Dec 2018 19:22:16 +0000 (14:22 -0500)] 
AVRO-2063. C: VERSION, SOVERSION not set correctly for shared library (#239)

Prior to this commit the VERSION and SOVERSION properties were not being
set correctly for the Avro C shared library. Previously, VERSION was
unset, and SOVERSION was set to the full dotted version string (e.g.
"23.0.0"), which resulted in a SONAME of "libavro.so.23.0.0", which is
incorrect.

This commit sets SOVERSION to the library's "current" version number
(obtained by invoking "version.sh libcurrent"), and sets VERSION to the
full dotted version string.

This should result in a proper libavro.so → libavro.so.23 →
libavro.so.23.0.0 symlink chain with a SONAME of "libavro.so.23".

See Sune Vuorela's article on "CMake and library properties":
http://pusling.com/blog/?p=352.

40 hours ago[AVRO-2026] Add valgrind to c tests
John Gill [Sat, 15 Apr 2017 22:32:20 +0000 (15:32 -0700)] 
[AVRO-2026] Add valgrind to c tests
This closes #218

Squashed merge of:
Don't clean after test. Allow review of memcheck files

Add valgrind to tests

Correct memory leaks in tests

41 hours agoAVRO-1167, AVRO-766: Fix c AVRO_LINK memory leaks (#217)
John Gill [Mon, 10 Dec 2018 18:56:07 +0000 (10:56 -0800)] 
AVRO-1167, AVRO-766: Fix c AVRO_LINK memory leaks (#217)

* AVRO-1167: Enhance avro_schema_copy for AVRO_LINK

- Add hash of named schemas found during copy
- Find saved named  schema for copy of AVRO_LINK

* AVRO-766: Correct memory leaks in AVRO_LINK copy

- Adds test cases for AVRO-766 & AVRO-1167
- Corrects reference counting for avro_schema_copy

* Enable TEST_AVRO_1167 in test_avro_766

This ensures that both fixes work together and that no valgrind errors are produced from a recrusive schema.

41 hours agoCleanup csharp tests a bit
Daniel Kulp [Mon, 10 Dec 2018 18:31:23 +0000 (13:31 -0500)] 
Cleanup csharp tests a bit

42 hours ago[AVRO-1952] Squashed commit of the following:
Daniel Kulp [Mon, 10 Dec 2018 18:05:59 +0000 (13:05 -0500)] 
[AVRO-1952] Squashed commit of the following:
This closes #134

commit 0cf2081569f3244ae535710d46ea41e15e57bbcc
Author: dolow <do_low@hotmail.com>
Date:   Wed Sep 28 20:10:17 2016 +0900

    removed unused GetConstructor methods

commit aad24a7b1bbeb39105b8b3ee9578dbc792d8cfea
Author: dolow <do_low@hotmail.com>
Date:   Wed Sep 28 17:45:43 2016 +0900

    replaced Reflection.Emit to simple instantiation for supporting AOT.

42 hours agofix avrogen.exe output dir path format using Path API
Naruto TAKAHASHI [Fri, 30 Sep 2016 02:43:59 +0000 (11:43 +0900)] 
fix avrogen.exe output dir path format using Path API

4 days agoOptimize ruby binary encoder/decoder
Kyle Phelps [Thu, 6 Dec 2018 18:33:19 +0000 (13:33 -0500)] 
Optimize ruby binary encoder/decoder

6 days agoFix typo in error messages (Unknown instead of Uknown)
Quentin Burny [Mon, 26 Feb 2018 13:59:44 +0000 (14:59 +0100)] 
Fix typo in error messages (Unknown instead of Uknown)

6 days agoC# - Generic Record - Fix false positive equality (#204)
Lukas Sedlacek [Wed, 5 Dec 2018 16:19:07 +0000 (16:19 +0000)] 
C# - Generic Record - Fix false positive equality (#204)

* C# - Test GenericRecord.Equals with [map,array] field

* C# - Fix GenericRecord.Equals for [map,array] field

6 days agoAVRO-2156: Map Avro namespace to C# namespaces during code generation
Brian Lachniet [Sat, 10 Mar 2018 23:34:49 +0000 (18:34 -0500)] 
AVRO-2156: Map Avro namespace to C# namespaces during code generation

6 days agoAVRO-2144: Fix for CSharp documentation Url
Selva Chinnasamy [Thu, 22 Feb 2018 00:42:02 +0000 (19:42 -0500)] 
AVRO-2144: Fix for CSharp documentation Url

6 days agoAVRO-2155: Include documentation for named schemas in generated code (#296)
Brian Lachniet [Wed, 5 Dec 2018 14:52:38 +0000 (09:52 -0500)] 
AVRO-2155: Include documentation for named schemas in generated code (#296)

* AVRO-2155: Add `Documentation` property to `NamedSchema`

* AVRO-2155: Add documentation to generated code

7 days agoAVRO-2192: Remove paranamer dependency from Avro (#400)
Ismaël Mejía [Wed, 5 Dec 2018 07:11:54 +0000 (08:11 +0100)] 
AVRO-2192: Remove paranamer dependency from Avro (#400)

7 days agoAVRO-1542 replacing auto_ptr by unique_ptr & std::move
Sandeep Joshi [Tue, 20 Sep 2016 07:30:27 +0000 (13:00 +0530)] 
AVRO-1542 replacing auto_ptr by unique_ptr & std::move
This closes #157

7 days agoAVRO-1939: Add missing Apache license header (#399)
Ismaël Mejía [Tue, 4 Dec 2018 13:05:30 +0000 (14:05 +0100)] 
AVRO-1939: Add missing Apache license header (#399)

Add missing Apache license header and fix failing test case for schema normalization tool

8 days agofixes unicode compile on windows
skarlsson [Sun, 12 Feb 2017 14:07:13 +0000 (15:07 +0100)] 
fixes unicode compile on windows

8 days agoAvro1363 C# union schema can now contain multiple entries with the same name and...
Simon24601 [Mon, 3 Dec 2018 20:13:34 +0000 (20:13 +0000)] 
Avro1363  C# union schema can now contain multiple entries with the same name and different namespace (#131)

* AVRO-1849 Fix the issue where converting the schema of a record with no fields produced an invalid JSON

* Fix style issues in the code.

* Fix the build scripts; build.sh requires the :z addition to work on SELinux (see Jira 1925). lang/c++/build.sh refers to the lang/c++/build directory which is empty. These are now fixed.

* Update to use BOOST_TEST_CHECKPOINT

* AVRO-1926 Revert changes to the lang/c++/build.sh script and add the SchemaTests to the list of tests. Also revert SELinux changes to build.sh as these should be committed separately

* AVRO-1363 Fix the parsing of a union schema with duplicate names but different namespaces. In Java, this works, but not in C#

* Remove c++ changes from the AVRO1363 branch

8 days agoAVRO-1939: Add commandline tool that outputs canonical form of schema
Erik Forsberg [Mon, 24 Oct 2016 12:13:15 +0000 (14:13 +0200)] 
AVRO-1939: Add commandline tool that outputs canonical form of schema

12 days agoAVRO-1528. C: Applied patch for enum bounds.
Ben Walsh [Tue, 13 Jan 2015 16:10:24 +0000 (16:10 +0000)] 
AVRO-1528. C: Applied patch for enum bounds.

12 days agoC: Allow file with no records. (#160)
walshb [Thu, 29 Nov 2018 21:26:23 +0000 (21:26 +0000)] 
C: Allow file with no records. (#160)

12 days agoC: Allow record to have no fields.
Ben Walsh [Tue, 20 Aug 2013 08:41:46 +0000 (08:41 +0000)] 
C: Allow record to have no fields.

12 days agoAVRO-1858 add tojson head mode (#100)
MikeHurleySurescripts [Thu, 29 Nov 2018 20:39:34 +0000 (14:39 -0600)] 
AVRO-1858 add tojson head mode (#100)

* AVRO-1858: added --head option to the tojson operation

* AVRO-1858: added unit tests for tojson --head option

* AVRO-1858: head input and record counters are now longs

* AVRO-1858: added tojson --head tests for zero and negative values. Negative head count is now an error.

12 days agoAVRO-1743: override writeFixed in BlockingBinaryEncoder
Taras Bobrovytsky [Wed, 16 Mar 2016 21:21:02 +0000 (14:21 -0700)] 
AVRO-1743: override writeFixed in BlockingBinaryEncoder
Closed #78

12 days ago[AVRO-2226] Fixes UnionSchema specificity
Andrew Kelleher [Fri, 14 Sep 2018 13:31:56 +0000 (09:31 -0400)] 
[AVRO-2226] Fixes UnionSchema specificity

Trouble arises in the python library when deducing the appropriate schema from a list of schemas given a particular datum.

When "null" values are allowed for fields in two separate schemas, there is no way to differentiate which should schema be used given of a list of schemas that are set as the type definition for a record.

This PR checks to ensure all fields defined on a given datum are _also_ defined in the schema being validated to use for that datum.

With this bugfix, datums such as `{"foo": "a"}` will not "cast" to schemas such as `{"name": "bar", "type": ["long", "null"]}`, which is currently the case.

12 days agoAdd license header
Daniel Kulp [Thu, 29 Nov 2018 19:43:31 +0000 (14:43 -0500)] 
Add license header

12 days agoAVRO-2131 Modified Schema.parse(JsonNode schema, Names names) to allow Unions with...
Jeff Maxwell [Thu, 29 Nov 2018 19:42:19 +0000 (13:42 -0600)] 
AVRO-2131 Modified Schema.parse(JsonNode schema, Names names) to allow Unions with self references. (#278)

12 days ago[AVRO-2129] Add getEncoder method to match getDecoder
Daniel Kulp [Thu, 29 Nov 2018 19:33:48 +0000 (14:33 -0500)] 
[AVRO-2129] Add getEncoder method to match getDecoder
Closes #277

12 days agoClean up Ruby warnings
Tim Perkins [Mon, 26 Nov 2018 20:08:24 +0000 (15:08 -0500)] 
Clean up Ruby warnings

12 days agoAVRO-2276: Escape Map keys in GenericData.toString to generate valid JSON
Ismaël Mejía [Tue, 27 Nov 2018 22:01:13 +0000 (14:01 -0800)] 
AVRO-2276: Escape Map keys in GenericData.toString to generate valid JSON

12 days agoAVRO-2279: Fix broken java build on windows
Ismaël Mejía [Thu, 29 Nov 2018 14:43:49 +0000 (15:43 +0100)] 
AVRO-2279: Fix broken java build on windows

2 weeks agoAVRO-2274 Improve resolving performance when schemas don't change. (#393) 394/head
Raymie Stata [Wed, 28 Nov 2018 03:32:45 +0000 (19:32 -0800)] 
AVRO-2274 Improve resolving performance when schemas don't change. (#393)

* AVRO-2274 Improve resolving performance when schemas don't change.

* AVRO-2274 Break out of field-no-reorder loop as early as possible.

2 weeks agoAVRO-2142: Fix SchemaBuilder javadoc code snippet
Ismaël Mejía [Mon, 12 Feb 2018 12:58:44 +0000 (13:58 +0100)] 
AVRO-2142: Fix SchemaBuilder javadoc code snippet

2 weeks agoAVRO-2181: missing escape character added
Hans-Peter Werner [Mon, 28 May 2018 17:49:39 +0000 (19:49 +0200)] 
AVRO-2181: missing escape character added

2 weeks agoRemove warning: comparison of unsigned expression < 0 is always false [-Werror=type...
jmccl [Tue, 12 Jun 2018 21:16:38 +0000 (14:16 -0700)] 
Remove warning: comparison of unsigned expression < 0 is always false [-Werror=type-limits]

2 weeks agoAVRO-2269 More documentation for using Perf.java
rstata [Mon, 26 Nov 2018 00:30:00 +0000 (16:30 -0800)] 
AVRO-2269 More documentation for using Perf.java

2 weeks agoAdded build.sh flag to pass extra docker-run args, updated perf-doc to explain how...
rstata [Mon, 26 Nov 2018 00:06:20 +0000 (16:06 -0800)] 
Added build.sh flag to pass extra docker-run args, updated perf-doc to explain how to use.

2 weeks agoAVRO-2269 Make Perf.java more usable.
rstata [Sat, 3 Nov 2018 02:31:34 +0000 (19:31 -0700)] 
AVRO-2269 Make Perf.java more usable.

2 weeks agoC: Namespace "" means space = NULL.
Ben Walsh [Fri, 17 May 2013 10:11:08 +0000 (10:11 +0000)] 
C: Namespace "" means space = NULL.

3 weeks agoAVRO-1658 Added Javadoc to AvroDoc.java, which was missing on initial commit.
rstata [Wed, 21 Nov 2018 00:28:06 +0000 (16:28 -0800)] 
AVRO-1658 Added Javadoc to AvroDoc.java, which was missing on initial commit.

3 weeks agoAVRO-1658: Java: Add reflection annotation @AvroDoc.
Evan McClain [Sun, 17 Sep 2017 04:13:54 +0000 (00:13 -0400)] 
AVRO-1658: Java: Add reflection annotation @AvroDoc.

@AvroMeta can be used for other keys, but doc is passed into the field's
constructor.

Patch 2: @AvroDoc should work for class-level documentation too.

Closes #189

3 weeks agoSquashed commit of the following:
Daniel Kulp [Tue, 20 Nov 2018 19:44:26 +0000 (14:44 -0500)] 
Squashed commit of the following:

commit a3f86c2874ad6d86b11fc2edc908065adcefdeda
Author: Daniel Kulp <dkulp@apache.org>
Date:   Tue Nov 20 14:32:48 2018 -0500

    Grab some more tests from other PR

commit 7d7822b5960c157ddf6db7fa15a3d797d0b286ee
Author: Joseph Pachod <joseph.pachod@berger-levrault.fr>
Date:   Sun Dec 11 22:50:45 2016 +0100

    new javadoc with same formatting as other javadoc

commit 82e8f7af6736034f4e85a4e6e1bcaa803019082e
Author: Joseph Pachod <joseph.pachod@berger-levrault.fr>
Date:   Sun Dec 11 22:38:33 2016 +0100

    restore initial imports

commit 0ca9815c8c884bc30c73b5c8a3c5d4c6e5188cee
Author: Joseph Pachod <joseph.pachod@berger-levrault.fr>
Date:   Sun Dec 11 22:36:03 2016 +0100

    javadoc

commit 551e1eb4a6bdedf00260ef90576490648f9b4658
Author: Joseph Pachod <joseph.pachod@berger-levrault.fr>
Date:   Wed Dec 7 23:14:03 2016 +0100

    format and clarify pre existing tests

commit 857da0c70a2db321d5bf521b901fe0c035f32edc
Author: Joseph Pachod <joseph.pachod@berger-levrault.fr>
Date:   Wed Dec 7 22:53:13 2016 +0100

    AVRO-1961: Java: add isUnion and isNullable on Schema class

Closes #169

3 weeks agoSquashed commit of the following:
Daniel Kulp [Tue, 20 Nov 2018 19:05:03 +0000 (14:05 -0500)] 
Squashed commit of the following:

commit 6a919437bff0977926b33cd56165994b22fbdf74
Author: Niels Basjes <nbasjes@bol.com>
Date:   Fri Nov 25 10:31:40 2016 +0100

    AVRO-1961: Extra flag to replace the regular getters with getters that return an Optional

commit 91d58b5dba7562240a84f6885037f9c74dc973e6
Author: Niels Basjes <nbasjes@bol.com>
Date:   Tue Nov 22 17:23:18 2016 +0100

    AVRO-1961: Java: Generate getters that return a Java 8 Optional.

Closes #162

3 weeks agoAVRO-2244 Fix flaky datetime test (#386)
Thiruvalluvan M G [Tue, 20 Nov 2018 10:58:53 +0000 (16:28 +0530)] 
AVRO-2244 Fix flaky datetime test (#386)

3 weeks agoAVRO-2039: Ruby encoding performance improvements (#230)
Tim Perkins [Tue, 20 Nov 2018 09:31:46 +0000 (04:31 -0500)] 
AVRO-2039: Ruby encoding performance improvements (#230)

3 weeks agoAVRO-2267 Removed copies of RandomData (#385)
Thiruvalluvan M G [Tue, 20 Nov 2018 09:27:33 +0000 (14:57 +0530)] 
AVRO-2267 Removed copies of RandomData (#385)

AVRO-2267 Removed copies of RandomData

3 weeks agoPrevent error checking compatibility of a record reading a union (#368)
Tim Perkins [Sun, 18 Nov 2018 17:30:03 +0000 (12:30 -0500)] 
Prevent error checking compatibility of a record reading a union (#368)

3 weeks agoAVRO-2239: Fix RPC interop tests for Ruby (#381)
Tim Perkins [Sun, 18 Nov 2018 17:05:41 +0000 (12:05 -0500)] 
AVRO-2239: Fix RPC interop tests for Ruby (#381)

3 weeks agoMake snnappy/xz/zstd-jni/paranamer optional/provided in avro jar.
Daniel Kulp [Fri, 16 Nov 2018 20:48:57 +0000 (15:48 -0500)] 
Make snnappy/xz/zstd-jni/paranamer optional/provided in avro jar.

3 weeks ago[AVRO-1605] Remove deprecated API's that expose JsonNode
Daniel Kulp [Fri, 16 Nov 2018 19:14:50 +0000 (14:14 -0500)] 
[AVRO-1605] Remove deprecated API's that expose JsonNode

3 weeks agoAVRO-2268 Support List.clear operation for FooBarSpecificRecord.nicknames field ...
Raymie Stata [Fri, 16 Nov 2018 08:50:18 +0000 (00:50 -0800)] 
AVRO-2268 Support List.clear operation for FooBarSpecificRecord.nicknames field (#382)

3 weeks agoSuppressed the warning from m2e maven plugin
Thiruvalluvan M G [Thu, 15 Nov 2018 17:48:36 +0000 (23:18 +0530)] 
Suppressed the warning from m2e maven plugin

3 weeks agoAVRO-1702: Added support for logical types in the C++ client. (#379)
Aniket Mokashi [Wed, 14 Nov 2018 14:29:17 +0000 (06:29 -0800)] 
AVRO-1702: Added support for logical types in the C++ client. (#379)

* Added support for logical types in the C++ client.

* Addressed thiru's comments.

* fix tests

* fix tests

* fix string formatting

* fix string formatting

* fix string formatting

4 weeks agoAVRO-2265 Remove Guava as a test dependency (#377)
Fokko Driesprong [Tue, 13 Nov 2018 08:50:05 +0000 (09:50 +0100)] 
AVRO-2265 Remove Guava as a test dependency (#377)

4 weeks ago Partially addressed the problem of constructing nested Array/Map schemas (#374)
Thiruvalluvan M G [Tue, 13 Nov 2018 02:07:05 +0000 (07:37 +0530)] 
 Partially addressed the problem of constructing nested Array/Map schemas (#374)

* Partially addressed the problem of constrcuting nested Array/Map schemas

* Removed an unused function

4 weeks agoAVRO-2262 Unit test to test codec behavior on sliced buffers (#376)
jacobtolar [Mon, 12 Nov 2018 20:05:38 +0000 (14:05 -0600)] 
AVRO-2262 Unit test to test codec behavior on sliced buffers (#376)

See #352 for further reference.

4 weeks agoSkipping iovec for Win32 (#375)
Thiruvalluvan M G [Mon, 12 Nov 2018 18:01:26 +0000 (23:31 +0530)] 
Skipping iovec for Win32 (#375)

4 weeks agoAVRO-2261 Bump Rat version (#372)
Fokko Driesprong [Mon, 12 Nov 2018 15:22:24 +0000 (16:22 +0100)] 
AVRO-2261 Bump Rat version (#372)

4 weeks agoAVRO-2263 Bump Apache commons-cli to 1.4 (#371)
Fokko Driesprong [Mon, 12 Nov 2018 15:22:04 +0000 (16:22 +0100)] 
AVRO-2263 Bump Apache commons-cli to 1.4 (#371)

4 weeks ago AVRO-1256: C++ API compileJsonSchema ignores "doc" and custom attributes on a field...
Aniket Mokashi [Mon, 12 Nov 2018 12:57:39 +0000 (04:57 -0800)] 
 AVRO-1256: C++ API compileJsonSchema ignores "doc" and custom attributes on a field/record (#345)

* AVRO-1256. C++ API compileJsonSchema ignores doc and custom attributes on a field/record

* minor code fixes

* minor code fixes

* more std::string fixes

* Add escape_json function to print doc string

* solve merge conflict

* compactSchema changes

* minor refactor

* Fix tests

* fix formatting

* fix formatting

* Fix nullptr and tests

4 weeks agoAVRO-2264 Bump Apache commons-lang3 to 3.8.1
Fokko Driesprong [Mon, 12 Nov 2018 12:47:34 +0000 (13:47 +0100)] 
AVRO-2264 Bump Apache commons-lang3 to 3.8.1

4 weeks agoAVRO-2262 Java compression codec fixes. (#352)
jacobtolar [Mon, 12 Nov 2018 11:18:09 +0000 (05:18 -0600)] 
AVRO-2262 Java compression codec fixes. (#352)

AVRO-2262 Java compression codec improvements

4 weeks agoFix for C++ tests to run on Docker (#369)
Thiruvalluvan M G [Sun, 11 Nov 2018 19:03:05 +0000 (00:33 +0530)] 
Fix for C++ tests to run on Docker (#369)

* Made the C++ build work in Docker

* Modified docker to run all tests including C++ ones

* Re-enabled C++ build

4 weeks agoAVRO-2183 Provide name only for named schema (#313)
Michael A. Smith [Sat, 10 Nov 2018 09:19:16 +0000 (04:19 -0500)] 
AVRO-2183 Provide name only for named schema (#313)

Otherwise, allow python to raise an AttributeError

4 weeks agoRemove some java6 code, add a configurable limit for maximum string lengths to read
Daniel Kulp [Thu, 8 Nov 2018 18:28:50 +0000 (13:28 -0500)] 
Remove some java6 code, add a configurable limit for maximum string lengths to read

4 weeks agoSince we will no longer support java6 and 7, remove the "optimizations" for those
Daniel Kulp [Thu, 8 Nov 2018 18:10:44 +0000 (13:10 -0500)] 
Since we will no longer support java6 and 7, remove the "optimizations" for those

4 weeks agoAVRO-2127: throw more specific exceptions from DataFileStream#initialize (#323)
Vladislav [Thu, 8 Nov 2018 17:28:27 +0000 (20:28 +0300)] 
AVRO-2127: throw more specific exceptions from DataFileStream#initialize (#323)

* AVRO-2127: throw more specific exceptions from DataFileStream#initialize

* AVRO-2127: throw more specific exceptions from DataFileReader12

4 weeks agoRemove println
Daniel Kulp [Thu, 8 Nov 2018 17:22:06 +0000 (12:22 -0500)] 
Remove println

4 weeks agoFix javadoc link
Andrew Duffy [Thu, 8 Nov 2018 16:41:20 +0000 (11:41 -0500)] 
Fix javadoc link

Currently, this links to https://avro.apache.org/docs/1.8.2/api/java/org/apache/avro/io/doc-files/parsing.html

The link should actually be to https://avro.apache.org/docs/1.8.2/api/java/org/apache/avro/io/parsing/doc-files/parsing.html

4 weeks agoFix map with no string keys toString method
trompa [Wed, 22 Aug 2018 13:33:48 +0000 (15:33 +0200)] 
Fix map with no string keys toString method

4 weeks agoUpdate to commons-lang3 which is in common with what velocity will bring in
Daniel Kulp [Thu, 8 Nov 2018 16:01:57 +0000 (11:01 -0500)] 
Update to commons-lang3 which is in common with what velocity will bring in

4 weeks agoUpdate compiler pom to load into m2e
Daniel Kulp [Thu, 8 Nov 2018 15:42:38 +0000 (10:42 -0500)] 
Update compiler pom to load into m2e

4 weeks ago[AVRO-2245] Improve java tests for compression codecs
jacobtolar [Thu, 8 Nov 2018 16:09:35 +0000 (10:09 -0600)] 
[AVRO-2245] Improve java tests for compression codecs

4 weeks ago[AVRO-2228] Bump Apache Velocity to 2.0
Fokko Driesprong [Mon, 24 Sep 2018 17:07:03 +0000 (10:07 -0700)] 
[AVRO-2228] Bump Apache Velocity to 2.0

- Remove Slf4jLogChute since 2.0 uses SLF4J itself
- Update $velocityHasNext to $foreach.hasNext because of deprecation
- Update $velocityCount to $foreach.count because of deprecation
- 2.0 does not depend on apache-common collections anymore which
  used to be an old version with security issues

4 weeks agoAllow to set template dir for avro-tools compile
Artem Yarulin [Tue, 6 Nov 2018 22:30:41 +0000 (00:30 +0200)] 
Allow to set template dir for avro-tools compile

maven-avro-plugin allows to specify custom template
directory (https://issues.apache.org/jira/browse/AVRO-983), same
applies to
gradle-avro-plugin (https://github.com/commercehub-oss/gradle-avro-plugin#templatedirectory).

It would be useful to support that in Arvo CLI tools as well. Use
case: generating Java classes during CI or for any scripting needs
when using maven or gradle plugins is too much

4 weeks agoAVRO-2240 Fix py3 Setup (#347)
Michael A. Smith [Wed, 7 Nov 2018 22:15:27 +0000 (17:15 -0500)] 
AVRO-2240 Fix py3 Setup (#347)

* AVRO-2240 Make setup.py python2 compatible

Indicate that avro-python3 is only python3 compatible without making the
setup script itself incompatible with python 2.

Fix a bug with chmod in setup.py

Add trove classifiers to setup.py

* Specify Python 3.4 and Up

Lazy Consensus per the utter silence of https://mail-archives.apache.org/mod_mbox/avro-dev/201810.mbox/%3CCA%2BB44%2BC0MLQreV2tozd8GFv74qnyBT0%2B3rd44Ey29Gv4T_9%2B3Q%40mail.gmail.com%3E.

* AVRO-2240 Remove Junk

4 weeks agoAVRO-1695: Ruby support for logical types revisited (#116)
Tim Perkins [Wed, 7 Nov 2018 21:50:10 +0000 (16:50 -0500)] 
AVRO-1695: Ruby support for logical types revisited (#116)

* AVRO-1695: Ruby support for logical types
* Support values for logical types that were already encoded

4 weeks ago[AVRO-2051] Remove synchronization for JsonProperties.getJsonProp
Daniel Kulp [Mon, 17 Jul 2017 19:08:10 +0000 (15:08 -0400)] 
[AVRO-2051] Remove synchronization for JsonProperties.getJsonProp
Fixes #245

4 weeks agoAVRO-2234 Use MappingProxyType, not ImmutableDict (#337)
Michael A. Smith [Wed, 7 Nov 2018 15:10:01 +0000 (10:10 -0500)] 
AVRO-2234 Use MappingProxyType, not ImmutableDict (#337)

Per the Rejection Notice of PEP-416, use MappingProxyType instead of
creating our own implementation of ImmutableDict.

4 weeks agoAVRO-1887 Integrate Yetus and fix tests (#353) AVRO-2228
Fokko Driesprong [Wed, 7 Nov 2018 12:52:22 +0000 (13:52 +0100)] 
AVRO-1887 Integrate Yetus and fix tests (#353)

* AVRO-1887 Setup precommit checks via Apache Yetus

Signed-off-by: sacharya <suraj.spa@gmail.com>
* AVRO-1887 Integrate Yetus

Add a precommit hook using Apache Yetus that will invoke the test
suite of the different languages

- Disable Ruby integration tests tests
- Fix Flaky Java Datetime test
  When the milsecons would have trailing zero, it would get trimmed
- Align the order of imports

5 weeks agoFix test
Daniel Kulp [Tue, 6 Nov 2018 20:48:40 +0000 (15:48 -0500)] 
Fix test

5 weeks agoRemove use of guava by utilizing java8 lambdas and collections
Daniel Kulp [Tue, 6 Nov 2018 20:38:51 +0000 (15:38 -0500)] 
Remove use of guava by utilizing java8 lambdas and collections

5 weeks agoSquashed commit of the following:
Daniel Kulp [Fri, 2 Nov 2018 20:40:09 +0000 (16:40 -0400)] 
Squashed commit of the following:

commit 6d4d6d6a963fd2363d9f5549f76140bdddfceb7d
Author: Gabor Szadovszky <gabor.szadovszky@cloudera.com>
Date:   Sun Oct 16 17:22:53 2016 +0200

    AVRO-1605 - Removed some unnecessary Accessor methods and callers

commit adcefac6cc1c7021b2a27da16b40c1253eff64cc
Author: Gabor Szadovszky <gabor.szadovszky@cloudera.com>
Date:   Thu Sep 29 18:35:26 2016 +0200

    AVRO-1605 - Remove Jackson classes from public API (Removed jackson references from javadoc)

commit dc2ca7ee9f881901aaf23d9221cc2d6413b43dc4
Author: Gabor Szadovszky <gabor.szadovszky@cloudera.com>
Date:   Thu Sep 29 14:31:40 2016 +0200

    AVRO-1605 - Remove Jackson classes from public API

commit 4e4c5ec63b3b0cf203e3af21c1cbc7a51d63c9f4
Author: Gabor Szadovszky <gabor.szadovszky@cloudera.com>
Date:   Wed Sep 28 17:08:15 2016 +0200

    AVRO-1605 - Remove Jackson classes from public API (INCOMPLETE#4)

commit 5fb5a5c14fadc03f44879f029114c4705749dfad
Author: Gabor Szadovszky <gabor.szadovszky@cloudera.com>
Date:   Wed Sep 28 16:54:44 2016 +0200

    AVRO-1605 - Remove Jackson classes from public API (INCOMPLETE#3)

commit 378fcc5aa6be560c301e23b73f919bc0eb98dd05
Author: Gabor Szadovszky <gabor.szadovszky@cloudera.com>
Date:   Wed Sep 28 11:11:40 2016 +0200

    AVRO-1605 - Remove Jackson classes from public API (INCOMPLETE#2)

commit 12533657f9bc73c73b1009ed2d9dd39ca2401a20
Author: Gabor Szadovszky <gabor.szadovszky@cloudera.com>
Date:   Mon Sep 26 16:25:19 2016 +0200

    AVRO-1605 - Remove Jackson classes from public API (INCOMPLETE)