Overhaul type serialization/deserialization machinery (#156)
authorJacob Quinn <quinn.jacobd@gmail.com>
Mon, 29 Mar 2021 13:22:44 +0000 (07:22 -0600)
committerGitHub <noreply@github.com>
Mon, 29 Mar 2021 13:22:44 +0000 (07:22 -0600)
commitff53d1359c01ae3e98fa3723f9f994c9ba420050
tree19c05b4657e33420e2fc1bf4b78286fd2f1b6bfa
parent2cacbe5384d3494bb49d929a8b386514f0111c74
Overhaul type serialization/deserialization machinery (#156)

* Start work on overhauling type serialization architecture

* More work; serialization is pretty much done but not tested

* fix timetype ArrowTypes definitions

* more work to get tests passing

* get tests passing?

* fix

* Fix #75 by supporting Set serialization/deserialization

* Fix #85 by supporting tuple serialization/deserialization

* Lots of cleanup

* few more fixes

* Update src/arrowtypes.jl

Co-authored-by: Jarrett Revels <jarrettrevels@gmail.com>
* Update src/arrowtypes.jl

Co-authored-by: Jarrett Revels <jarrettrevels@gmail.com>
* fix NullKind reading

* Fix #134 by requiring concrete or union of concrete element types for
all columns when serializing

* Add new ArrowTypes.arrowmetadata method for providing additional extension type metadata htat can be used in JuliaType

* Update manual

* tests

Co-authored-by: Jarrett Revels <jarrettrevels@gmail.com>
19 files changed:
docs/src/manual.md
src/Arrow.jl
src/arraytypes/arraytypes.jl
src/arraytypes/bool.jl
src/arraytypes/dictencoding.jl
src/arraytypes/fixedsizelist.jl
src/arraytypes/list.jl
src/arraytypes/map.jl
src/arraytypes/primitive.jl
src/arraytypes/struct.jl
src/arraytypes/unions.jl
src/arrowtypes.jl
src/eltypes.jl
src/table.jl
src/utils.jl
src/write.jl
test/arrowjson.jl
test/dates.jl
test/runtests.jl