iceberg.git
3 months agoCore: Add reference_snapshot_id filter column to all_manifests table (#4847)
Szehon Ho [Wed, 29 Jun 2022 22:49:08 +0000 (15:49 -0700)] 
Core: Add reference_snapshot_id filter column to all_manifests table (#4847)

3 months agoAPI: Fix version exception when registering metadata (#4946)
Ajantha Bhat [Wed, 29 Jun 2022 18:39:46 +0000 (00:09 +0530)] 
API: Fix version exception when registering metadata (#4946)

3 months agoAWS: Support overriding endpoint in DynamoDB (#4726)
Yuya Ebihara [Wed, 29 Jun 2022 18:36:18 +0000 (20:36 +0200)] 
AWS: Support overriding endpoint in DynamoDB (#4726)

3 months agoFlink: Remove unnecessary switch statement (#4737)
Yonghua Jian_deepnova [Wed, 29 Jun 2022 18:34:00 +0000 (02:34 +0800)] 
Flink: Remove unnecessary switch statement (#4737)

Co-authored-by: jian yonghua <jianyonghua@163.com>
3 months agoCore: Avoid snapshot ID collisions (#4747)
Ajantha Bhat [Wed, 29 Jun 2022 18:32:58 +0000 (00:02 +0530)] 
Core: Avoid snapshot ID collisions (#4747)

3 months agoNessie: Update to 0.30.0 (#4780)
Robert Stupp [Wed, 29 Jun 2022 18:28:27 +0000 (20:28 +0200)] 
Nessie: Update to 0.30.0 (#4780)

3 months agoSpec: Fix language in spec ORC type notes (#4976)
Szehon Ho [Wed, 29 Jun 2022 16:58:25 +0000 (09:58 -0700)] 
Spec: Fix language in spec ORC type notes (#4976)

3 months agoDocs: Add Flink SQL client -i docs (#5003)
zhaoym_deepnova [Wed, 29 Jun 2022 16:56:57 +0000 (00:56 +0800)] 
Docs: Add Flink SQL client -i docs (#5003)

3 months agoSpark 3.x: Use original option keys in SparkCatalog (#5044)
Rajarshi Sarkar [Wed, 29 Jun 2022 16:26:49 +0000 (21:56 +0530)] 
Spark 3.x: Use original option keys in SparkCatalog (#5044)

3 months agoSpark: Port performance fix for Spark 3.2 to 3.3 (#5155)
Bryan Keller [Wed, 29 Jun 2022 16:20:18 +0000 (09:20 -0700)] 
Spark: Port performance fix for Spark 3.2 to 3.3 (#5155)

3 months agoCore: Make StreamingDelete public (#5148)
Gustavo Torres [Wed, 29 Jun 2022 16:18:48 +0000 (09:18 -0700)] 
Core: Make StreamingDelete public (#5148)

3 months agoPython: Resolve write/read schemas (#5116)
Fokko Driesprong [Wed, 29 Jun 2022 14:51:58 +0000 (16:51 +0200)] 
Python: Resolve write/read schemas (#5116)

3 months agoSpark 3.3: Support AS OF syntax in Spark SQL for time travel (#5156)
Prashant Singh [Wed, 29 Jun 2022 14:47:28 +0000 (20:17 +0530)] 
Spark 3.3: Support AS OF syntax in Spark SQL for time travel (#5156)

Co-authored-by: Prashant Singh <psinghvk@amazon.com>
3 months agoCore: Test serialization of LoadTableResponse (#5118)
Kyle Bendickson [Wed, 29 Jun 2022 14:37:52 +0000 (07:37 -0700)] 
Core: Test serialization of LoadTableResponse (#5118)

3 months agoSpark: Fix regression from Scan refactor (#5143)
Bryan Keller [Tue, 28 Jun 2022 23:58:51 +0000 (16:58 -0700)] 
Spark: Fix regression from Scan refactor (#5143)

3 months agoPython: Make the VoidTransform a singleton (#5149)
Fokko Driesprong [Tue, 28 Jun 2022 23:53:53 +0000 (01:53 +0200)] 
Python: Make the VoidTransform a singleton (#5149)

3 months agoSpec: Fix typo in REST catalog spec (#5152)
Kyle Bendickson [Tue, 28 Jun 2022 23:53:20 +0000 (16:53 -0700)] 
Spec: Fix typo in REST catalog spec (#5152)

3 months agoDocs: Update README.md project description.
Ryan Blue [Tue, 28 Jun 2022 16:45:48 +0000 (09:45 -0700)] 
Docs: Update README.md project description.

3 months agoenable ci for 3.2
Prashant Singh [Mon, 20 Jun 2022 10:30:15 +0000 (16:00 +0530)] 
enable ci for 3.2

3 months agocopy 3.2 files from 3.3
Prashant Singh [Tue, 28 Jun 2022 05:01:13 +0000 (10:31 +0530)] 
copy 3.2 files from 3.3

3 months agomake spark 3.3 work
Prashant Singh [Mon, 20 Jun 2022 11:37:41 +0000 (17:07 +0530)] 
make spark 3.3 work

3 months agomove spark/v3.2 to spark/v3.3
Prashant Singh [Tue, 28 Jun 2022 04:59:16 +0000 (10:29 +0530)] 
move spark/v3.2 to spark/v3.3

3 months agoCore: Update CreateTableRequest Javadoc (#5144)
Kyle Bendickson [Tue, 28 Jun 2022 15:28:47 +0000 (08:28 -0700)] 
Core: Update CreateTableRequest Javadoc (#5144)

3 months agoCore: Fix CreateTableRequest to use field names from the REST spec (#5135)
Kyle Bendickson [Tue, 28 Jun 2022 15:27:10 +0000 (08:27 -0700)] 
Core: Fix CreateTableRequest to use field names from the REST spec (#5135)

3 months agoDocs: Add reference to Apache Impala documentation (#5146)
Samuel Redai [Tue, 28 Jun 2022 14:42:29 +0000 (10:42 -0400)] 
Docs: Add reference to Apache Impala documentation (#5146)

3 months agoAPI: Support composite types in Accessors (#5067)
Dmitri Bourlatchkov [Tue, 28 Jun 2022 14:39:39 +0000 (10:39 -0400)] 
API: Support composite types in Accessors (#5067)

3 months agoCore: Add source snapshot info to Puffin Blob metadata (#5129)
Piotr Findeisen [Tue, 28 Jun 2022 14:37:00 +0000 (16:37 +0200)] 
Core: Add source snapshot info to Puffin Blob metadata (#5129)

3 months agoAPI: Refactor ScanTask hierarchy (#5077)
Anton Okolnychyi [Tue, 28 Jun 2022 03:57:42 +0000 (20:57 -0700)] 
API: Refactor ScanTask hierarchy (#5077)

3 months agoMR: Clone ANYWHERE location array IcebergSplit (#4984)
Piotr Findeisen [Tue, 28 Jun 2022 02:22:50 +0000 (04:22 +0200)] 
MR: Clone ANYWHERE location array IcebergSplit (#4984)

`IcebergSplit.ANYWHERE` was a mutable and publicly accessible field, so
someone could modify it. The modification could also be accidental, if
someone modified the array returned from `IcebergSplit.locations()`.

3 months agoRevert "Spark: Use original option keys in SparkCatalog (#4903)"
Ryan Blue [Tue, 28 Jun 2022 02:18:02 +0000 (19:18 -0700)] 
Revert "Spark: Use original option keys in SparkCatalog (#4903)"

This reverts commit b06a89cebd5099b40b188c4c40ea7b1a23d3427a.

3 months agoSpark: Add __metadata_col for metadata columns when converting types (#5075)
Prashant Singh [Tue, 28 Jun 2022 02:07:47 +0000 (07:37 +0530)] 
Spark: Add __metadata_col for metadata columns when converting types (#5075)

Co-authored-by: Prashant Singh <psinghvk@amazon.com>
3 months agoSpark: Validate HMS uri in SparkSessionCatalog (#5134)
Yufei Gu [Tue, 28 Jun 2022 01:51:33 +0000 (18:51 -0700)] 
Spark: Validate HMS uri in SparkSessionCatalog (#5134)

3 months agoBuild: Print used JDK version (#5138)
Eduard Tudenhöfner [Tue, 28 Jun 2022 01:50:28 +0000 (03:50 +0200)] 
Build: Print used JDK version (#5138)

3 months agoCore: Fix tag ancestor snapshot handling (#5034)
Ryan Blue [Tue, 28 Jun 2022 00:10:29 +0000 (17:10 -0700)] 
Core: Fix tag ancestor snapshot handling (#5034)

* Core: Fix tag parent snapshot handling.

* Fix import order.

3 months agoCore: Fix partition clustering to produce table sort order (#5131)
Ryan Blue [Mon, 27 Jun 2022 23:43:54 +0000 (16:43 -0700)] 
Core: Fix partition clustering to produce table sort order (#5131)

3 months agoPython: Use Pydantic for serialization and deserialization (#5011)
Fokko Driesprong [Mon, 27 Jun 2022 23:42:50 +0000 (01:42 +0200)] 
Python: Use Pydantic for serialization and deserialization (#5011)

3 months agoDocs: A few small fixes to docs markdown files (#5127)
Samuel Redai [Mon, 27 Jun 2022 22:57:24 +0000 (18:57 -0400)] 
Docs: A few small fixes to docs markdown files (#5127)

3 months agoPython: Update dependencies (#5142)
Fokko Driesprong [Mon, 27 Jun 2022 21:53:35 +0000 (23:53 +0200)] 
Python: Update dependencies (#5142)

3 months agoCore: Fix REST field name case strategy (#5133)
Ryan Blue [Mon, 27 Jun 2022 21:09:58 +0000 (14:09 -0700)] 
Core: Fix REST field name case strategy (#5133)

3 months agoArrow: Avoid extra dictionary buffer copy (#5137)
Bryan Keller [Mon, 27 Jun 2022 19:12:49 +0000 (12:12 -0700)] 
Arrow: Avoid extra dictionary buffer copy (#5137)

3 months agoCheckstyle: Add rule for %d in Preconditions.checkArgument (#5057)
xrl1 [Mon, 27 Jun 2022 19:12:19 +0000 (22:12 +0300)] 
Checkstyle: Add rule for %d in Preconditions.checkArgument (#5057)

3 months agoParquet: Release the compressor when closing ParquetWriter (#5126)
Harshit Mittal [Mon, 27 Jun 2022 19:07:21 +0000 (12:07 -0700)] 
Parquet: Release the compressor when closing ParquetWriter (#5126)

3 months agoSpark: Add compute stats to scan builder also (#5136)
Bryan Keller [Mon, 27 Jun 2022 15:55:37 +0000 (08:55 -0700)] 
Spark: Add compute stats to scan builder also (#5136)

3 months agoFlink: FLIP-27 Iceberg source and builder (#5109)
Steven Zhen Wu [Fri, 24 Jun 2022 23:43:16 +0000 (16:43 -0700)] 
Flink: FLIP-27 Iceberg source and builder (#5109)

3 months agoDocs: Use more specific hidden partitioning anchor link (#5128)
LuNing (Lucas) Wang [Fri, 24 Jun 2022 23:21:45 +0000 (07:21 +0800)] 
Docs: Use more specific hidden partitioning anchor link (#5128)

3 months agoPython: Add flake8-comprehensions (#5130)
Fokko Driesprong [Fri, 24 Jun 2022 23:20:11 +0000 (01:20 +0200)] 
Python: Add flake8-comprehensions (#5130)

It’s slower to call e.g. `dict()` than using the empty literal `{}`,
because the name dict must be looked up in the global scope in
case it has been rebound.

3 months agoORC: Upgrade to 1.7.5 (#5070)
William Hyun [Fri, 24 Jun 2022 16:06:21 +0000 (09:06 -0700)] 
ORC: Upgrade to 1.7.5 (#5070)

3 months agoFlink: Add option to limit the number of snapshots in a planning operation (#4943)
Chen, Junjie [Fri, 24 Jun 2022 16:03:08 +0000 (00:03 +0800)] 
Flink: Add option to limit the number of snapshots in a planning operation (#4943)

3 months agoDocs: Change docs layout for new iceberg-theme (#5115)
Samuel Redai [Thu, 23 Jun 2022 20:49:24 +0000 (16:49 -0400)] 
Docs: Change docs layout for new iceberg-theme (#5115)

3 months agoSpark 3.2: RewriteDataFiles - Escape special characters in table identifiers (#5112)
Bijan Houle [Thu, 23 Jun 2022 20:43:27 +0000 (14:43 -0600)] 
Spark 3.2: RewriteDataFiles - Escape special characters in table identifiers (#5112)

* Spark 3.2: Escape table identifier in RewriteDataFiles Procedure/Action

Allows e.g. `db.special-chars`.`table.special-chars`

* mark original method as deprecated

* @deprecated tag in javadoc as well

* keep existing interface

3 months agoCore: Reuse REST client for catalog and table operations (#5125)
Daniel Weeks [Thu, 23 Jun 2022 19:16:46 +0000 (12:16 -0700)] 
Core: Reuse REST client for catalog and table operations (#5125)

3 months agoPython: Add flake8 bugbear (#5117)
Fokko Driesprong [Thu, 23 Jun 2022 15:58:02 +0000 (17:58 +0200)] 
Python: Add flake8 bugbear (#5117)

3 months agoSpec: Typo an to a (#5123)
Fokko Driesprong [Thu, 23 Jun 2022 15:52:32 +0000 (17:52 +0200)] 
Spec: Typo an to a (#5123)

3 months agoNessie: Fix drop/rename table with TableReference in identifier (#5033)
Ajantha Bhat [Thu, 23 Jun 2022 12:08:43 +0000 (17:38 +0530)] 
Nessie: Fix drop/rename table with TableReference in identifier (#5033)

3 months agoParquet: Fix VectorizedParquetDefinitionLevelReader with direct ByteBuffer (#5079)
Huaxin Gao [Thu, 23 Jun 2022 01:56:48 +0000 (18:56 -0700)] 
Parquet: Fix VectorizedParquetDefinitionLevelReader with direct ByteBuffer (#5079)

3 months agoCore: Remove Usage of Sets.Union in Loop (#5114)
Russell Spitzer [Wed, 22 Jun 2022 21:44:06 +0000 (16:44 -0500)] 
Core: Remove Usage of Sets.Union in Loop (#5114)

Previously the repeated calls to union could create a very large stack depth since each call ends up creating a set view. This can lead to StackOverflow issues with very large compaction jobs.

3 months agoCore: Support FileIO prefix operations (#5096)
Daniel Weeks [Wed, 22 Jun 2022 20:40:33 +0000 (13:40 -0700)] 
Core: Support FileIO prefix operations (#5096)

3 months agoCore: Metadata table queries fail if a partition column was reused in V2 (#4662)
Adam Szita [Wed, 22 Jun 2022 07:37:12 +0000 (09:37 +0200)] 
Core: Metadata table queries fail if a partition column was reused in V2 (#4662)

3 months agoHive: Print db and table name while acquiring hive meta-store lock (#5039)
krisdas [Wed, 22 Jun 2022 04:34:46 +0000 (21:34 -0700)] 
Hive: Print db and table name while acquiring hive meta-store lock (#5039)

3 months agoCore: Check for valid identifiers in REST catalog (#5107)
Bryan Keller [Tue, 21 Jun 2022 22:51:38 +0000 (15:51 -0700)] 
Core: Check for valid identifiers in REST catalog (#5107)

* Shutdown refresh token thread during REST catalog client close

* Improved shutdown of token refresh executor during REST catalog close

* REST: Set table format version for create table transactions

* add test for creating v2 table via transaction

* Core: Check for valid identifiers in REST catalog

3 months agoPython: Renable pylint (#5066)
Fokko Driesprong [Tue, 21 Jun 2022 17:55:07 +0000 (19:55 +0200)] 
Python: Renable pylint (#5066)

* Python: Renable pylint

For some reason pylint fell through the cracks when migrating from tox
to pre-commit

* Be more explicit in disabled checks

3 months agoCore: Send format version for create table in REST catalog (#5084)
Bryan Keller [Tue, 21 Jun 2022 15:27:48 +0000 (08:27 -0700)] 
Core: Send format version for create table in REST catalog (#5084)

3 months agoPython: Replace vars with cached_property decorator (#5068)
Fokko Driesprong [Tue, 21 Jun 2022 15:18:40 +0000 (17:18 +0200)] 
Python: Replace vars with cached_property decorator (#5068)

3 months agoAWS: add skip name validation to isValidIdentifier (#5081)
Xingfan Xia [Mon, 20 Jun 2022 23:47:57 +0000 (16:47 -0700)] 
AWS: add skip name validation to isValidIdentifier (#5081)

3 months agoPython: Bump pre-commit versions (#5074)
Fokko Driesprong [Mon, 20 Jun 2022 22:39:26 +0000 (00:39 +0200)] 
Python: Bump pre-commit versions (#5074)

```
➜  python git:(fd-bump-pre-commit) pre-commit autoupdate
Updating https://github.com/pre-commit/pre-commit-hooks ... updating v4.2.0 -> v4.3.0.
Updating https://github.com/ambv/black ... already up to date.
Updating https://github.com/pre-commit/mirrors-isort ... already up to date.
Updating https://github.com/pre-commit/mirrors-mypy ... updating v0.960 -> v0.961.
Updating https://github.com/hadialqattan/pycln ... already up to date.
Updating https://github.com/asottile/pyupgrade ... updating v2.32.1 -> v2.34.0.
➜  python git:(fd-bump-pre-commit) ✗ pre-commit run --all-files
trim trailing whitespace.................................................Passed
fix end of files.........................................................Passed
check docstring is first.................................................Passed
debug statements (python)................................................Passed
check yaml...............................................................Passed
check python ast.........................................................Passed
black....................................................................Passed
isort....................................................................Passed
mypy.....................................................................Passed
pycln....................................................................Passed
pyupgrade................................................................Passed
```

3 months agoCore: Add serialization tests for CreateTableRequest (#5052)
Kyle Bendickson [Mon, 20 Jun 2022 19:22:51 +0000 (12:22 -0700)] 
Core: Add serialization tests for CreateTableRequest (#5052)

Co-authored-by: Prashant Singh <35593236+singhpk234@users.noreply.github.com>
3 months agoCore: Add Javadoc for LoadTableResponse, fix error prone warnings (#5053)
Kyle Bendickson [Mon, 20 Jun 2022 18:54:45 +0000 (11:54 -0700)] 
Core: Add Javadoc for LoadTableResponse, fix error prone warnings (#5053)

3 months agoFlink: Port #4986, FLIP-27 source enumerator to 1.14 module (#5078)
Steven Zhen Wu [Mon, 20 Jun 2022 15:55:51 +0000 (08:55 -0700)] 
Flink: Port #4986, FLIP-27 source enumerator to 1.14 module (#5078)

3 months agoPython: Add Avro read path (#4920)
Fokko Driesprong [Mon, 20 Jun 2022 15:47:41 +0000 (17:47 +0200)] 
Python: Add Avro read path (#4920)

3 months agoFix type of fields list in Puffin (#5087)
Piotr Findeisen [Mon, 20 Jun 2022 15:44:28 +0000 (17:44 +0200)] 
Fix type of fields list in Puffin (#5087)

3 months agoInclude actual class name in class mismatch exception (#5089)
Piotr Findeisen [Mon, 20 Jun 2022 15:39:07 +0000 (17:39 +0200)] 
Include actual class name in class mismatch exception (#5089)

* Remove redundant call to String.valueOf in format argument

* Remove redundant warning suppression

The unchecked code was removed in
9384bd6f91996986ff680c0bf5de17179ebd0a1f.

* Include actual class name in class mismatch exception

Include requested and actual class name in the exception message thrown
when `PartitionData` detects type mismatch.

3 months agoPython: Add py.typed file for annotations (#5091)
Fokko Driesprong [Mon, 20 Jun 2022 15:35:32 +0000 (17:35 +0200)] 
Python: Add py.typed file for annotations (#5091)

https://blog.whtsky.me/tech/2021/dont-forget-py.typed-for-your-typed-python-package/

3 months agoOpen-api: RenameTableRequest props are required (#5093)
Fokko Driesprong [Mon, 20 Jun 2022 15:33:05 +0000 (17:33 +0200)] 
Open-api: RenameTableRequest props are required (#5093)

Currently, the properties are optional, which doesn't really make sense.

Also, in the Java code it throws an exception:
https://github.com/apache/iceberg/blob/master/core/src/test/java/org/apache/iceberg/rest/requests/TestRenameTableRequest.java#L106-L121

Therefore I would suggest making those required in the spec as well

3 months agoPuffin: Inline PuffinWriter.writeFully (#5088)
Piotr Findeisen [Mon, 20 Jun 2022 14:59:36 +0000 (16:59 +0200)] 
Puffin: Inline PuffinWriter.writeFully (#5088)

3 months agoFlink: FLIP-27 source enumerator (#4986)
Steven Zhen Wu [Fri, 17 Jun 2022 16:34:47 +0000 (09:34 -0700)] 
Flink: FLIP-27 source enumerator (#4986)

3 months agoPython: Add Flake8 for simple checks (#5073)
Fokko Driesprong [Fri, 17 Jun 2022 15:33:56 +0000 (17:33 +0200)] 
Python: Add Flake8 for simple checks (#5073)

3 months agoCore: In HadoopTableOperations, replace Util.getFs call with getFileSystem (#5062)
chakradhar2 [Thu, 16 Jun 2022 12:13:35 +0000 (17:43 +0530)] 
Core: In HadoopTableOperations, replace Util.getFs call with getFileSystem (#5062)

3 months agoPython: Don't use a metaclass for the Singleton (#5055)
Fokko Driesprong [Wed, 15 Jun 2022 21:07:43 +0000 (23:07 +0200)] 
Python: Don't use a metaclass for the Singleton (#5055)

Metaclasses in Python don't mix very well, and when they cause
conflicts then it breaks at initialization.
Example of metaclasses is the ABC, but also the Pydantic BaseModel.
I tried to circumvent this by extending the Singleton from ABC
but it is likely that we use different metaclasses in the future,
and then it will bring us sadness and misery.

3 months agoAWS: add skip name validation config for glue namespace and table (#5041)
Xingfan Xia [Wed, 15 Jun 2022 20:41:08 +0000 (13:41 -0700)] 
AWS: add skip name validation config for glue namespace and table (#5041)

3 months agoCore: Add reader and writer for Puffin index and stats format (#4537)
Piotr Findeisen [Wed, 15 Jun 2022 18:01:12 +0000 (20:01 +0200)] 
Core: Add reader and writer for Puffin index and stats format (#4537)

3 months agoNessie: Properly close all resources in NessieCatalog (#5047)
Eduard Tudenhöfner [Wed, 15 Jun 2022 17:59:14 +0000 (19:59 +0200)] 
Nessie: Properly close all resources in NessieCatalog (#5047)

3 months agoCore: Update ExpireSnapshots impl for branching and tagging (#4578)
Amogh Jahagirdar [Tue, 14 Jun 2022 14:42:12 +0000 (07:42 -0700)] 
Core: Update ExpireSnapshots impl for branching and tagging (#4578)

3 months agoBuild: Avoid running engine tests on LICENSE and NOTICE update (#5022)
Prashant Singh [Tue, 14 Jun 2022 03:23:08 +0000 (08:53 +0530)] 
Build: Avoid running engine tests on LICENSE and NOTICE update (#5022)

Co-authored-by: Prashant Singh <psinghvk@amazon.com>
3 months agoCore: Enforce close for in-memory files (#5019)
Piotr Findeisen [Tue, 14 Jun 2022 03:22:36 +0000 (05:22 +0200)] 
Core: Enforce close for in-memory files (#5019)

The in-memory `InputFile` and `OutputFile` implementations has an
undesirable property that returned streams allowed use after close.
Since most streams don't have such property, it should be disallowed
here too.

3 months agoPython: Add identity transform (#4908)
jun-he [Mon, 13 Jun 2022 20:15:29 +0000 (13:15 -0700)] 
Python: Add identity transform (#4908)

3 months agoDocs: Fix copy paste: s/parquet/avro/ (#5020)
Fokko Driesprong [Mon, 13 Jun 2022 19:12:17 +0000 (21:12 +0200)] 
Docs: Fix copy paste: s/parquet/avro/ (#5020)

I think we forgot to update the home page from the Parquet block.

3 months agoParquet: Support row group bloom filters (#4938)
Huaxin Gao [Mon, 13 Jun 2022 02:12:14 +0000 (19:12 -0700)] 
Parquet: Support row group bloom filters (#4938)

Co-authored-by: Xi Chen <jshmchenxi@163.com>
Co-authored-by: Hao Lin <linhao1990@gmail.com>
3 months agoCore: Improve refresh executor shutdown in REST catalog close (#4991)
Bryan Keller [Sun, 12 Jun 2022 23:28:25 +0000 (16:28 -0700)] 
Core: Improve refresh executor shutdown in REST catalog close (#4991)

3 months agoParquet: Fix NPE in logical type handling (#4999)
Xianyang Liu [Sun, 12 Jun 2022 23:25:24 +0000 (07:25 +0800)] 
Parquet: Fix NPE in logical type handling (#4999)

Co-authored-by: xianyangliu <xianyangliu@tencent.com>
3 months agoDocs: Restore Iceberg logo in README (#5016)
Guillaume Massé [Sun, 12 Jun 2022 23:21:11 +0000 (19:21 -0400)] 
Docs: Restore Iceberg logo in README (#5016)

3 months agoCore: Rename JDBC namespace property column to non-keyword (#5017)
Sung Yun [Sun, 12 Jun 2022 22:55:39 +0000 (18:55 -0400)] 
Core: Rename JDBC namespace property column to non-keyword (#5017)

3 months agoPython: Add PartitionSpec (#4717)
Hongyue/Steve Zhang [Sun, 12 Jun 2022 20:55:57 +0000 (13:55 -0700)] 
Python: Add PartitionSpec (#4717)

Co-authored-by: Fokko Driesprong <fokko@apache.org>
Co-authored-by: Steve Zhang <hongyue_zhang@apple.com>
3 months agoPython: Extend the use of the Singleton (#5008)
Fokko Driesprong [Sun, 12 Jun 2022 19:58:40 +0000 (21:58 +0200)] 
Python: Extend the use of the Singleton (#5008)

3 months agoSpark: Fix flaky testOlderThanTimestamp in TestRemoveOrphanFilesAction3 (#4825)
Sumeet Gajjar [Sun, 12 Jun 2022 19:49:41 +0000 (12:49 -0700)] 
Spark: Fix flaky testOlderThanTimestamp in TestRemoveOrphanFilesAction3 (#4825)

3 months agoCore: Resolve environment variables in REST catalog config (#5018)
Ryan Blue [Sun, 12 Jun 2022 15:43:40 +0000 (08:43 -0700)] 
Core: Resolve environment variables in REST catalog config (#5018)

3 months agoFlink: Reduce the scope and duration of holding checkpoint lock in the read path...
Steven Zhen Wu [Fri, 10 Jun 2022 23:44:02 +0000 (16:44 -0700)] 
Flink: Reduce the scope and duration of holding checkpoint lock in the read path (#4911)

3 months agoPython: Change Python API naming to the spec (#4992)
Fokko Driesprong [Thu, 9 Jun 2022 16:02:21 +0000 (18:02 +0200)] 
Python: Change Python API naming to the spec (#4992)

See https://github.com/apache/iceberg/issues/4985

3 months agoPython: Add Poetry IDEA instructions (#4980)
Fokko Driesprong [Thu, 9 Jun 2022 15:52:57 +0000 (17:52 +0200)] 
Python: Add Poetry IDEA instructions (#4980)

3 months agoBuild: Fix API compatibility Github Action (#4989)
Kyle Bendickson [Wed, 8 Jun 2022 23:49:14 +0000 (16:49 -0700)] 
Build: Fix API compatibility Github Action (#4989)

3 months agoCore: Replace unnecessary hash uses with hashCode (#4953)
Amogh Jahagirdar [Wed, 8 Jun 2022 20:04:57 +0000 (13:04 -0700)] 
Core: Replace unnecessary hash uses with hashCode (#4953)