beam.git
78 sec agoMerge pull request #7241: [BEAM-6204] Clean up duplicated SocketAddressFactory class. master
Scott Wegner [Wed, 12 Dec 2018 16:34:20 +0000 (08:34 -0800)] 
Merge pull request #7241: [BEAM-6204] Clean up duplicated SocketAddressFactory class.

25 min agoMerge pull request #7261 from echauchot/BEAM-6216-flink-local
Etienne Chauchot [Wed, 12 Dec 2018 16:10:06 +0000 (17:10 +0100)] 
Merge pull request #7261 from echauchot/BEAM-6216-flink-local

Merge pull request #7261: [BEAM-6216] Update flinkMaster URL to reflect change in FlinkExecutionEnvironments

42 min ago[BEAM-6216] Update flinkMaster URL in nexmark postCommit script to reflect change... 7261/head
Etienne Chauchot [Wed, 12 Dec 2018 14:09:17 +0000 (15:09 +0100)] 
[BEAM-6216] Update flinkMaster URL in nexmark postCommit script to reflect change in FlinkExecutionEnvironments.

48 min agoMerge pull request #7260 Fix combiner lifting for external job service.
Robert Bradshaw [Wed, 12 Dec 2018 15:47:20 +0000 (16:47 +0100)] 
Merge pull request #7260 Fix combiner lifting for external job service.

Fix combiner lifting for external job service.

2 hours ago[BEAM-6216] Update flinkMaster URL in the nexmark wep-page to reflect change in Flink...
Etienne Chauchot [Wed, 12 Dec 2018 14:08:16 +0000 (15:08 +0100)] 
[BEAM-6216] Update flinkMaster URL in the nexmark wep-page to reflect change in FlinkExecutionEnvironments.

2 hours agoMerge pull request #7258: [BEAM-6213] Fix matching of glob patterns in windows local...
Alexey Romanenko [Wed, 12 Dec 2018 14:30:32 +0000 (15:30 +0100)] 
Merge pull request #7258: [BEAM-6213] Fix matching of glob patterns in windows local filesystem

3 hours agoFix combiner lifting for external job service. 7260/head
Robert Bradshaw [Wed, 12 Dec 2018 13:08:08 +0000 (14:08 +0100)] 
Fix combiner lifting for external job service.

4 hours agoMerge pull request #7078 from [BEAM-6094] External portable BeamPython.
Robert Bradshaw [Wed, 12 Dec 2018 12:02:10 +0000 (13:02 +0100)] 
Merge pull request #7078 from [BEAM-6094] External portable BeamPython.

[BEAM-6094] Implement external environment for portable BeamPython.

5 hours ago[BEAM-6213] Fix matching of glob patterns in windows local filesystem 7258/head
Ismaël Mejía [Wed, 12 Dec 2018 11:21:01 +0000 (12:21 +0100)] 
[BEAM-6213] Fix matching of glob patterns in windows local filesystem

5 hours ago[BEAM-6094] Implement external environment for Portable Beam. 7078/head
Robert Bradshaw [Tue, 20 Nov 2018 09:52:39 +0000 (10:52 +0100)] 
[BEAM-6094] Implement external environment for Portable Beam.

5 hours agoUse environment to control worker startup in FnApiRunner.
Robert Bradshaw [Tue, 20 Nov 2018 09:31:44 +0000 (10:31 +0100)] 
Use environment to control worker startup in FnApiRunner.

11 hours agoMerge pull request #7254: [BEAM-2943] Fix typo in filename on FlinkRunner page
Thomas Weise [Wed, 12 Dec 2018 04:58:42 +0000 (20:58 -0800)] 
Merge pull request #7254: [BEAM-2943] Fix typo in filename on FlinkRunner page

14 hours agoMerge pull request #7246: [BEAM-5058] remove unused envdir parameter
Thomas Weise [Wed, 12 Dec 2018 01:49:13 +0000 (17:49 -0800)] 
Merge pull request #7246: [BEAM-5058] remove unused envdir parameter

17 hours agoMerge pull request #7032: [BEAM-6033] normalize httplib2.Http initialization and...
Chamikara Jayalath [Tue, 11 Dec 2018 22:44:05 +0000 (14:44 -0800)] 
Merge pull request #7032: [BEAM-6033] normalize httplib2.Http initialization and usage

19 hours agoMerge pull request #7250 from [BEAM-6181] Unexpected metrics non-fatal.
Robert Bradshaw [Tue, 11 Dec 2018 20:58:53 +0000 (21:58 +0100)] 
Merge pull request #7250 from [BEAM-6181] Unexpected metrics non-fatal.

[BEAM-6181] Unexpected metrics should be non-fatal.

21 hours ago[BEAM-6178] Adding beam-sdks-java-bom, adding exportJavadoc flag for applyJavaNature...
Garrett Jones [Tue, 11 Dec 2018 19:00:50 +0000 (11:00 -0800)] 
[BEAM-6178] Adding beam-sdks-java-bom, adding exportJavadoc flag for applyJavaNature (#7197)

22 hours ago[BEAM-2943] Fix typo in filename on FlinkRunner page 7254/head
Maximilian Michels [Tue, 11 Dec 2018 18:02:55 +0000 (19:02 +0100)] 
[BEAM-2943] Fix typo in filename on FlinkRunner page

26 hours agoMerge pull request #7228 from [BEAM-4678] Combiner lifting in portable Flink.
Robert Bradshaw [Tue, 11 Dec 2018 14:28:27 +0000 (15:28 +0100)] 
Merge pull request #7228 from [BEAM-4678] Combiner lifting in portable Flink.

[BEAM-4678] Support combiner lifting in portable Flink runner.

27 hours ago[BEAM-6181] Unexpected metrics should be non-fatal. 7250/head
Robert Bradshaw [Tue, 11 Dec 2018 13:21:28 +0000 (14:21 +0100)] 
[BEAM-6181] Unexpected metrics should be non-fatal.

28 hours agoMerge pull request #7249: Fix various lint errors in Python presubmit.
Maximilian Michels [Tue, 11 Dec 2018 12:34:44 +0000 (13:34 +0100)] 
Merge pull request #7249: Fix various lint errors in Python presubmit.

28 hours agoQuiet c-extension-no-member lint warning. 7249/head
Robert Bradshaw [Tue, 11 Dec 2018 10:16:20 +0000 (11:16 +0100)] 
Quiet c-extension-no-member lint warning.

28 hours agoMerge pull request #7207: [BEAM-6172] Adjust Flink metric names / Add metric reportin...
Maximilian Michels [Tue, 11 Dec 2018 11:37:32 +0000 (12:37 +0100)] 
Merge pull request #7207: [BEAM-6172] Adjust Flink metric names / Add metric reporting tests

28 hours agoMerge pull request #7196: [BEAM-6176] Support IPv6 addresses for Flink master url
Maximilian Michels [Tue, 11 Dec 2018 11:36:21 +0000 (12:36 +0100)] 
Merge pull request #7196: [BEAM-6176] Support IPv6 addresses for Flink master url

30 hours agoMerge pull request #7238: [BEAM-6201] Data insertion pipeline
Łukasz Gajowy [Tue, 11 Dec 2018 10:09:09 +0000 (11:09 +0100)] 
Merge pull request #7238: [BEAM-6201] Data insertion pipeline

30 hours agoRemove trailing whitespace.
Robert Bradshaw [Tue, 11 Dec 2018 09:59:12 +0000 (10:59 +0100)] 
Remove trailing whitespace.

31 hours ago[BEAM-4678] Support combiner lifting in portable Flink runner. 7228/head
Robert Bradshaw [Fri, 7 Dec 2018 12:16:12 +0000 (13:16 +0100)] 
[BEAM-4678] Support combiner lifting in portable Flink runner.

37 hours agoMerge pull request #7189: [BEAM-5514] BigQueryIO doesn't handle quotaExceeded errors...
Chamikara Jayalath [Tue, 11 Dec 2018 03:18:11 +0000 (19:18 -0800)] 
Merge pull request #7189: [BEAM-5514] BigQueryIO doesn't handle quotaExceeded errors properly

41 hours agoMerge pull request #7179: [BEAM-3657] Port JoinExamplesTest off DoFnTester
Kenn Knowles [Mon, 10 Dec 2018 22:52:52 +0000 (15:52 -0700)] 
Merge pull request #7179: [BEAM-3657] Port JoinExamplesTest off DoFnTester

42 hours ago[BEAM-5514] BigQueryIO doesn't handle quotaExceeded errors properly 7189/head
Heejong Lee [Wed, 5 Dec 2018 19:16:54 +0000 (11:16 -0800)] 
[BEAM-5514] BigQueryIO doesn't handle quotaExceeded errors properly

update to use backoff for all IOExceptions in BigQuery insertAll

42 hours ago[BEAM-6240] Clean up duplicated SocketAddressFactory class. 7241/head
Boyuan Zhang [Mon, 10 Dec 2018 22:23:53 +0000 (14:23 -0800)] 
[BEAM-6240] Clean up duplicated SocketAddressFactory class.

2 days ago[BEAM-5058] remove unused envdir parameter 7246/head
Thomas Weise [Mon, 10 Dec 2018 16:33:20 +0000 (08:33 -0800)] 
[BEAM-5058] remove unused envdir parameter

2 days agoMerge pull request #7064: [BEAM-6079] Add ability for CassandraIO to delete data
Ismaël Mejía [Mon, 10 Dec 2018 16:30:15 +0000 (17:30 +0100)] 
Merge pull request #7064: [BEAM-6079] Add ability for CassandraIO to delete data

2 days ago[BEAM-6079] Fix access level and clean up generics issues
Ismaël Mejía [Mon, 10 Dec 2018 16:24:21 +0000 (17:24 +0100)] 
[BEAM-6079] Fix access level and clean up generics issues

2 days ago[BEAM-6079] Add ability for CassandraIO to delete data
Fabien Rousseau [Fri, 16 Nov 2018 13:28:26 +0000 (14:28 +0100)] 
[BEAM-6079] Add ability for CassandraIO to delete data

2 days ago[BEAM-6201] Add SyntheticDataPubSubPublisher pipeline 7238/head
Łukasz Gajowy [Mon, 10 Dec 2018 15:01:13 +0000 (16:01 +0100)] 
[BEAM-6201] Add SyntheticDataPubSubPublisher pipeline

2 days ago[BEAM-6201] Move fromJsonString() method to SyntheticOptions class
Łukasz Gajowy [Mon, 10 Dec 2018 14:59:18 +0000 (15:59 +0100)] 
[BEAM-6201] Move fromJsonString() method to SyntheticOptions class

2 days ago[BEAM-6176] Support IPv6 addresses for Flink master url 7196/head
Maximilian Michels [Tue, 4 Dec 2018 11:01:52 +0000 (12:01 +0100)] 
[BEAM-6176] Support IPv6 addresses for Flink master url

The previous port parsing logic assumed colons to indicate a port number. That
assumption clearly can't be made for IPv6 addresses.

2 days ago[BEAM-6172] Adjust Flink metric names / Add metric reporting tests 7207/head
Maximilian Michels [Wed, 5 Dec 2018 12:39:36 +0000 (13:39 +0100)] 
[BEAM-6172] Adjust Flink metric names / Add metric reporting tests

This picks up the metrics delimiter from the Flink config and removes the metric
type prefix. This improves consistency with Flink's defaults and makes metric
names more readable.

2 days agoMerge pull request #6719 Upgrade to Apache Tika 1.19.1
Robert Bradshaw [Mon, 10 Dec 2018 13:47:06 +0000 (14:47 +0100)] 
Merge pull request #6719 Upgrade to Apache Tika 1.19.1

2 days ago[BEAM-4444] Parquet IO for Python SDK (#6763)
Heejong Lee [Mon, 10 Dec 2018 13:46:20 +0000 (05:46 -0800)] 
[BEAM-4444] Parquet IO for Python SDK (#6763)

* [BEAM-4444] Parquet IO for Python SDK

  * add new dependency `pyarrow`
  * provide read, write ptransforms for parquet files on any file systems
  supported by Beam
  * source splitting is supported at row group granularity
  * partial read is supported by column selection
  * row group size is configurable for write ptransform
  * compression codec is configurable for write ptransform

2 days agoMerge pull request #6862 from [BEAM-5866] structuralValue in List/MapCoder
Robert Bradshaw [Mon, 10 Dec 2018 13:40:47 +0000 (14:40 +0100)] 
Merge pull request #6862 from [BEAM-5866] structuralValue in List/MapCoder

[BEAM-5866] Override structuralValue in ListCoder and MapCoder

2 days agoMerge pull request #6872 Clarify snippet for PipelineOptions subclass
Robert Bradshaw [Mon, 10 Dec 2018 13:35:52 +0000 (14:35 +0100)] 
Merge pull request #6872 Clarify snippet for PipelineOptions subclass

Clarify snippet for PipelineOptions subclass

2 days agoMerge pull request #6887 from coheigea/string_literals
Robert Bradshaw [Mon, 10 Dec 2018 13:35:14 +0000 (14:35 +0100)] 
Merge pull request #6887 from coheigea/string_literals

Move string literals to the left hand side of the expression in a few places.

2 days agoMerge pull request #7095 from HuangLED/update_postcommit_doc
Robert Bradshaw [Mon, 10 Dec 2018 13:14:31 +0000 (14:14 +0100)] 
Merge pull request #7095 from HuangLED/update_postcommit_doc

Update instructions to post-commit policy web page.

2 days agoMerge pull request #7127 from [BEAM-6120] Large gbk iterables
Robert Bradshaw [Mon, 10 Dec 2018 11:32:07 +0000 (12:32 +0100)] 
Merge pull request #7127 from [BEAM-6120] Large gbk iterables

[BEAM-6120] Support retrieval of large gbk iterables over the state API.

2 days ago[BEAM-6120] Support retrieval of large gbk iterables over the state API. 7127/head
Robert Bradshaw [Fri, 23 Nov 2018 16:05:07 +0000 (17:05 +0100)] 
[BEAM-6120] Support retrieval of large gbk iterables over the state API.

2 days ago[BEAM-6186] Move combiner lifting out of line.
Robert Bradshaw [Thu, 6 Dec 2018 14:46:13 +0000 (15:46 +0100)] 
[BEAM-6186] Move combiner lifting out of line.

2 days agoMerge pull request #7227 from [BEAM-6186] Optimization cleanup
Robert Bradshaw [Mon, 10 Dec 2018 08:21:52 +0000 (09:21 +0100)] 
Merge pull request #7227 from [BEAM-6186] Optimization cleanup

[BEAM-6186] Optimization cleanup: move phase utilities out of local scope.

2 days ago[BEAM-6167] Add class ReadFromTextWithFilename (Python) (#7193)
lcaggio [Mon, 10 Dec 2018 08:15:29 +0000 (09:15 +0100)] 
[BEAM-6167] Add class ReadFromTextWithFilename (Python) (#7193)

4 days ago[BEAM-6195] Make ProcessRemoteBundleOperation map PCollectionId into correct OutputRe...
Boyuan Zhang [Sat, 8 Dec 2018 00:14:31 +0000 (16:14 -0800)] 
[BEAM-6195] Make ProcessRemoteBundleOperation map PCollectionId into correct OutputReceiver and throws Exception when there is more than one input PCollection. (#7223)

4 days agoMerge pull request #7225 from udim/patch-2
Pablo [Fri, 7 Dec 2018 22:47:38 +0000 (14:47 -0800)] 
Merge pull request #7225 from udim/patch-2

[BEAM-6196] Redirect from nexmark page's older location

4 days ago[BEAM-6139] Adding support for BQ GEOGRAPHY data type (#7144)
Pablo [Fri, 7 Dec 2018 21:03:27 +0000 (13:03 -0800)] 
[BEAM-6139] Adding support for BQ GEOGRAPHY data type (#7144)

* Adding support for BQ GEOGRAPHY data type for Python Direct Runner

* Improving GEOGRAPHY documentation

* Improving GEOGRAPHY documentation

4 days agoMerge pull request #7230 Fix precommits due to concurrent submissions.
Robert Bradshaw [Fri, 7 Dec 2018 19:50:15 +0000 (20:50 +0100)] 
Merge pull request #7230 Fix precommits due to concurrent submissions.

Fix precommits due to concurrent submissions.

4 days agoFix precommits due to concurrent submissions. 7230/head
Robert Bradshaw [Fri, 7 Dec 2018 19:48:21 +0000 (20:48 +0100)] 
Fix precommits due to concurrent submissions.

4 days ago[BEAM-6186] Optimization cleanup: move phase utilities out of local scope. 7227/head
Robert Bradshaw [Thu, 6 Dec 2018 14:37:19 +0000 (15:37 +0100)] 
[BEAM-6186] Optimization cleanup: move phase utilities out of local scope.

4 days ago[BEAM-6194] Follow up with cleanup for https://github.com/apache/beam/pull/7015 ...
Boyuan Zhang [Fri, 7 Dec 2018 19:23:19 +0000 (11:23 -0800)] 
[BEAM-6194] Follow up with cleanup for https://github.com/apache/beam/pull/7015 (#7219)

5 days agoMerge pull request #6739 [BEAM-5787] Fix test_translate_pattern on Python 3.7
Robert Bradshaw [Fri, 7 Dec 2018 12:00:05 +0000 (13:00 +0100)] 
Merge pull request #6739 [BEAM-5787] Fix test_translate_pattern on Python 3.7

[BEAM-5787] Fix test_translate_pattern on Python 3.7

5 days agoMerge pull request #7062 Enabling the ArrayTypeStyle checkstyle module
Robert Bradshaw [Fri, 7 Dec 2018 11:51:27 +0000 (12:51 +0100)] 
Merge pull request #7062 Enabling the ArrayTypeStyle checkstyle module

Enabling the ArrayTypeStyle checkstyle module

5 days agoMerge pull request #7185 Removing some unnecessary parentheses
Robert Bradshaw [Fri, 7 Dec 2018 11:43:01 +0000 (12:43 +0100)] 
Merge pull request #7185 Removing some unnecessary parentheses

Removing some unnecessary parentheses

5 days agoMerge pull request #7192 from [BEAM-5167] Log unscheduled process bundle requests
Robert Bradshaw [Fri, 7 Dec 2018 11:40:34 +0000 (12:40 +0100)] 
Merge pull request #7192 from [BEAM-5167] Log unscheduled process bundle requests

[BEAM-5167] Log unscheduled process bundle requests

5 days agoRedirect from nexmark page's older location 7225/head
Udi Meiri [Fri, 7 Dec 2018 02:38:03 +0000 (18:38 -0800)] 
Redirect from nexmark page's older location

Currently searching for "beam nexmark" on Google returns this link 404 link as the first result:
https://beam.apache.org/documentation/sdks/java/nexmark/

5 days agoMerge pull request #7182 from bramp/BEAM-6155
Ahmet Altay [Fri, 7 Dec 2018 02:03:18 +0000 (18:03 -0800)] 
Merge pull request #7182 from bramp/BEAM-6155

[BEAM-6155] Updates the GCS library the Go SDK uses.

5 days agoAdd QueueingBeamFnDataClient and make process, finish and start run on the same threa...
Alex Amato [Fri, 7 Dec 2018 01:37:36 +0000 (17:37 -0800)] 
Add QueueingBeamFnDataClient and make process, finish and start run on the same thread to support metrics. (#6786)

5 days ago[BEAM-5321] Port transforms package to Python 3 (#7104)
Robbe Sneyders [Fri, 7 Dec 2018 00:26:15 +0000 (01:26 +0100)] 
[BEAM-5321] Port transforms package to Python 3 (#7104)

* Port transforms package to Python 3

5 days ago[BEAM-6181] Reporting user counters via MonitoringInfos in Portable Dataflow Runner...
Mikhail Gryzykhin [Fri, 7 Dec 2018 00:07:53 +0000 (16:07 -0800)] 
[BEAM-6181] Reporting user counters via MonitoringInfos in Portable Dataflow Runner. (#7202)

5 days agoMerge pull request #7186: [BEAM-5920] Add additional owners for Community Metrics
Scott Wegner [Thu, 6 Dec 2018 19:24:34 +0000 (11:24 -0800)] 
Merge pull request #7186: [BEAM-5920] Add additional owners for Community Metrics

5 days agoMerge pull request #7214: Update PortableTimersExecutionTest to use PAssert
Maximilian Michels [Thu, 6 Dec 2018 18:21:01 +0000 (19:21 +0100)] 
Merge pull request #7214: Update PortableTimersExecutionTest to use PAssert

5 days ago[BEAM-6159] Make Dataflow worker use ExecutableStage to process bundle (#7015)
Boyuan Zhang [Thu, 6 Dec 2018 18:13:38 +0000 (10:13 -0800)] 
[BEAM-6159] Make Dataflow worker use ExecutableStage to process bundle (#7015)

5 days agoFixup User_COUNTER_URN_PREFIX to contain the trailing: (#7188)
Alex Amato [Thu, 6 Dec 2018 17:49:55 +0000 (09:49 -0800)] 
Fixup User_COUNTER_URN_PREFIX to contain the trailing: (#7188)

5 days agoRemove extra timeout code from PortableTimersExecutionTest. 7214/head
Alex Amato [Thu, 6 Dec 2018 17:42:14 +0000 (09:42 -0800)] 
Remove extra timeout code from PortableTimersExecutionTest.

5 days ago[BEAM-6067] In Python SDK, specify pipeline_proto_coder_id property in non-Beam-stand...
CraigChambersG [Thu, 6 Dec 2018 17:08:23 +0000 (09:08 -0800)] 
[BEAM-6067] In Python SDK, specify pipeline_proto_coder_id property in non-Beam-standard CloudObject coders (#7081)

6 days agoMerge pull request #7208: [BEAM-5859] Better handle fused composite stage names.
Maximilian Michels [Thu, 6 Dec 2018 14:17:30 +0000 (15:17 +0100)] 
Merge pull request #7208: [BEAM-5859] Better handle fused composite stage names.

6 days agoMerge pull request #7213 from [BEAM-6184] Add portable-runner dependency to example...
Robert Bradshaw [Thu, 6 Dec 2018 13:42:31 +0000 (14:42 +0100)] 
Merge pull request #7213 from [BEAM-6184] Add portable-runner dependency to example pom.xml

[BEAM-6184] Add portable-runner dependency to example pom.xml

6 days agoMerge pull request #6691: [BEAM-5309] Add streaming support for HadoopFormatIO
Alexey Romanenko [Thu, 6 Dec 2018 13:36:20 +0000 (14:36 +0100)] 
Merge pull request #6691: [BEAM-5309] Add streaming support for HadoopFormatIO

6 days ago[BEAM-5859] Better handle fused composite stage names. 7208/head
Robert Bradshaw [Wed, 5 Dec 2018 13:44:58 +0000 (14:44 +0100)] 
[BEAM-5859] Better handle fused composite stage names.

I decided to default to truncated names because they both look
nicer and they have more information if the UI is going to
(implicitly or explicitly) truncate them on length anyways.

6 days ago[BEAM-4150] Use unwindowed coder in FnApiRunner optimization phases. 7217/head
Robert Bradshaw [Thu, 6 Dec 2018 10:51:01 +0000 (11:51 +0100)] 
[BEAM-4150] Use unwindowed coder in FnApiRunner optimization phases.

6 days agoUpdate PortableTimersExecutionTest to use PAssert, to prevent a concurrency issue...
Alex Amato [Wed, 5 Dec 2018 20:35:24 +0000 (12:35 -0800)] 
Update PortableTimersExecutionTest to use PAssert, to prevent a concurrency issue collecting the test results.

6 days agoAdd portable-runner dependency to wordcount example as one of the 7213/head
Ruoyun [Wed, 5 Dec 2018 19:54:20 +0000 (11:54 -0800)] 
Add portable-runner dependency to wordcount example as one of the
defaults.

6 days ago[BEAM-6182] Disable conscrypt by default (#7203)
Ahmet Altay [Wed, 5 Dec 2018 18:25:42 +0000 (10:25 -0800)] 
[BEAM-6182] Disable conscrypt by default (#7203)

* Disable conscrypt by default

6 days agoMerge pull request #7162 from chaimt/BEAM-6151
Jean-Baptiste Onofré [Wed, 5 Dec 2018 17:27:16 +0000 (18:27 +0100)] 
Merge pull request #7162 from chaimt/BEAM-6151

[BEAM-6151] MongoDbIO add support mongodb server with self signed ssl

6 days agoMerge pull request #7205: [BEAM-5817] Add SQL bounded side input join to queries...
Kenn Knowles [Wed, 5 Dec 2018 16:59:18 +0000 (09:59 -0700)] 
Merge pull request #7205: [BEAM-5817] Add SQL bounded side input join to queries that are actually run

7 days agoMerge pull request #7170 from [BEAM-6153] Re-enable coder optimization.
Robert Bradshaw [Wed, 5 Dec 2018 11:04:36 +0000 (12:04 +0100)] 
Merge pull request #7170 from [BEAM-6153] Re-enable coder optimization.

[BEAM-6153] Re-enable coder optimization.

7 days agoMerge pull request #7204: [BEAM-5884] Fix FieldType comparison in BeamSQL
reuvenlax [Wed, 5 Dec 2018 07:27:36 +0000 (23:27 -0800)] 
Merge pull request #7204:  [BEAM-5884] Fix FieldType comparison in BeamSQL

7 days ago[BEAM-5817] Add SQL bounded side input join to queries that are actually run 7205/head
Kenneth Knowles [Wed, 5 Dec 2018 04:33:06 +0000 (20:33 -0800)] 
[BEAM-5817] Add SQL bounded side input join to queries that are actually run

7 days ago[BEAM-6180] Remove duplicated IdGenerator from runner harness and use IdGenerator...
Boyuan Zhang [Wed, 5 Dec 2018 00:44:49 +0000 (16:44 -0800)] 
[BEAM-6180] Remove duplicated IdGenerator from runner harness and use IdGenerator from fnexecution instead. (#7201)

7 days agoMerge pull request #7199: [BEAM-2400] Use getJobId() consistently
Scott Wegner [Wed, 5 Dec 2018 00:34:24 +0000 (16:34 -0800)] 
Merge pull request #7199: [BEAM-2400] Use getJobId() consistently

7 days agoMerge pull request #6930: [BEAM-5462] get rid of <pipeline>.options deprecation warni...
Chamikara Jayalath [Tue, 4 Dec 2018 19:00:01 +0000 (11:00 -0800)] 
Merge pull request #6930: [BEAM-5462] get rid of <pipeline>.options deprecation warnings in tests

7 days ago[BEAM-2400] Use getJobId() consistently 7199/head
Ahmet Altay [Tue, 4 Dec 2018 18:45:48 +0000 (10:45 -0800)] 
[BEAM-2400] Use getJobId() consistently

7 days agoMerge pull request #7128: [BEAM-6077] If available, use max_parallelism for splitting...
Maximilian Michels [Tue, 4 Dec 2018 17:02:15 +0000 (18:02 +0100)] 
Merge pull request #7128: [BEAM-6077] If available, use max_parallelism for splitting unbounded source

7 days agoMerge pull request #7129: [BEAM-6122] Update committer guidelines
Thomas Weise [Tue, 4 Dec 2018 16:59:34 +0000 (08:59 -0800)] 
Merge pull request #7129: [BEAM-6122] Update committer guidelines

8 days agoMerge pull request #7187: [BEAM-1628] Allow empty port for flink master url
Maximilian Michels [Tue, 4 Dec 2018 14:27:49 +0000 (15:27 +0100)] 
Merge pull request #7187: [BEAM-1628] Allow empty port for flink master url

8 days agoMerge pull request #6943: [BEAM-5778] Add integrations of Metrics API to Big Query...
Łukasz Gajowy [Tue, 4 Dec 2018 12:55:49 +0000 (13:55 +0100)] 
Merge pull request #6943: [BEAM-5778] Add integrations of Metrics API to Big Query for SyntheticcSources load tests in Python SDK

8 days agoMerge pull request #7194: [BEAM-6174] Kryo dependency removed.
David Moravek [Tue, 4 Dec 2018 12:24:14 +0000 (13:24 +0100)] 
Merge pull request #7194: [BEAM-6174] Kryo dependency removed.

8 days ago[BEAM-6174] Kryo dependency removed. 7194/head
vaclav.plajt@gmail.com [Tue, 4 Dec 2018 11:36:33 +0000 (12:36 +0100)] 
[BEAM-6174] Kryo dependency removed.

8 days ago[BEAM-1628] Allow empty port for flink master url 7187/head
Maximilian Michels [Mon, 3 Dec 2018 17:07:31 +0000 (18:07 +0100)] 
[BEAM-1628] Allow empty port for flink master url

This allows only specifying the host name without a port. It reads the port from
the configuration or uses the default Flink port if non configured. It does not
fall back to the special "[auto]" mode anymore if the port is omitted.

8 days ago[BEAM-6077] Tests for read source translator 7128/head
Jozef Vilcek [Sat, 1 Dec 2018 12:11:09 +0000 (13:11 +0100)] 
[BEAM-6077] Tests for read source translator

8 days ago[BEAM-5167] Log unscheduled process bundle requrests 7192/head
Ankur Goenka [Tue, 4 Dec 2018 01:04:29 +0000 (17:04 -0800)] 
[BEAM-5167] Log unscheduled process bundle requrests

8 days agoMerge pull request #7163 from markflyhigh/py-precommit-it
Ahmet Altay [Tue, 4 Dec 2018 01:02:36 +0000 (17:02 -0800)] 
Merge pull request #7163 from markflyhigh/py-precommit-it

[BEAM-5058] Run basic ITs in Python Precommit in parallel

8 days ago[BEAM-5462] get rid of <pipeline>.options deprecation warnings in tests 6930/head
Heejong Lee [Mon, 26 Nov 2018 22:58:42 +0000 (14:58 -0800)] 
[BEAM-5462] get rid of <pipeline>.options deprecation warnings in tests

adding a new parameter `options` to `runner.run_pipeline` method

8 days ago[BEAM-6033] normalize httplib2.Http initialization and usage 7032/head
Heejong Lee [Wed, 14 Nov 2018 03:42:35 +0000 (19:42 -0800)] 
[BEAM-6033] normalize httplib2.Http initialization and usage

Creating apache_beam.internal.http_client for a common
Http client from httplib2.