beam.git
74 min agoMerge pull request #5443: [BEAM-4357] Fix SQL shadow jar master
Kenn Knowles [Thu, 24 May 2018 23:33:27 +0000 (16:33 -0700)] 
Merge pull request #5443: [BEAM-4357]  Fix SQL shadow jar

88 min agoMerge pull request #5370: Move the ReferenceRunner Job Service, Artifact Services...
Thomas Groh [Thu, 24 May 2018 23:20:08 +0000 (16:20 -0700)] 
Merge pull request #5370: Move the ReferenceRunner Job Service, Artifact Services to the DirectRunner module

[BEAM-2885]

91 min agoMerge pull request #5469: Update Docker Command
Thomas Groh [Thu, 24 May 2018 23:16:14 +0000 (16:16 -0700)] 
Merge pull request #5469: Update Docker Command

2 hours agoMerge pull request #5466 from robertwb/fast-state-sampler
Robert Bradshaw [Thu, 24 May 2018 22:29:36 +0000 (15:29 -0700)] 
Merge pull request #5466 from robertwb/fast-state-sampler

Slowly ramp up wait time in state sampler.

2 hours agoMerge pull request #5472: [BEAM-4393]: Copy root repo's LICENSE & NOTICE into shadowJar
Kenn Knowles [Thu, 24 May 2018 21:49:18 +0000 (14:49 -0700)] 
Merge pull request #5472: [BEAM-4393]: Copy root repo's LICENSE & NOTICE into shadowJar

3 hours agoMerge pull request #5460: Update GroupAlsoByWindowEvaluatorFactory
Thomas Groh [Thu, 24 May 2018 21:38:13 +0000 (14:38 -0700)] 
Merge pull request #5460: Update GroupAlsoByWindowEvaluatorFactory

3 hours ago[BEAM-4392] Fix :beam-runners-java-fn-execution failure
Lukasz Cwik [Thu, 24 May 2018 21:37:41 +0000 (14:37 -0700)] 
[BEAM-4392] Fix :beam-runners-java-fn-execution failure

3 hours agoUpdate Docker Command 5469/head
Thomas Groh [Thu, 24 May 2018 18:25:39 +0000 (11:25 -0700)] 
Update Docker Command

The Docker Options should be seperate from the arguments provided to the
container, and need to be specified separately so the image can be
placed in the appropriate place.

3 hours ago[BEAM-4393]: Copy root repo's LICENSE & NOTICE into shadowJar 5472/head
Boyuan Zhang [Thu, 24 May 2018 20:58:10 +0000 (13:58 -0700)] 
[BEAM-4393]: Copy root repo's LICENSE & NOTICE into shadowJar

5 hours ago[SQL] Run tests against actual jar 5443/head
Andrew Pilloud [Wed, 23 May 2018 16:33:11 +0000 (09:33 -0700)] 
[SQL] Run tests against actual jar

5 hours ago[SQL] Fix transitive dependencies
Andrew Pilloud [Mon, 21 May 2018 20:06:04 +0000 (13:06 -0700)] 
[SQL] Fix transitive dependencies

6 hours agoMerge pull request #5465: [BEAM-4401] Use ElementEncoders for beam.Create
jasonkuster [Thu, 24 May 2018 18:42:56 +0000 (11:42 -0700)] 
Merge pull request #5465: [BEAM-4401] Use ElementEncoders for beam.Create

[BEAM-4401] Use ElementEncoders for beam.Create

6 hours agoAdd test case for proto oneof fields in create_test.go 5465/head
Cody Schroeder [Thu, 24 May 2018 17:47:04 +0000 (10:47 -0700)] 
Add test case for proto oneof fields in create_test.go

7 hours agoFix License Headers 5370/head
Thomas Groh [Tue, 22 May 2018 23:36:26 +0000 (16:36 -0700)] 
Fix License Headers

7 hours agoMigrate the ReferenceRunnerJobServer to runners-direct
Thomas Groh [Wed, 16 May 2018 20:57:21 +0000 (13:57 -0700)] 
Migrate the ReferenceRunnerJobServer to runners-direct

This is expected to be the only user. Future changes can move this out
if necessary, but until other users exist this simplifies building and
distribution.

7 hours agoMove the Local Artifact Services to the DirectRunner
Thomas Groh [Tue, 15 May 2018 17:50:07 +0000 (10:50 -0700)] 
Move the Local Artifact Services to the DirectRunner

This is expected to be the only user, at the current time.

7 hours agoSlowly ramp up wait time in state sampler. 5466/head
Robert Bradshaw [Thu, 24 May 2018 17:24:58 +0000 (10:24 -0700)] 
Slowly ramp up wait time in state sampler.

For pipelines with lots of small stages (e.g. tests), a significant amount
of time was being spent waiting for the state sampler to finish one tick.
This speeds up these kinds of pipelines, as well as giving more detailed
breakdowns of short stages without causing large overheads for longer-running
stages.

7 hours agoMerge pull request #5349: Add a Remote Stage Evaluator
Thomas Groh [Thu, 24 May 2018 16:56:56 +0000 (09:56 -0700)] 
Merge pull request #5349: Add a Remote Stage Evaluator

[BEAM-3326]

7 hours agoChange bulid rules of sdks/java/harness to make harness as a uber-jar 5457/head
Boyuan Zhang [Wed, 23 May 2018 18:46:18 +0000 (11:46 -0700)] 
Change bulid rules of sdks/java/harness to make harness as a uber-jar

8 hours agoUse ElementEncoders for beam.Create
Cody Schroeder [Thu, 24 May 2018 16:26:03 +0000 (09:26 -0700)] 
Use ElementEncoders for beam.Create

This ensures that any valid pipeline element can be passed to beam.Create.  The JSON encodings only work for a subset of valid PCollection types.

10 hours agoMerge pull request #5461: [BEAM-4393] Appending lacked LICENSE of shaded dependencies
Kenn Knowles [Thu, 24 May 2018 13:55:06 +0000 (06:55 -0700)] 
Merge pull request #5461: [BEAM-4393] Appending lacked LICENSE of shaded dependencies

15 hours agoMerge pull request #5411: [BEAM-4342] Enforce ErrorProne analysis in hadoop IO
Ismaël Mejía [Thu, 24 May 2018 09:21:23 +0000 (11:21 +0200)] 
Merge pull request #5411: [BEAM-4342] Enforce ErrorProne analysis in hadoop IO

15 hours agoMerge pull request #5462 from iemejia/fix-parquet-issues
Jean-Baptiste Onofré [Thu, 24 May 2018 09:01:49 +0000 (11:01 +0200)] 
Merge pull request #5462 from iemejia/fix-parquet-issues

Refine ParquetIO dependencies fix javadoc generation and enforce error-prone

16 hours agoEnforce error-prone in ParquetIO, fix missing javadoc and refine deps 5462/head
Ismaël Mejía [Thu, 24 May 2018 08:17:41 +0000 (10:17 +0200)] 
Enforce error-prone in ParquetIO, fix missing javadoc and refine deps

16 hours agoRemove repeated GCPIO dependency in SQL module (Again!)
Ismaël Mejía [Thu, 24 May 2018 08:10:46 +0000 (10:10 +0200)] 
Remove repeated GCPIO dependency in SQL module (Again!)

22 hours agoMerge pull request #5458: Establish and enforce exact Java format in sdks/java/extens...
Kenn Knowles [Thu, 24 May 2018 02:05:45 +0000 (19:05 -0700)] 
Merge pull request #5458: Establish and enforce exact Java format in sdks/java/extensions/sql

24 hours agoSolve BEAM-4393: Missing copyright notices for shaded packages 5461/head
Boyuan Zhang [Thu, 24 May 2018 00:22:02 +0000 (17:22 -0700)] 
Solve BEAM-4393: Missing copyright notices for shaded packages

24 hours agoActivate spotless for SQL module 5458/head
Kenneth Knowles [Wed, 23 May 2018 22:03:00 +0000 (15:03 -0700)] 
Activate spotless for SQL module

24 hours agoAdd spotless config to global gradle file
Kenneth Knowles [Wed, 23 May 2018 22:02:32 +0000 (15:02 -0700)] 
Add spotless config to global gradle file

24 hours agoAutoformat sdks/java/extensions/sql
Kenneth Knowles [Wed, 23 May 2018 21:23:15 +0000 (14:23 -0700)] 
Autoformat sdks/java/extensions/sql

25 hours agoMove InProcessEnvironmentFactory to java-fn-execution 5349/head
Thomas Groh [Wed, 23 May 2018 01:09:10 +0000 (18:09 -0700)] 
Move InProcessEnvironmentFactory to java-fn-execution

Use of InProcessEnvironmentFactory requires users to also depend on the
Java SDK harness.

25 hours agoMerge pull request #5459: Use WindowOnlyContext in ReduceFnContextFactory
Thomas Groh [Wed, 23 May 2018 23:36:03 +0000 (16:36 -0700)] 
Merge pull request #5459: Use WindowOnlyContext in ReduceFnContextFactory

25 hours agoUpdate GroupAlsoByWindowEvaluatorFactory 5460/head
Thomas Groh [Fri, 4 May 2018 20:27:24 +0000 (13:27 -0700)] 
Update GroupAlsoByWindowEvaluatorFactory

26 hours agoUse WindowOnlyContext in ReduceFnContextFactory 5459/head
Thomas Groh [Wed, 23 May 2018 22:37:11 +0000 (15:37 -0700)] 
Use WindowOnlyContext in ReduceFnContextFactory

Window is non-nullable, so always provide the window.

28 hours agoMerge pull request #5422 from timrobertson100/BEAM-4347
Ismaël Mejía [Wed, 23 May 2018 20:29:31 +0000 (22:29 +0200)] 
Merge pull request #5422 from timrobertson100/BEAM-4347

[BEAM-4347] Enforce ErrorProne analysis in kafka IO

29 hours ago[BEAM-4347] Correction of typo following PR review 5422/head
timrobertson100 [Wed, 23 May 2018 19:28:13 +0000 (21:28 +0200)] 
[BEAM-4347] Correction of typo following PR review

30 hours ago[BEAM-4347] Minor changes following PR review
timrobertson100 [Wed, 23 May 2018 18:03:11 +0000 (20:03 +0200)] 
[BEAM-4347] Minor changes following PR review

32 hours agoMerge pull request #5455: Fix build with Maven (Again!)
Ismaël Mejía [Wed, 23 May 2018 15:51:32 +0000 (17:51 +0200)] 
Merge pull request #5455: Fix build with Maven (Again!)

Fix build with Maven (Again!)

33 hours agoMerge pull request #5242: [BEAM-214] ParquetIO
Eugene Kirpichov [Wed, 23 May 2018 15:37:17 +0000 (08:37 -0700)] 
Merge pull request #5242: [BEAM-214] ParquetIO

[BEAM-214] ParquetIO

38 hours ago[BEAM-214] Apply reviewer's suggestions 5242/head
Łukasz Gajowy [Tue, 22 May 2018 09:46:19 +0000 (11:46 +0200)] 
[BEAM-214] Apply reviewer's suggestions

40 hours agoFix build with Maven (Again!) 5455/head
Ismaël Mejía [Wed, 23 May 2018 08:39:50 +0000 (10:39 +0200)] 
Fix build with Maven (Again!)

41 hours agoMerge pull request #5454: [BEAM-4354] Enforce ErrorProne analysis in tika IO
Ismaël Mejía [Wed, 23 May 2018 07:20:33 +0000 (09:20 +0200)] 
Merge pull request #5454: [BEAM-4354] Enforce ErrorProne analysis in tika IO

44 hours ago[BEAM-4354] Enforce ErrorProne analysis in tika IO 5454/head
timrobertson100 [Wed, 23 May 2018 04:27:11 +0000 (06:27 +0200)] 
[BEAM-4354] Enforce ErrorProne analysis in tika IO

2 days agoMerge pull request #5273: [BEAM-3883] Adding Client to push artifacts to artifact...
Eugene Kirpichov [Tue, 22 May 2018 23:41:33 +0000 (16:41 -0700)] 
Merge pull request #5273: [BEAM-3883] Adding Client to push artifacts to artifact staging service

[BEAM-3883] Adding Client to push artifacts to artifact staging service

2 days agoAdd a RemoteStageEvaluatorFactory
Thomas Groh [Fri, 4 May 2018 20:54:21 +0000 (13:54 -0700)] 
Add a RemoteStageEvaluatorFactory

This factory produces evaluators that handle the ExecutableStage
primtiive transform.

2 days agoUpdate InProcessManagedChannelFactory
Thomas Groh [Tue, 8 May 2018 23:46:08 +0000 (16:46 -0700)] 
Update InProcessManagedChannelFactory

2 days agoMerge pull request #5334 from RobbeSneyders/internal
Ahmet Altay [Tue, 22 May 2018 22:12:18 +0000 (15:12 -0700)] 
Merge pull request #5334 from RobbeSneyders/internal

[BEAM-3999] Futurize internal subpackage

2 days agoMerge pull request #5339 from Fematich/options
Ahmet Altay [Tue, 22 May 2018 22:06:38 +0000 (15:06 -0700)] 
Merge pull request #5339 from Fematich/options

[BEAM-4002] Futurize options subpackage

2 days agoMerge pull request #5448: [BEAM-4348] Enforce ErrorProne analysis in kinesis IO
Ismaël Mejía [Tue, 22 May 2018 21:18:39 +0000 (23:18 +0200)] 
Merge pull request #5448: [BEAM-4348] Enforce ErrorProne analysis in kinesis IO

2 days agoUpdating the dostring 5273/head
Ankur Goenka [Tue, 22 May 2018 21:09:26 +0000 (14:09 -0700)] 
Updating the dostring

2 days ago[BEAM-4348] Removes double-checked locking to aid readability 5448/head
timrobertson100 [Tue, 22 May 2018 20:28:23 +0000 (22:28 +0200)] 
[BEAM-4348] Removes double-checked locking to aid readability

2 days agoAdd an InProcessEnvironmentFactory
Thomas Groh [Tue, 8 May 2018 23:35:50 +0000 (16:35 -0700)] 
Add an InProcessEnvironmentFactory

This EnvironmentFactory produces an In-process Java SDK harness.

It is useful to test components of the ReferenceRunner without requiring
Docker.

2 days agoEnhancing test cases
Ankur Goenka [Tue, 22 May 2018 20:23:55 +0000 (13:23 -0700)] 
Enhancing test cases

2 days agoMerge pull request #5392: [BEAM-4267] JobBundleFactory that uses Docker-backed enviro...
Eugene Kirpichov [Tue, 22 May 2018 19:54:23 +0000 (12:54 -0700)] 
Merge pull request #5392: [BEAM-4267] JobBundleFactory that uses Docker-backed environments

[BEAM-4267] JobBundleFactory that uses Docker-backed environments

2 days agoMerge pull request #5451: [BEAM-4351] Enforce ErrorProne analysis in mqtt IO
Ismaël Mejía [Tue, 22 May 2018 19:49:24 +0000 (21:49 +0200)] 
Merge pull request #5451: [BEAM-4351] Enforce ErrorProne analysis in mqtt IO

2 days agoMerge pull request #5450: [BEAM-4349] Enforce ErrorProne analysis in mongodb IO
Ismaël Mejía [Tue, 22 May 2018 19:46:32 +0000 (21:46 +0200)] 
Merge pull request #5450: [BEAM-4349] Enforce ErrorProne analysis in mongodb IO

2 days agoLogging and naming changes
Ankur Goenka [Tue, 22 May 2018 19:44:09 +0000 (12:44 -0700)] 
Logging and naming changes

2 days agoMerge pull request #5427: Add a Window-only State Context
Thomas Groh [Tue, 22 May 2018 17:58:15 +0000 (10:58 -0700)] 
Merge pull request #5427: Add a Window-only State Context

2 days agoMerge pull request #5298: Add a Default RemoteEnvironment Implementation
Thomas Groh [Tue, 22 May 2018 17:57:50 +0000 (10:57 -0700)] 
Merge pull request #5298: Add a Default RemoteEnvironment Implementation

2 days agoMerge pull request #5413: [BEAM-4341] Enforce ErrorProne analysis in google-cloud...
Chamikara Jayalath [Tue, 22 May 2018 17:49:06 +0000 (10:49 -0700)] 
Merge pull request #5413: [BEAM-4341] Enforce ErrorProne analysis in google-cloud-platform IO

2 days ago[BEAM-1755] Add a directory with build-specific scripts to clear up the Python SDK...
Pablo [Tue, 22 May 2018 17:33:05 +0000 (10:33 -0700)] 
[BEAM-1755] Add a directory with build-specific scripts to clear up the Python SDK dir (#5400)

* Moving Python Bash scripts to own directory

2 days ago[BEAM-4060] Add the pom.xml and pom.properties file to the artifact when publishing
Lukasz Cwik [Tue, 22 May 2018 17:17:10 +0000 (10:17 -0700)] 
[BEAM-4060] Add the pom.xml and pom.properties file to the artifact when publishing

2 days agoMerge pull request #5180: [BEAM-4065] Basic performance tests analysis added
Chamikara Jayalath [Tue, 22 May 2018 16:59:53 +0000 (09:59 -0700)] 
Merge pull request #5180: [BEAM-4065] Basic performance tests analysis added

2 days agoMerge pull request #5348: Add a Direct Job Bundle Factory
Thomas Groh [Tue, 22 May 2018 16:49:51 +0000 (09:49 -0700)] 
Merge pull request #5348: Add a Direct Job Bundle Factory

[BEAM-3326]

2 days agoMerge pull request #5444: Revert BEAM-3256 add archetype testing to gradle build...
Thomas Groh [Tue, 22 May 2018 16:45:18 +0000 (09:45 -0700)] 
Merge pull request #5444: Revert BEAM-3256 add archetype testing to gradle build PreCommits

2 days ago[BEAM-4060] Add the pom.xml and pom.properties file to the artifact when publishing 5453/head
Luke Cwik [Tue, 22 May 2018 15:54:43 +0000 (08:54 -0700)] 
[BEAM-4060] Add the pom.xml and pom.properties file to the artifact when publishing

2 days ago[BEAM-4351] Enforce ErrorProne analysis in mqtt IO 5451/head
timrobertson100 [Tue, 22 May 2018 13:29:42 +0000 (15:29 +0200)] 
[BEAM-4351] Enforce ErrorProne analysis in mqtt IO

2 days ago[BEAM-4349] Enforce ErrorProne analysis in mongodb IO 5450/head
timrobertson100 [Tue, 22 May 2018 13:18:09 +0000 (15:18 +0200)] 
[BEAM-4349] Enforce ErrorProne analysis in mongodb IO

2 days ago[BEAM-4348] Enforce ErrorProne analysis in kinesis IO
timrobertson100 [Tue, 22 May 2018 12:44:20 +0000 (14:44 +0200)] 
[BEAM-4348] Enforce ErrorProne analysis in kinesis IO

2 days ago[BEAM-4347] Improve ErrorProne analysis in kafka IO
timrobertson100 [Tue, 22 May 2018 10:22:33 +0000 (12:22 +0200)] 
[BEAM-4347] Improve ErrorProne analysis in kafka IO

2 days agoJenkins job will run tests before executing script. Extended testing of averages... 5180/head
Kamil Szewczyk [Mon, 14 May 2018 13:45:03 +0000 (15:45 +0200)] 
Jenkins job will run tests before executing script. Extended testing of averages changes. Added PyDoc comments and applyied review requests.

2 days agoFixed typo in env name, added unit tests for create report logic, slack notification...
Kamil Szewczyk [Wed, 9 May 2018 14:35:11 +0000 (16:35 +0200)] 
Fixed typo in env name, added unit tests for create report logic, slack notification enabled

2 days ago[BEAM-4065] Basic performance tests analysis added.
Kamil Szewczyk [Mon, 16 Apr 2018 14:42:00 +0000 (16:42 +0200)] 
[BEAM-4065] Basic performance tests analysis added.

2 days agoFuturize options subpackage 5339/head
Matthias Feys [Fri, 11 May 2018 17:10:49 +0000 (19:10 +0200)] 
Futurize options subpackage

2 days agoMerge pull request #5440: [BEAM-4375] Replaces usage of JUnit runners that do not...
Eugene Kirpichov [Tue, 22 May 2018 03:55:14 +0000 (20:55 -0700)] 
Merge pull request #5440: [BEAM-4375] Replaces usage of JUnit runners that do not work well with Gradle

[BEAM-4375] Replaces usage of JUnit runners that do not work well with Gradle

2 days ago[BEAM-4375] Replaces usage of JUnit runners that do not work well with Gradle 5440/head
Eugene Kirpichov [Mon, 21 May 2018 19:56:18 +0000 (12:56 -0700)] 
[BEAM-4375] Replaces usage of JUnit runners that do not work well with Gradle

2 days agoMerge pull request #5439: Fixes MetricsTest
Eugene Kirpichov [Tue, 22 May 2018 01:27:48 +0000 (18:27 -0700)] 
Merge pull request #5439: Fixes MetricsTest

Fixes MetricsTest

2 days agoSimplifying numeric constants
Ankur Goenka [Tue, 22 May 2018 00:53:51 +0000 (17:53 -0700)] 
Simplifying numeric constants

3 days agoConverting ArtifactServiceFileHandler to PortableStager based on discussion in parent PR
Ankur Goenka [Fri, 11 May 2018 01:13:59 +0000 (18:13 -0700)] 
Converting ArtifactServiceFileHandler to PortableStager based on discussion in parent PR

3 days agoAdding context manager to ArtifactStagingFileHandler
Ankur Goenka [Wed, 9 May 2018 23:24:13 +0000 (16:24 -0700)] 
Adding context manager to ArtifactStagingFileHandler

3 days agoAdding filesystem based artifact service to ULR job service
Ankur Goenka [Thu, 3 May 2018 21:27:38 +0000 (14:27 -0700)] 
Adding filesystem based artifact service to ULR job service

3 days agoAdding ArtifactStagingFileHandler to push files to staging server
Ankur Goenka [Wed, 2 May 2018 22:00:56 +0000 (15:00 -0700)] 
Adding ArtifactStagingFileHandler to push files to staging server

3 days agorollback BEAM-3256 add archetype testing to gradle build PreCommits 5444/head
Yifan Zou [Mon, 21 May 2018 23:43:20 +0000 (16:43 -0700)] 
rollback BEAM-3256 add archetype testing to gradle build PreCommits

3 days agoMerge pull request #5251: [BEAM-3883] Refactor and clean dependency.py to make it...
Eugene Kirpichov [Mon, 21 May 2018 23:05:06 +0000 (16:05 -0700)] 
Merge pull request #5251: [BEAM-3883] Refactor and clean dependency.py to make it reusable with artifact service

[BEAM-3883] Refactor and clean dependency.py to make it reusable with artifact service

3 days agoMerge pull request #5442: [BEAM-4343][BEAM-4344] Enforce ErrorProne analysis in HBase...
Kenn Knowles [Mon, 21 May 2018 22:29:47 +0000 (15:29 -0700)] 
Merge pull request #5442: [BEAM-4343][BEAM-4344] Enforce ErrorProne analysis in HBaseIO and HCatalogIO

3 days agoFix Copyright Headers in sdks/java/fn-execution 5348/head
Thomas Groh [Fri, 18 May 2018 23:06:05 +0000 (16:06 -0700)] 
Fix Copyright Headers in sdks/java/fn-execution

3 days agoAdd a DirectJobBundleFactory
Thomas Groh [Tue, 8 May 2018 23:34:32 +0000 (16:34 -0700)] 
Add a DirectJobBundleFactory

This is a JobBundleFactory to use in the ReferenceRunner.

3 days agoAdd a BundleFactoryOutputReceiverFactory
Thomas Groh [Fri, 4 May 2018 18:41:02 +0000 (11:41 -0700)] 
Add a BundleFactoryOutputReceiverFactory

This is an OutputReceiverFactory that produces Bundles for a
StepTransformResult in the portable direct runner.

3 days ago[BEAM-4344] Enforce ErrorProne analysis in the HCatalogIO 5442/head
Ismaël Mejía [Mon, 21 May 2018 20:18:45 +0000 (22:18 +0200)] 
[BEAM-4344] Enforce ErrorProne analysis in the HCatalogIO

3 days ago[BEAM-4343] Enforce ErrorProne analysis in HBaseIO
Ismaël Mejía [Mon, 21 May 2018 20:17:58 +0000 (22:17 +0200)] 
[BEAM-4343] Enforce ErrorProne analysis in HBaseIO

3 days agoFixing lint 5251/head
Ankur Goenka [Mon, 21 May 2018 21:14:33 +0000 (14:14 -0700)] 
Fixing lint

3 days agoApplying changes from rebase
Ankur Goenka [Mon, 21 May 2018 19:45:09 +0000 (12:45 -0700)] 
Applying changes from rebase

3 days agoMaking a few methods static and moving code around
Ankur Goenka [Wed, 16 May 2018 21:19:37 +0000 (14:19 -0700)] 
Making a few methods static and moving code around

3 days agorenaming GCSStager to _ParameterizedStager
Ankur Goenka [Fri, 11 May 2018 19:59:28 +0000 (12:59 -0700)] 
renaming GCSStager to _ParameterizedStager

3 days agoMerging filehandler in stager
Ankur Goenka [Fri, 11 May 2018 00:45:42 +0000 (17:45 -0700)] 
Merging filehandler in stager

3 days agoRemoving stage_job_resources from dependencies.py and other minor changes
Ankur Goenka [Wed, 9 May 2018 21:09:55 +0000 (14:09 -0700)] 
Removing stage_job_resources from dependencies.py and other minor changes

3 days agoMoving stager to portability
Ankur Goenka [Mon, 30 Apr 2018 19:26:52 +0000 (12:26 -0700)] 
Moving stager to portability

3 days agoMaking dependency.py use stager.py and fixing dependency_test.py test cases.
Ankur Goenka [Sat, 28 Apr 2018 01:36:38 +0000 (18:36 -0700)] 
Making dependency.py use stager.py and fixing dependency_test.py test cases.

3 days agoFixing Stager Tests
Ankur Goenka [Sat, 28 Apr 2018 00:41:14 +0000 (17:41 -0700)] 
Fixing Stager Tests

3 days agoRemoving reference to Google/GCS/Dataflow and restructuring a bit of code.
Ankur Goenka [Fri, 27 Apr 2018 01:02:58 +0000 (18:02 -0700)] 
Removing reference to Google/GCS/Dataflow and restructuring a bit of code.