incubator-heron.git
14 months agoupdatedocandlink (#3685) ubuntu20.04-arm64
bed debug [Tue, 6 Apr 2021 19:12:25 +0000 (12:12 -0700)] 
updatedocandlink (#3685)

Co-authored-by: Huijun Wu <huijunw@twitter.com>
15 months agoUpdated to Kryo 5.0.4 (#3683)
Nicholas Nezis [Fri, 19 Mar 2021 01:46:39 +0000 (21:46 -0400)] 
Updated to Kryo 5.0.4 (#3683)

15 months agoFixing incorrect article title (#3682)
Josh Fischer [Mon, 15 Mar 2021 04:18:38 +0000 (23:18 -0500)] 
Fixing incorrect article title (#3682)

15 months agoGrammar fix (#3681)
fredster33 [Wed, 10 Mar 2021 02:34:46 +0000 (18:34 -0800)] 
Grammar fix (#3681)

15 months agoRemove cppunit-dev dependency (#3680)
bed debug [Tue, 9 Mar 2021 08:47:27 +0000 (00:47 -0800)] 
Remove cppunit-dev dependency (#3680)

Co-authored-by: Huijun Wu <huijunw@twitter.com>
16 months agoDecrease the minimum requirement of RAM of single instance to 16MB in Round Robin...
Windham Wong [Sat, 27 Feb 2021 20:21:18 +0000 (04:21 +0800)] 
Decrease the minimum requirement of RAM of single instance to 16MB in Round Robin algorithm (#3678)

Co-authored-by: Windham Wong <windham.wong@stormeye.io>
16 months agoRemoving unused Bookkeeper hostPort that causes port conflict (#3677)
Nicholas Nezis [Fri, 19 Feb 2021 03:05:05 +0000 (22:05 -0500)] 
Removing unused Bookkeeper hostPort that causes port conflict (#3677)

16 months agoSpecifying explicit transitive dependency for uvloop due to Python version conflict...
Nicholas Nezis [Thu, 18 Feb 2021 23:25:20 +0000 (18:25 -0500)] 
Specifying explicit transitive dependency for uvloop due to Python version conflict (#3675)

Adding a temporary fix until uvicorn fix is released

17 months agoFixed website style issue (#3673)
Josh Fischer [Wed, 3 Feb 2021 05:28:04 +0000 (23:28 -0600)] 
Fixed website style issue (#3673)

17 months agoJoshfischer/add download links (#3671)
Josh Fischer [Mon, 1 Feb 2021 14:54:48 +0000 (08:54 -0600)] 
Joshfischer/add download links (#3671)

* initial addition of heron download page.  Still work to do.

* adding start to release page; adding updates for versioned docs

* adding versioned docs

17 months agoReverting Glog back to 0.3.5 (#3672)
Nicholas Nezis [Mon, 1 Feb 2021 13:40:59 +0000 (08:40 -0500)] 
Reverting Glog back to 0.3.5 (#3672)

17 months agoUse Build Kit docker feature to shrink the Docker image size (#3669)
Nicholas Nezis [Wed, 27 Jan 2021 04:52:37 +0000 (23:52 -0500)] 
Use Build Kit docker feature to shrink the Docker image size (#3669)

17 months agoChanged heartbeat log statement to debug (#3667)
Nicholas Nezis [Fri, 22 Jan 2021 05:51:47 +0000 (00:51 -0500)] 
Changed heartbeat log statement to debug (#3667)

17 months agoRemoving defaulted HeapDumpOnOutOfMemory (#3665)
Nicholas Nezis [Fri, 22 Jan 2021 05:49:05 +0000 (00:49 -0500)] 
Removing defaulted HeapDumpOnOutOfMemory (#3665)

17 months agoAdded CLI submit config toggle for verbose GC logging (#3663)
Nicholas Nezis [Thu, 21 Jan 2021 05:33:27 +0000 (00:33 -0500)] 
Added CLI submit config toggle for verbose GC logging (#3663)

17 months agoAdd sum/max/min reducers in Scala (#3133)
Ning Wang [Wed, 20 Jan 2021 08:42:03 +0000 (00:42 -0800)] 
Add sum/max/min reducers in Scala (#3133)

17 months agoUpdated K8s Scheduler to set Resource Limits and Requests (#3664)
Nicholas Nezis [Mon, 18 Jan 2021 17:26:57 +0000 (12:26 -0500)] 
Updated K8s Scheduler to set Resource Limits and Requests (#3664)

What was previously used for K8s request is now used as a container limit.
There is an optional setting to either set or not set the K8s request to the same value.

17 months agoexplicit unreleased code (#3658)
Josh Fischer [Tue, 12 Jan 2021 01:18:58 +0000 (19:18 -0600)] 
explicit unreleased code (#3658)

17 months agoAllow localhost graceful shutdown (#3650)
choi se [Mon, 11 Jan 2021 22:14:25 +0000 (07:14 +0900)] 
Allow localhost graceful shutdown (#3650)

* Allow localhost graceful shutdown

* Update heron/shell/src/python/handlers/killexecutorhandler.py

Co-authored-by: Oliver Bristow <evilumbrella+github@gmail.com>
Co-authored-by: Oliver Bristow <evilumbrella+github@gmail.com>
17 months agoGLog updated to 0.4.0. Also some C++ code cleanup to remove warnings (#3655)
Nicholas Nezis [Thu, 7 Jan 2021 05:46:05 +0000 (00:46 -0500)] 
GLog updated to 0.4.0. Also some C++ code cleanup to remove warnings (#3655)

17 months agoUpdated Kryo to 5.0.3 (#3657)
Nicholas Nezis [Wed, 6 Jan 2021 19:20:25 +0000 (14:20 -0500)] 
Updated Kryo to 5.0.3 (#3657)

17 months agoupdate notice year (#3656)
Josh Fischer [Wed, 6 Jan 2021 00:43:07 +0000 (18:43 -0600)] 
update notice year (#3656)

18 months agoImproving Kubernetes scheduler logic (#3653)
Nicholas Nezis [Mon, 4 Jan 2021 01:59:50 +0000 (20:59 -0500)] 
Improving Kubernetes scheduler logic (#3653)

* Added support for HTTP_NOT_FOUND response code
* Updated to use try-with-resources logic for Response cleanup
* More cleanup. Now throwing TopologyRuntimeManagementException in more places

18 months agoBumping Bazel to 3.7.2 (#3654)
Nicholas Nezis [Thu, 31 Dec 2020 07:14:40 +0000 (02:14 -0500)] 
Bumping Bazel to 3.7.2 (#3654)

18 months agoAdd Prometheus metrics rules (#3651)
choi se [Mon, 21 Dec 2020 04:05:59 +0000 (13:05 +0900)] 
Add Prometheus metrics rules (#3651)

18 months agoUpdated Heron UI with Apache compliant font (#3648) release/0.20.3-incubating-rc9 0.20.3-incubating-rc9
Josh Fischer [Wed, 16 Dec 2020 01:02:10 +0000 (19:02 -0600)] 
Updated Heron UI with Apache compliant font (#3648)

18 months agoSupport javadoc of jdk11 (#3649)
choi se [Sat, 12 Dec 2020 22:57:51 +0000 (07:57 +0900)] 
Support javadoc of jdk11 (#3649)

Co-authored-by: thinker0 <thinker0@linecorp.com>
18 months agofix year in notice (#3647)
Josh Fischer [Wed, 9 Dec 2020 12:17:05 +0000 (06:17 -0600)] 
fix year in notice (#3647)

19 months agoFix vagrant init (#3643)
Oliver Bristow [Thu, 3 Dec 2020 13:43:36 +0000 (13:43 +0000)] 
Fix vagrant init (#3643)

19 months agoAdd license to shell.snip.html (#3641)
Nicholas Nezis [Wed, 2 Dec 2020 16:51:27 +0000 (11:51 -0500)] 
Add license to shell.snip.html (#3641)

* Converting comments to jinja2 format

19 months agoTypo fix (#3637) release/0.20.3-incubating-rc8 0.20.3-incubating-rc8
Nicholas Nezis [Fri, 27 Nov 2020 19:17:37 +0000 (14:17 -0500)] 
Typo fix (#3637)

19 months agoFix for large int that Helm was changing to scientific notation (#3635)
Nicholas Nezis [Mon, 23 Nov 2020 23:18:54 +0000 (18:18 -0500)] 
Fix for large int that Helm was changing to scientific notation (#3635)

19 months agoFixes to heron-ui arg name changes (#3634)
Nicholas Nezis [Mon, 23 Nov 2020 23:18:04 +0000 (18:18 -0500)] 
Fixes to heron-ui arg name changes (#3634)

19 months agocorrect reference to values in yaml file (#3632)
Josh Fischer [Fri, 20 Nov 2020 13:15:27 +0000 (07:15 -0600)] 
correct reference to values in yaml file (#3632)

19 months agoApache Rat additional excludes rules added (#3631)
Josh Fischer [Wed, 18 Nov 2020 08:39:56 +0000 (02:39 -0600)] 
Apache Rat additional excludes rules added (#3631)

* adding website2 folder and travis toolchain bazel rule to .rat_excludes

* adding missed directory for generated site docs

19 months agoUpgrade to Bazel 3.7 (#3630)
Nicholas Nezis [Mon, 16 Nov 2020 16:43:54 +0000 (11:43 -0500)] 
Upgrade to Bazel 3.7 (#3630)

19 months agoUpdate travis-ci.com in README (#3629)
bed debug [Mon, 16 Nov 2020 01:28:32 +0000 (17:28 -0800)] 
Update travis-ci.com in README (#3629)

19 months agoClean heron-ui backend (#3597)
Oliver Bristow [Wed, 11 Nov 2020 07:14:04 +0000 (07:14 +0000)] 
Clean heron-ui backend (#3597)

* Clean heron-ui backend

 * replace tornado server with FastAPI+Jinja2+Uvicorn
 * factor out torado from heron.tools.common
 * add type annotations
 * expose port 8889 of Vagrant VM for heron-ui
 * pin to latest 4.x version of Tornado
 * visual changes to container pages

This should only be an internal refactor.

Async querying of the tracker was dropped, but could be reintroduced
using [aiohttp](https://docs.aiohttp.org/en/stable/) if speed becomes
an issue for requests that aggregate tracker data.

* Remove duplicate tracker process

19 months agoRename "topology master" to "topology manager" (#3624)
Jim Rath [Fri, 6 Nov 2020 05:41:44 +0000 (00:41 -0500)] 
Rename "topology master" to "topology manager" (#3624)

20 months agoUse click instead of argparse in py instance (#3598)
Oliver Bristow [Tue, 3 Nov 2020 15:33:38 +0000 (15:33 +0000)] 
Use click instead of argparse in py instance (#3598)

* Use click instead of argparse in py instance
* Improve heron-python-instance option name consistency
* Rename instance/st_heron_instance.py to instance.py to avoid [this kind of runtime
warning](https://stackoverflow.com/questions/43393764/python-3-6-project-structure-leads-to-runtimewarning).

20 months agoPurge heron-admin (#3585)
Oliver Bristow [Tue, 3 Nov 2020 15:12:20 +0000 (15:12 +0000)] 
Purge heron-admin (#3585)

* remove heron-admin binary from release
 * remove nomad binary from release
 * remove "standalone" cluster config from release and documentation

20 months agoUpdating to Bazel 3.5.0 (#3627)
Nicholas Nezis [Tue, 3 Nov 2020 05:35:04 +0000 (00:35 -0500)] 
Updating to Bazel 3.5.0 (#3627)

20 months agoAdded more Helm chart Bookkeeper config items (#3628)
Nicholas Nezis [Tue, 3 Nov 2020 05:32:39 +0000 (00:32 -0500)] 
Added more Helm chart Bookkeeper config items (#3628)

20 months agoclean up site docs (#3626)
Josh Fischer [Sat, 31 Oct 2020 14:29:39 +0000 (09:29 -0500)] 
clean up site docs (#3626)

* clean up

* Update website2/docs/topology-development-streamlet-api.md

Co-authored-by: Oliver Bristow <evilumbrella+github@gmail.com>
* clean up duplicates

* clean up

* last version clean up

* commit before reset

* adding version to link

Co-authored-by: Oliver Bristow <evilumbrella+github@gmail.com>
20 months agoClean tracker top level code (#3602)
Oliver Bristow [Sat, 31 Oct 2020 00:39:27 +0000 (00:39 +0000)] 
Clean tracker top level code (#3602)

 * Allow arbitrary whitespace in queries
 * DRY up Multiply/Divide/Subtract
 * use snake_case
 * code simplification

20 months agoAdding python3-venv to Debian image (#3625)
Josh Fischer [Fri, 30 Oct 2020 18:57:51 +0000 (13:57 -0500)] 
Adding python3-venv to Debian image (#3625)

20 months agoUse click instead of argparse in tracker (#3599)
Oliver Bristow [Fri, 30 Oct 2020 18:56:26 +0000 (18:56 +0000)] 
Use click instead of argparse in tracker (#3599)

20 months agoUpdated Kryo to 5.0.0 (#3621)
Nicholas Nezis [Mon, 19 Oct 2020 01:08:13 +0000 (21:08 -0400)] 
Updated Kryo to 5.0.0 (#3621)

20 months agoFix documentation CI build process (#3620)
bed debug [Fri, 16 Oct 2020 06:59:35 +0000 (23:59 -0700)] 
Fix documentation CI build process (#3620)

Co-authored-by: Huijun Wu <huijunw@twitter.com>
21 months agoAdded ability to disable base_url in Helm chart (#3619)
Nicholas Nezis [Wed, 23 Sep 2020 22:55:24 +0000 (18:55 -0400)] 
Added ability to disable base_url in Helm chart (#3619)

21 months agoStop using "cluster admin" role and restrict to k8s namespace (#3618)
Scott [Mon, 21 Sep 2020 04:00:55 +0000 (00:00 -0400)] 
Stop using "cluster admin" role and restrict to k8s namespace (#3618)

21 months agoAdding missing ENV variables for Centos 7 image (#3617)
Nicholas Nezis [Mon, 14 Sep 2020 21:14:44 +0000 (17:14 -0400)] 
Adding missing ENV variables for Centos 7 image (#3617)

21 months agoFixing typo in Helm chart template
Nicholas Nezis [Sat, 12 Sep 2020 07:25:48 +0000 (03:25 -0400)] 
Fixing typo in Helm chart template

21 months agoFix Helm chart to support clustered Zookeepers (#3611)
Nicholas Nezis [Tue, 8 Sep 2020 02:49:57 +0000 (22:49 -0400)] 
Fix Helm chart to support clustered Zookeepers (#3611)

22 months agoUpdating Kryo to 5.0.0-RC9 (#3593) roundrobin-improvement
Nicholas Nezis [Mon, 24 Aug 2020 19:20:25 +0000 (15:20 -0400)] 
Updating Kryo to 5.0.0-RC9 (#3593)

22 months agoDockerfiles Python 3 cleanup (#3601)
Nicholas Nezis [Fri, 21 Aug 2020 21:21:17 +0000 (17:21 -0400)] 
Dockerfiles Python 3 cleanup (#3601)

22 months agoUpdated to fix Kubernetes scale issue (#3607)
Nicholas Nezis [Fri, 21 Aug 2020 19:14:51 +0000 (15:14 -0400)] 
Updated to fix Kubernetes scale issue (#3607)

22 months agoUnvendor (#3603)
Oliver Bristow [Fri, 14 Aug 2020 19:03:37 +0000 (20:03 +0100)] 
Unvendor (#3603)

* Unvendor kashmir

* Unvendor cpplint

* Fix cpplint issues

22 months agoAdding Bazel version check (#3605)
Josh Fischer [Fri, 14 Aug 2020 17:45:01 +0000 (12:45 -0500)] 
Adding Bazel version check (#3605)

22 months agoDeep clean heron-explorer (#3588)
Oliver Bristow [Mon, 10 Aug 2020 21:22:31 +0000 (22:22 +0100)] 
Deep clean heron-explorer (#3588)

* Deep clean heron-explorer

 * use click instead of argparse pattern
 * list all topologies instead of just 20
 * not strictly the same CLI argument names but same functionality
 * add smoke testes for heron-tracker and heron-explorer in local-test-runner

* heron-explorer clean PR feedback

23 months agoSwitch to pigz to support multi-core tar command (#3595)
Windham Wong [Fri, 31 Jul 2020 03:59:54 +0000 (11:59 +0800)] 
Switch to pigz to support multi-core tar command (#3595)

* Update build-artifacts.sh
* Update build-exec-docker.sh
* Update build-docker.sh

23 months agoUpdating docker build to fix Python Click library issue (#3596)
Windham Wong [Fri, 31 Jul 2020 03:59:06 +0000 (11:59 +0800)] 
Updating docker build to fix Python Click library issue (#3596)

23 months agoChanging JRE to JDK (#3592) 0.20.3-incubaging-rc7-line 0.20.3-incubating-rc7 0.20.3-incubating-rc7-line
Nicholas Nezis [Wed, 29 Jul 2020 13:30:06 +0000 (09:30 -0400)] 
Changing JRE to JDK (#3592)

23 months agoRemove unused heron.tools.common.src.python.utils.heronparser (#3591)
Oliver Bristow [Wed, 29 Jul 2020 13:29:37 +0000 (14:29 +0100)] 
Remove unused heron.tools.common.src.python.utils.heronparser (#3591)

23 months agoReordering the init containers in the Helm chart (#3589)
Nicholas Nezis [Wed, 29 Jul 2020 05:55:12 +0000 (01:55 -0400)] 
Reordering the init containers in the Helm chart (#3589)

23 months agoFix licenses in 2020/7/20 master (#3590)
Ning Wang [Tue, 28 Jul 2020 05:44:42 +0000 (22:44 -0700)] 
Fix licenses in 2020/7/20 master (#3590)

23 months agoCorrect heron-executor CLI usage (#3587)
Oliver Bristow [Mon, 27 Jul 2020 13:55:34 +0000 (14:55 +0100)] 
Correct heron-executor CLI usage (#3587)

23 months agoFix log-reader for Python3 (#3580) 0.20.3-incubating-line 0.20.3-incubating-rc6
choi se [Sun, 26 Jul 2020 07:45:42 +0000 (16:45 +0900)] 
Fix log-reader for Python3 (#3580)

* Fix log-reader for Python3

Signed-off-by: thinker0 <thinker0@linecorp.com>
* typo

Signed-off-by: thinker0 <thinker0@linecorp.com>
* Revert commit

Co-authored-by: thinker0 <thinker0@linecorp.com>
23 months agoReplace graph code in tracker (#3579)
Oliver Bristow [Sun, 26 Jul 2020 04:25:17 +0000 (05:25 +0100)] 
Replace graph code in tracker (#3579)

23 months agoSupport lifecycle for aurora (#3581)
choi se [Sun, 26 Jul 2020 04:24:57 +0000 (13:24 +0900)] 
Support lifecycle for aurora (#3581)

Co-authored-by: thinker0 <thinker0@linecorp.com>
23 months agoUpgrade to Bazel 3.4.1 (#3576)
Nicholas Nezis [Thu, 23 Jul 2020 16:44:22 +0000 (12:44 -0400)] 
Upgrade to Bazel 3.4.1 (#3576)

* Upgrade to Bazel 3.4.1
* Fixing ArrayToString error
see https://errorprone.info/bugpattern/ArrayToString
* Updating Docker rules and Pkg rules
* Updating `rules_python`

23 months agoUnvendor pyobj + fix py2->py3 compatability fixes. (#3574) 0.20.3-incubating-rc5
Oliver Bristow [Wed, 22 Jul 2020 11:03:46 +0000 (12:03 +0100)] 
Unvendor pyobj + fix py2->py3 compatability fixes. (#3574)

This also uses the longer DataWatcher handler signature
to avoid a TypeError, which it relies on to indicate it
should retry with the shorter signature. Without this
change, exceptions can be reported messily due to a raise
in the except path being reasonably expected.

23 months agoUpdate website URL in README (#3578)
Josh Fischer [Tue, 21 Jul 2020 13:57:49 +0000 (08:57 -0500)] 
Update website URL in README (#3578)

23 months agoUnvendor cloudpickle (#3568)
Oliver Bristow [Mon, 20 Jul 2020 19:26:06 +0000 (20:26 +0100)] 
Unvendor cloudpickle (#3568)

23 months agoallfix (#3577)
bed debug [Mon, 20 Jul 2020 05:16:45 +0000 (22:16 -0700)] 
allfix (#3577)

Signed-off-by: Huijun Wu <huijunw@twitter.com>
Co-authored-by: Huijun Wu <huijunw@twitter.com>
23 months agoStrip old python requirements (#3569)
Oliver Bristow [Mon, 20 Jul 2020 03:21:26 +0000 (04:21 +0100)] 
Strip old python requirements (#3569)

* Remove enum34+future+argparse

* Remove six

* DRY up zkstatemanager.py

* Remove pycrypto

* Remove external dependancies for unittest2+mock+py

23 months agoUpdated Bookkeeper to 4.11.0 (#3571)
Nicholas Nezis [Mon, 20 Jul 2020 00:03:13 +0000 (20:03 -0400)] 
Updated Bookkeeper to 4.11.0 (#3571)

23 months agoAdd Ant dependency to Vagrant machine (#3573)
Oliver Bristow [Sun, 19 Jul 2020 19:22:49 +0000 (20:22 +0100)] 
Add Ant dependency to Vagrant machine (#3573)

23 months agoFix Jenkins Doc generation (#3572)
bed debug [Sat, 18 Jul 2020 16:19:02 +0000 (09:19 -0700)] 
Fix Jenkins Doc generation (#3572)

* fix doc CI
* update py3
* update pip3

Co-authored-by: Huijun Wu <huijunw@twitter.com>
23 months agofix jenkins debian10 (#3570) 0.20.3-incubating-rc4
bed debug [Sat, 18 Jul 2020 10:17:33 +0000 (03:17 -0700)] 
fix jenkins debian10 (#3570)

* fixci

* useopenjdk

* order

* updatedebian9

Co-authored-by: Huijun Wu <huijunw@twitter.com>
23 months agoUpdates to Kubernetes scheduler to fix dockerenv issue (#3550)
Nicholas Nezis [Tue, 14 Jul 2020 17:02:36 +0000 (13:02 -0400)] 
Updates to Kubernetes scheduler to fix dockerenv issue (#3550)

* Updates to Kubernetes scheduler to create Headless service
* Use FQDN instead of hostname when running in Kubernetes environment

23 months agoupdate storm 2.2.0 ISpout open() (#3567) 0.20.3-incubating-rc3-line
bed debug [Sun, 12 Jul 2020 08:33:01 +0000 (01:33 -0700)] 
update storm 2.2.0 ISpout open() (#3567)

* updateispout

* fix-style

* minchange

* updateibolt

Co-authored-by: Huijun Wu <huijunw@twitter.com>
23 months agomkdir for storm api 2.2.0 (#3566)
bed debug [Sat, 11 Jul 2020 23:39:59 +0000 (16:39 -0700)] 
mkdir for storm api 2.2.0 (#3566)

* mkdirstormapi2

* fixjavalicenseheader

* fixstyle

Co-authored-by: Huijun Wu <huijunw@twitter.com>
23 months agofixtoolchain (#3563)
bed debug [Sat, 11 Jul 2020 20:23:49 +0000 (13:23 -0700)] 
fixtoolchain (#3563)

23 months agoMake the integration test script executable. (#3565)
bed debug [Fri, 10 Jul 2020 21:38:33 +0000 (14:38 -0700)] 
Make the integration test script executable. (#3565)

23 months agozookeeper to 3.5.8 (#3555)
bed debug [Fri, 10 Jul 2020 21:11:09 +0000 (14:11 -0700)] 
zookeeper to 3.5.8 (#3555)

* Upgrade zookeeper3.5.8

Co-authored-by: Huijun Wu <huijunw@twitter.com>
Co-authored-by: Nicholas Nezis <nicholas.nezis@gmail.com>
23 months agoPython 3 upgrade (#3522)
Oliver Bristow [Tue, 7 Jul 2020 00:24:27 +0000 (01:24 +0100)] 
Python 3 upgrade (#3522)

* Initial Python 3 upgrade effort

* Fixes towards python3 support

 * update heronpy release scripts for python3
 * update dist Dockerfiles to only use python3
 * remove python2 from docker images
 * upgrade pylint for python3 support
 * upgrade PEX so transative dependencies are captured

Additionally:
 * fix Ubuntu 16.04 images
 * fix linting issues found by newer pylint

There is an issue with encapsulation in the builds where the global python3 environment is used
while PEX installs a nested transitive dependency of pylint: `pylint>astroid>wrapt`. This seems
to be because of logic in its setup.py which can be disabled with `WRAPT_INSTALL_EXTENSIONS=false`

* Fix new pylint issues

* update setuptools

* Make pex_pytest non-zip-safe

* Rough proto_library fix

The issue encountered was https://github.com/protocolbuffers/protobuf/issues/1491 which
may be fixed by a pending PR to protoc, or with a switch to the official protobuf rules
and the import_prefix parameter to proto_library.

* WIP: Fix python3 incompatibilities

 * bytes vs str issues
 * update kazoo
 * order of processes in executor test changed due to dict ordering?
 * some places needed / switched to // - may be more not caught by tests
 * add travis_wait as some stages going over 10 minutes without output in CI

TODO:
 * make sure the kazoo upgrade is correct, it was done only by updating package versoin

* Try fixing build time issue in travis

* Upgrade docker rules

* Upgrade to python3 in CI

* Fix python integration tests

* Fix more bytes vs str errors + update vagrant

* Update Travis to Python3.7 + fix Vagrant on mac

* Reduce requirement to python3.6 + py3 fixes

 * use universal_newline in popen instead of text in Popen for py3.6
 * fix bytes/str issues in deserialisation
 * fix file open modes
 * use set instead of sets.Set
 * fix __import__(level) default

* Update cloudpickle

* Fix python addressing of release.yaml

* Additions to get docker image builds working and tested

 * use new external pkg_* rules
 * add python to compile docker images until pkg_*
 * add --host_force_python=PY3 to other bazel.rc files

* WIP: Add CI for docker images/releases

 * use kind to create ephemeral clusters
 * start consolidating scripts with python

* Fix helm chart

* bytes vs str fix

* Mention Python 3.6 requirement in README.md

* updatedockerfile

Co-authored-by: Neng Lu <nlu@twitter.com>
Co-authored-by: Nicholas Nezis <nicholas.nezis@gmail.com>
Co-authored-by: bed debug <huijunwu@users.noreply.github.com>
Co-authored-by: huijunwu <huijun.wu.2010@gmail.com>
2 years agoAdding missing baseUrl (#3553)
Nicholas Nezis [Fri, 3 Jul 2020 12:37:11 +0000 (08:37 -0400)] 
Adding missing baseUrl (#3553)

2 years agoRevert "upgradezookeeper3.5.8"
huijunwu [Fri, 3 Jul 2020 02:11:21 +0000 (02:11 +0000)] 
Revert "upgradezookeeper3.5.8"

This reverts commit 00e4e81d77153ac4017967e78c59a3b9b72e5609.

2 years agoupgradezookeeper3.5.8
huijunwu [Fri, 3 Jul 2020 02:01:31 +0000 (02:01 +0000)] 
upgradezookeeper3.5.8

2 years agoFixing RVO optimization (#3549)
Nicholas Nezis [Thu, 2 Jul 2020 00:53:30 +0000 (20:53 -0400)] 
Fixing RVO optimization (#3549)

2 years agoDistribution Dockerfile missing ncat and other cleanup (#3552)
Nicholas Nezis [Wed, 1 Jul 2020 06:45:46 +0000 (02:45 -0400)] 
Distribution Dockerfile missing ncat and other cleanup (#3552)

* Distribution Dockerfile cleanup

2 years agoUpdated to make site look better on mobile (#3547)
Nicholas Nezis [Thu, 25 Jun 2020 14:15:34 +0000 (10:15 -0400)] 
Updated to make site look better on mobile (#3547)

2 years agoHeronPy: Add missing TOPOLOGY_CONTAINER_MAX_RAM_HINT (#3544)
Windham Wong [Thu, 25 Jun 2020 06:05:24 +0000 (14:05 +0800)] 
HeronPy: Add missing TOPOLOGY_CONTAINER_MAX_RAM_HINT (#3544)

TOPOLOGY_CONTAINER_MAX_RAM_HINT should be there for FirstFitDecreasingPacking

2 years agoUpdated Docusaurus config to fix Javadocs CSS bug (#3546)
Nicholas Nezis [Thu, 25 Jun 2020 02:23:51 +0000 (22:23 -0400)] 
Updated Docusaurus config to fix Javadocs CSS bug (#3546)

* Updated Docusaurus config to ignore Javadocs CSS

* Refactored and updated gitignore rules

* Website build script cleanup

2 years agoEmbedded Trykker font (#3541)
Nicholas Nezis [Thu, 18 Jun 2020 11:53:48 +0000 (07:53 -0400)] 
Embedded Trykker font (#3541)

2 years agoadjusting packages for javadocs (#3537)
Josh Fischer [Wed, 10 Jun 2020 10:21:19 +0000 (05:21 -0500)] 
adjusting packages for javadocs (#3537)

2 years agofixing javadocs (#3536)
Josh Fischer [Sun, 7 Jun 2020 12:56:36 +0000 (07:56 -0500)] 
fixing javadocs (#3536)

* fixing javadocs

* Adding back Pulsar Streamlet example

* Excluding examples folder from javadocs

* clean up

Co-authored-by: Nicholas Nezis <nicholas.nezis@gmail.com>
2 years agoFix use of non-default base url value (#3535)
Oliver Bristow [Wed, 3 Jun 2020 01:33:28 +0000 (02:33 +0100)] 
Fix use of non-default base url value (#3535)

2 years agoFix service url in Helm chart (#3534)
Oliver Bristow [Tue, 2 Jun 2020 01:55:02 +0000 (02:55 +0100)] 
Fix service url in Helm chart (#3534)

The template string in the values.yaml wasn't rendered, so this patch renders the default value in the template