PySpark fixes for YARN and Mesos
authorNadav Har Tzvi <nadavha@apache.org>
Thu, 17 May 2018 06:00:24 +0000 (09:00 +0300)
committerNadav Har Tzvi <nadavha@apache.org>
Sat, 26 May 2018 15:06:22 +0000 (18:06 +0300)
commit0f0a88bae8541b0856a96a0414b310e17da6de0f
treed8318dc4d72825d5cbfe330af942df5014187364
parent4fc833a46b3e5877f8280d806893ced56009cc91
PySpark fixes for YARN and Mesos
includes a hack for executor tests to run
common/src/main/scala/org/apache/amaterasu/common/configuration/ClusterConfig.scala
executor/src/main/resources/spark_intp.py
executor/src/main/scala/org/apache/amaterasu/executor/execution/actions/runners/spark/PySpark/PySparkRunner.scala
executor/src/main/scala/org/apache/amaterasu/executor/execution/actions/runners/spark/SparkRunnersProvider.scala
executor/src/main/scala/org/apache/spark/repl/amaterasu/runners/spark/SparkRunnerHelper.scala
executor/src/test/resources/amaterasu.properties