amaterasu-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ya...@apache.org
Subject [incubator-amaterasu] branch master updated (e42a9b1 -> 68b6198)
Date Sun, 05 Aug 2018 09:38:28 GMT
This is an automated email from the ASF dual-hosted git repository.

yaniv pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-amaterasu.git.


    from e42a9b1  Merge pull request #31 from roadan/AMATERASU-47
     add cb3bb3a  spark runners providers added
     add 27f80c6  fixed mesos classpath
     add 7f96b9b  added callback address to spark scala
     add 137eaa2  broke mesos cmd to multiline
     add 590caa6  parameterized spark version in SparkSetupProvider.scala
     new 68b6198  Merge pull request #32 from roadan/AMATERASU-35

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../spark/dispatcher/SparkSetupProvider.scala      | 40 +++++++------
 .../runners/providers/PySparkRunnerProvider.scala  | 46 +++++++++++++++
 .../providers/SparkScalaRunnerProvider.scala       | 62 ++++++++++++++++++++
 .../leader/mesos/schedulers/JobScheduler.scala     | 68 +++++++++-------------
 .../amaterasu/leader/yarn/ApplicationMaster.scala  | 26 ++-------
 leader/src/main/scripts/ama-start-mesos.sh         |  9 ++-
 .../sdk/frameworks/FrameworkSetupProvider.java     |  4 +-
 .../RunnerSetupProvider.java}                      | 11 ++--
 8 files changed, 177 insertions(+), 89 deletions(-)
 create mode 100644 frameworks/spark/dispatcher/src/main/scala/org/apache/amaterasu/frameworks/spark/dispatcher/runners/providers/PySparkRunnerProvider.scala
 create mode 100644 frameworks/spark/dispatcher/src/main/scala/org/apache/amaterasu/frameworks/spark/dispatcher/runners/providers/SparkScalaRunnerProvider.scala
 copy sdk/src/main/java/org/apache/amaterasu/sdk/{AmaterasuRunner.java => frameworks/RunnerSetupProvider.java}
(73%)


Mime
View raw message