spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shivaram Venkataraman (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-6797) Add support for YARN cluster mode
Date Wed, 03 Jun 2015 05:43:49 GMT

    [ https://issues.apache.org/jira/browse/SPARK-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570307#comment-14570307
] 

Shivaram Venkataraman commented on SPARK-6797:
----------------------------------------------

You are right that we are assuming binary compatibility across AM nodes. I guess its a reasonable
assumption for now but we could investigate not requiring this in the future. BTW the source
vs. binary package also affects what we ship to users in a release, so its a more general
problem. 

> Add support for YARN cluster mode
> ---------------------------------
>
>                 Key: SPARK-6797
>                 URL: https://issues.apache.org/jira/browse/SPARK-6797
>             Project: Spark
>          Issue Type: Improvement
>          Components: SparkR
>            Reporter: Shivaram Venkataraman
>            Assignee: Sun Rui
>            Priority: Critical
>
> SparkR currently does not work in YARN cluster mode as the R package is not shipped along
with the assembly jar to the YARN AM. We could try to use the support for archives in YARN
to send out the R package as a zip file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message