spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shivaram Venkataraman (JIRA)" <>
Subject [jira] [Commented] (SPARK-6797) Add support for YARN cluster mode
Date Wed, 03 Jun 2015 05:43:49 GMT


Shivaram Venkataraman commented on SPARK-6797:

You are right that we are assuming binary compatibility across AM nodes. I guess its a reasonable
assumption for now but we could investigate not requiring this in the future. BTW the source
vs. binary package also affects what we ship to users in a release, so its a more general

> Add support for YARN cluster mode
> ---------------------------------
>                 Key: SPARK-6797
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: SparkR
>            Reporter: Shivaram Venkataraman
>            Assignee: Sun Rui
>            Priority: Critical
> SparkR currently does not work in YARN cluster mode as the R package is not shipped along
with the assembly jar to the YARN AM. We could try to use the support for archives in YARN
to send out the R package as a zip file.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message