spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Felix Cheung (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-12609) Make R to JVM timeout configurable
Date Mon, 04 Jan 2016 20:00:40 GMT

    [ https://issues.apache.org/jira/browse/SPARK-12609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081686#comment-15081686
] 

Felix Cheung commented on SPARK-12609:
--------------------------------------

Shouldn't we have a "in-progress" update ping or something instead?

That would be a bigger change but seems like would be better to make calls asynchronous?

> Make R to JVM timeout configurable 
> -----------------------------------
>
>                 Key: SPARK-12609
>                 URL: https://issues.apache.org/jira/browse/SPARK-12609
>             Project: Spark
>          Issue Type: Improvement
>          Components: SparkR
>            Reporter: Shivaram Venkataraman
>
> The timeout from R to the JVM is hardcoded at 6000 seconds in https://github.com/apache/spark/blob/6c5bbd628aaedb6efb44c15f816fea8fb600decc/R/pkg/R/client.R#L22
> This results in Spark jobs that take more than 100 minutes to always fail. We should
make this timeout configurable through SparkConf.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message