hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Joseph Evans (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-378) ApplicationMaster retry times should be set by Client
Date Tue, 05 Mar 2013 20:24:14 GMT

    [ https://issues.apache.org/jira/browse/YARN-378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13593863#comment-13593863
] 

Robert Joseph Evans commented on YARN-378:
------------------------------------------

But the config *is* specific to mapreduce.  Every other application client will have to provide
their own way of putting that value into the container launch context.  It could be through
a hadoop config or it could be through something else entirely.

I am in the process of porting Storm to run on top of YARN.  I don't see us ever using a Hadoop
Configuration in the client except the default one to be able to access HDFS.  Storm has its
own configuration object and for better integration with Storm I would set up a Storm conf
for that, although in reality I would probably just never set it because I never want it to
go down entirely, and that is how I would get the maximum number of retries allowed by the
cluster.

I can see other applications that already exist and are being ported to run on YARN, like
OpenMPI, to want to set that config in a way that is consistent with their current configuration
and not in a Hadoop specific way.
                
> ApplicationMaster retry times should be set by Client
> -----------------------------------------------------
>
>                 Key: YARN-378
>                 URL: https://issues.apache.org/jira/browse/YARN-378
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: client, resourcemanager
>         Environment: suse
>            Reporter: xieguiming
>            Assignee: Zhijie Shen
>              Labels: usability
>
> We should support that different client or user have different ApplicationMaster retry
times. It also say that "yarn.resourcemanager.am.max-retries" should be set by client. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message