hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhijie Shen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-549) Asynchronous application submission
Date Sat, 20 Apr 2013 07:27:16 GMT

     [ https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Zhijie Shen updated YARN-549:

    Attachment: YARN-549.2.patch

In the newest patch:

1. Do throw the exception in YarnClientImpl. IMHO, the exception should be thrown here in
case interruption disturbs the application submission.


3. Throwing exceptions is refactored in RMAppManager#submitApplication. And log level (warn)
is unified when exception is logged.

4. Refactor TestAppManager to move some duplicate init code to setup().

5. Re-visit the validation code in RMAppManager#submitApplication and ClientRMService#submitApplication.
Some validations depend on the RM's configuration (dynamic), such that they need to be done
whether during new submission or recovery. These validations need to be put in RMAppManager#submitApplication.
The others are independent of the RM's configuration (static), such that the are only need
to be done once during newly submission. These validations are put in ClientRMService#submitApplication.

6. After rebalance the validation code among RMAppManager#submitApplication and ClientRMService#submitApplication.
The corresponding test code in TestAppManager and TestClientRMService are reorganized as well.

> Asynchronous application submission
> -----------------------------------
>                 Key: YARN-549
>                 URL: https://issues.apache.org/jira/browse/YARN-549
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Zhijie Shen
>            Assignee: Zhijie Shen
>         Attachments: Proposal of Asynchronous Application Submission_v1.pdf, YARN-549.1.patch,
> Currently, when submitting an application, storeApplication will be called for recovery.
However, it is a blocking API, and is likely to block concurrent application submissions.
Therefore, it is good to make application submission asynchronous, and postpone storeApplication.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message