hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhijie Shen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-549) Asynchronous application submission
Date Sat, 20 Apr 2013 07:27:16 GMT

     [ https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Zhijie Shen updated YARN-549:
-----------------------------

    Attachment: YARN-549.2.patch

In the newest patch:

1. Do throw the exception in YarnClientImpl. IMHO, the exception should be thrown here in
case interruption disturbs the application submission.

2. RM_CLIENT_STATE_POLL_INTERVAL has be renamed as YARN_CLIENT_APP_SUBMISSION_POLL_INTERVAL.

3. Throwing exceptions is refactored in RMAppManager#submitApplication. And log level (warn)
is unified when exception is logged.

4. Refactor TestAppManager to move some duplicate init code to setup().

5. Re-visit the validation code in RMAppManager#submitApplication and ClientRMService#submitApplication.
Some validations depend on the RM's configuration (dynamic), such that they need to be done
whether during new submission or recovery. These validations need to be put in RMAppManager#submitApplication.
The others are independent of the RM's configuration (static), such that the are only need
to be done once during newly submission. These validations are put in ClientRMService#submitApplication.

6. After rebalance the validation code among RMAppManager#submitApplication and ClientRMService#submitApplication.
The corresponding test code in TestAppManager and TestClientRMService are reorganized as well.


                
> Asynchronous application submission
> -----------------------------------
>
>                 Key: YARN-549
>                 URL: https://issues.apache.org/jira/browse/YARN-549
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Zhijie Shen
>            Assignee: Zhijie Shen
>         Attachments: Proposal of Asynchronous Application Submission_v1.pdf, YARN-549.1.patch,
YARN-549.2.patch
>
>
> Currently, when submitting an application, storeApplication will be called for recovery.
However, it is a blocking API, and is likely to block concurrent application submissions.
Therefore, it is good to make application submission asynchronous, and postpone storeApplication.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message