hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2363) Submitted applications occasionally lack a tracking URL
Date Mon, 28 Jul 2014 15:18:39 GMT

    [ https://issues.apache.org/jira/browse/YARN-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14076292#comment-14076292

Jason Lowe commented on YARN-2363:

Most application submits result in a proxy tracking URL, but occasionally the client sees
a transient "N/A" URL.  Here's a snippet of Pig client output where a MapReduce job was submitted
with no tracking URL received:

2014-07-23 19:19:16,658 [JobControl] INFO org.apache.hadoop.mapred.ResourceMgrDelegate - Submitted
application application_1403199204249_357708 to ResourceManager at
2014-07-23 19:19:16,660 [JobControl] INFO  org.apache.hadoop.mapreduce.Job - The url to track
the job: N/A

I believe this can occur if the client tries to get an application report just as the app
is submitted.  YarnClientImpl.submitApplication won't return until the app is past the NEW_SAVING
state, but if the client slips in while the app is in the SUBMITTED state then I think we
could end up with no tracking URL due to the lack of a current attempt.  From RMAppImpl.createAndGetApplicationReport:

      String trackingUrl = UNAVAILABLE;
      String host = UNAVAILABLE;
      String origTrackingUrl = UNAVAILABLE;
      if (allowAccess) {
        if (this.currentAttempt != null) {
          currentApplicationAttemptId = this.currentAttempt.getAppAttemptId();
          trackingUrl = this.currentAttempt.getTrackingUrl();
          origTrackingUrl = this.currentAttempt.getOriginalTrackingUrl();

So if we don't have a current attempt we'll return "N/A" as the tracking URL.  Arguably we
should return the proxied URL which will redirect to the RM app page if there is no tracking
URL set yet so at least the client/user has a URL that can be used to track the application.

> Submitted applications occasionally lack a tracking URL
> -------------------------------------------------------
>                 Key: YARN-2363
>                 URL: https://issues.apache.org/jira/browse/YARN-2363
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 2.4.0
>            Reporter: Jason Lowe
> Sometimes when an application is submitted the client receives no tracking URL.  More
details in the first comment.

This message was sent by Atlassian JIRA

View raw message