hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prabhu Joseph (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime
Date Fri, 25 Jan 2019 02:38:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16751829#comment-16751829

Prabhu Joseph commented on YARN-6616:

Thanks [~eepayne] for the review. The submitTime is different from launchTime. submitTime
is the time the job is submitted to RM whereas the launchTime is the time first attempt (AM)
is launched.

1. SubmitTime is the time submitApplication is received by RM (ClientRMService) from YarnClient.
ClientRMService sets submitTime to the system time.

 // call RMAppManager to submit application directly
System.currentTimeMillis(), user);

2. StartTime is the time set by RMAppImpl after ClientRMService validates with queue SUBMIT_APPLICATIONS.
RMAppImpl sets startTime to the system time.

if (startTime <= 0) {
this.startTime = this.systemClock.getTime();

3. LaunchTime is the time set when AM is Launched and the first attempt is launched. RMAppImpl
sets it with event timestamp when AttemptLaunchedTransition.

app.launchTime = event.getTimestamp();

submitTime <= startTime <= launchTime <= finishTime

> YARN AHS shows submitTime for jobs same as startTime
> ----------------------------------------------------
>                 Key: YARN-6616
>                 URL: https://issues.apache.org/jira/browse/YARN-6616
>             Project: Hadoop YARN
>          Issue Type: Bug
>    Affects Versions: 2.7.3
>            Reporter: Prabhu Joseph
>            Assignee: Prabhu Joseph
>            Priority: Minor
>         Attachments: 0001-YARN-6616.patch, 0002-YARN-6616.patch, 0003-YARN-6616.patch,
0004-YARN-6616.patch, 0005-YARN-6616.patch, 0006-YARN-6616.patch, 0007-YARN-6616.patch, 0008-YARN-6616.patch,
> YARN AHS returns startTime value for both submitTime and startTime for the jobs.  Looks
the code sets the submitTime with startTime value. 
> https://github.com/apache/hadoop/blob/branch-2.7.3/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/dao/AppInfo.java#L80
> {code}
> curl --negotiate -u: http://prabhuzeppelin3.openstacklocal:8188/ws/v1/applicationhistory/apps
> <submittedTime>1495015537574</submittedTime><startedTime>1495015537574</startedTime><finishedTime>1495016384084</finishedTime>
> {code}

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message