hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prabhu Joseph (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime
Date Fri, 25 Jan 2019 02:38:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16751829#comment-16751829
] 

Prabhu Joseph commented on YARN-6616:
-------------------------------------

Thanks [~eepayne] for the review. The submitTime is different from launchTime. submitTime
is the time the job is submitted to RM whereas the launchTime is the time first attempt (AM)
is launched.

{code}
1. SubmitTime is the time submitApplication is received by RM (ClientRMService) from YarnClient.
ClientRMService sets submitTime to the system time.

 // call RMAppManager to submit application directly
      rmAppManager.submitApplication(submissionContext,
System.currentTimeMillis(), user);


2. StartTime is the time set by RMAppImpl after ClientRMService validates with queue SUBMIT_APPLICATIONS.
RMAppImpl sets startTime to the system time.

if (startTime <= 0) {
this.startTime = this.systemClock.getTime();

3. LaunchTime is the time set when AM is Launched and the first attempt is launched. RMAppImpl
sets it with event timestamp when AttemptLaunchedTransition.

app.launchTime = event.getTimestamp();
{code}

submitTime <= startTime <= launchTime <= finishTime

> YARN AHS shows submitTime for jobs same as startTime
> ----------------------------------------------------
>
>                 Key: YARN-6616
>                 URL: https://issues.apache.org/jira/browse/YARN-6616
>             Project: Hadoop YARN
>          Issue Type: Bug
>    Affects Versions: 2.7.3
>            Reporter: Prabhu Joseph
>            Assignee: Prabhu Joseph
>            Priority: Minor
>         Attachments: 0001-YARN-6616.patch, 0002-YARN-6616.patch, 0003-YARN-6616.patch,
0004-YARN-6616.patch, 0005-YARN-6616.patch, 0006-YARN-6616.patch, 0007-YARN-6616.patch, 0008-YARN-6616.patch,
ApplicationReport.poc
>
>
> YARN AHS returns startTime value for both submitTime and startTime for the jobs.  Looks
the code sets the submitTime with startTime value. 
> https://github.com/apache/hadoop/blob/branch-2.7.3/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/dao/AppInfo.java#L80
> {code}
> curl --negotiate -u: http://prabhuzeppelin3.openstacklocal:8188/ws/v1/applicationhistory/apps
> <submittedTime>1495015537574</submittedTime><startedTime>1495015537574</startedTime><finishedTime>1495016384084</finishedTime>
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message