hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jian He (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1816) Succeeded application remains in accepted
Date Wed, 12 Mar 2014 20:08:43 GMT

    [ https://issues.apache.org/jira/browse/YARN-1816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13932282#comment-13932282
] 

Jian He commented on YARN-1816:
-------------------------------

The patch changed RMApp to handle  AttemptFinished event at Accepted state which may  occur
on recovery, 
Also made one more change to skip adding the app into scheduler if the final state of last
attempt is not null, meaning the attempt was already completed.

> Succeeded application remains in accepted
> -----------------------------------------
>
>                 Key: YARN-1816
>                 URL: https://issues.apache.org/jira/browse/YARN-1816
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>    Affects Versions: 2.4.0
>            Reporter: Arpit Gupta
>            Assignee: Jian He
>             Fix For: 2.4.0
>
>         Attachments: YARN-1816.1.patch
>
>
> {code}
> 2014-03-10 18:07:31,944|beaver.machine|INFO|Application-Id	    Application-Name	    Application-Type
      User	     Queue	             State	       Final-State	       Progress	             
         Tracking-URL
> 2014-03-10 18:07:31,945|beaver.machine|INFO|application_1394449508064_0008	test_mapred_ha_multiple_job_nn-rm-1-min-5-jobs_1394449960-4
           MAPREDUCE	    hrt_qa	   default	          ACCEPTED	         SUCCEEDED	        
  100%	http://hostname:19888/jobhistory/job/job_1394449508064_0008
> 2014-03-10 18:08:02,125|beaver.machine|INFO|RUNNING: /usr/bin/yarn application -list
-appStates NEW,NEW_SAVING,SUBMITTED,ACCEPTED,RUNNING
> 2014-03-10 18:08:03,198|beaver.machine|INFO|14/03/10 18:08:03 INFO client.ConfiguredRMFailoverProxyProvider:
Failing over to rm2
> 2014-03-10 18:08:03,238|beaver.machine|INFO|Total number of applications (application-types:
[] and states: [NEW, NEW_SAVING, SUBMITTED, ACCEPTED, RUNNING]):1
> 2014-03-10 18:08:03,239|beaver.machine|INFO|Application-Id	    Application-Name	    Application-Type
      User	     Queue	             State	       Final-State	       Progress	             
         Tracking-URL
> 2014-03-10 18:08:03,239|beaver.machine|INFO|application_1394449508064_0008	test_mapred_ha_multiple_job_nn-rm-1-min-5-jobs_1394449960-4
           MAPREDUCE	    hrt_qa	   default	          ACCEPTED	         SUCCEEDED	        
  100%	http://hostname:19888/jobhistory/job/job_1394449508064_0008
> 2014-03-10 18:08:33,390|beaver.machine|INFO|RUNNING: /usr/bin/yarn application -list
-appStates NEW,NEW_SAVING,SUBMITTED,ACCEPTED,RUNNING
> 2014-03-10 18:08:34,437|beaver.machine|INFO|14/03/10 18:08:34 INFO client.ConfiguredRMFailoverProxyProvider:
Failing over to rm2
> 2014-03-10 18:08:34,477|beaver.machine|INFO|Total number of applications (application-types:
[] and states: [NEW, NEW_SAVING, SUBMITTED, ACCEPTED, RUNNING]):1
> 2014-03-10 18:08:34,477|beaver.machine|INFO|Application-Id	    Application-Name	    Application-Type
      User	     Queue	             State	       Final-State	       Progress	             
         Tracking-URL
> 2014-03-10 18:08:34,478|beaver.machine|INFO|application_1394449508064_0008	test_mapred_ha_multiple_job_nn-rm-1-min-5-jobs_1394449960-4
           MAPREDUCE	    hrt_qa	   default	          ACCEPTED	         SUCCEEDED	        
  100%	http://hostname:19888/jobhistory/job/job_1394449508064_0008
> 2014-03-10 18:09:04,628|beaver.machine|INFO|RUNNING: /usr/bin/yarn application -list
-appStates NEW,NEW_SAVING,SUBMITTED,ACCEPTED,RUNNING
> 2014-03-10 18:09:05,688|beaver.machine|INFO|14/03/10 18:09:05 INFO client.ConfiguredRMFailoverProxyProvider:
Failing over to rm2
> 2014-03-10 18:09:05,728|beaver.machine|INFO|Total number of applications (application-types:
[] and states: [NEW, NEW_SAVING, SUBMITTED, ACCEPTED, RUNNING]):1
> 2014-03-10 18:09:05,728|beaver.machine|INFO|Application-Id	    Application-Name	    Application-Type
      User	     Queue	             State	       Final-State	       Progress	             
         Tracking-URL
> 2014-03-10 18:09:05,729|beaver.machine|INFO|application_1394449508064_0008	test_mapred_ha_multiple_job_nn-rm-1-min-5-jobs_1394449960-4
           MAPREDUCE	    hrt_qa	   default	          ACCEPTED	         SUCCEEDED	        
  100%	http://hostname:19888/jobhistory/job/job_1394449508064_0008
> 2014-03-10 18:09:35,879|beaver.machine|INFO|RUNNING: /usr/bin/yarn application -list
-appStates NEW,NEW_SAVING,SUBMITTED,ACCEPTED,RUNNING
> 2014-03-10 18:09:36,951|beaver.machine|INFO|14/03/10 18:09:36 INFO client.ConfiguredRMFailoverProxyProvider:
Failing over to rm2
> 2014-03-10 18:09:36,992|beaver.machine|INFO|Total number of applications (application-types:
[] and states: [NEW, NEW_SAVING, SUBMITTED, ACCEPTED, RUNNING]):1
> 2014-03-10 18:09:36,993|beaver.machine|INFO|Application-Id	    Application-Name	    Application-Type
      User	     Queue	             State	       Final-State	       Progress	             
         Tracking-URL
> 2014-03-10 18:09:36,993|beaver.machine|INFO|application_1394449508064_0008	test_mapred_ha_multiple_job_nn-rm-1-min-5-jobs_1394449960-4
           MAPREDUCE	    hrt_qa	   default	          ACCEPTED	         SUCCEEDED	        
  100%	http://hostname:19888/jobhistory/job/job_1394449508064_0008
> 2014-03-10 18:10:07,142|beaver.machine|INFO|RUNNING: /usr/bin/yarn application -list
-appStates NEW,NEW_SAVING,SUBMITTED,ACCEPTED,RUNNING
> 2014-03-10 18:10:08,201|beaver.machine|INFO|14/03/10 18:10:08 INFO client.ConfiguredRMFailoverProxyProvider:
Failing over to rm2
> 2014-03-10 18:10:08,242|beaver.machine|INFO|Total number of applications (application-types:
[] and states: [NEW, NEW_SAVING, SUBMITTED, ACCEPTED, RUNNING]):1
> 2014-03-10 18:10:08,242|beaver.machine|INFO|Application-Id	    Application-Name	    Application-Type
      User	     Queue	             State	       Final-State	       Progress	             
         Tracking-URL
> 2014-03-10 18:10:08,242|beaver.machine|INFO|application_1394449508064_0008	test_mapred_ha_multiple_job_nn-rm-1-min-5-jobs_1394449960-4
           MAPREDUCE	    hrt_qa	   default	          ACCEPTED	         SUCCEEDED	        
  100%	http://hostname:19888/jobhistory/job/job_1394449508064_0008
> 2014-03-10 18:10:38,392|beaver.machine|INFO|RUNNING: /usr/bin/yarn application -list
-appStates NEW,NEW_SAVING,SUBMITTED,ACCEPTED,RUNNING
> 2014-03-10 18:10:39,443|beaver.machine|INFO|14/03/10 18:10:39 INFO client.ConfiguredRMFailoverProxyProvider:
Failing over to rm2
> 2014-03-10 18:10:39,484|beaver.machine|INFO|Total number of applications (application-types:
[] and states: [NEW, NEW_SAVING, SUBMITTED, ACCEPTED, RUNNING]):1
> 2014-03-10 18:10:39,484|beaver.machine|INFO|Application-Id	    Application-Name	    Application-Type
      User	     Queue	             State	       Final-State	       Progress	             
         Tracking-URL
> 2014-03-10 18:10:39,485|beaver.machine|INFO|application_1394449508064_0008	test_mapred_ha_multiple_job_nn-rm-1-min-5-jobs_1394449960-4
           MAPREDUCE	    hrt_qa	   default	          ACCEPTED	         SUCCEEDED	        
  100%	http://hostname:19888/jobhistory/job/job_1394449508064_0008
> {code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message