hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nishan Shetty, Huawei (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-5961) Job start time setting to "Thu Jan 01 05:29:59 IST 1970"
Date Mon, 07 Jul 2014 11:59:34 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Nishan Shetty, Huawei updated MAPREDUCE-5961:
---------------------------------------------

    Affects Version/s: 2.4.1

> Job start time setting to "Thu Jan 01 05:29:59 IST 1970"
> --------------------------------------------------------
>
>                 Key: MAPREDUCE-5961
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5961
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobhistoryserver
>    Affects Versions: 2.4.1
>            Reporter: Nishan Shetty, Huawei
>            Priority: Minor
>
> Induce RM switchover while job is in progress
> Observe that  job start time setting to "Thu Jan 01 05:29:59 IST 1970" saying below error
> {code}
> 2014-07-05 21:38:12,415 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Moving
hdfs://mycluster:8020/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0056_conf.xml
to hdfs://mycluster:8020/home/testos/staging-dir/history/done/2014/07/05/000000/job_1404572770516_0056_conf.xml
> 2014-07-05 21:41:12,289 INFO org.apache.hadoop.mapreduce.v2.hs.JobHistory: Starting scan
to move intermediate done files
> 2014-07-05 21:41:12,294 WARN org.apache.hadoop.mapreduce.v2.jobhistory.FileNameIndexUtils:
Unable to parse launch time from job history file job_1404572770516_0057-1404576372149-testos-word+count-1404576499406-85-10-SUCCEEDED-default--1.jhist
: java.lang.NumberFormatException: For input string: ""
> 2014-07-05 21:41:12,297 INFO org.apache.hadoop.mapreduce.jobhistory.JobSummary: jobId=job_1404572770516_0057,submitTime=1404576372149,launchTime=-1,firstMapTaskLaunchTime=1404576442635,firstReduceTaskLaunchTime=1404576492243,finishTime=1404576499406,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=85,numReduces=10,user=testos,queue=default,status=SUCCEEDED,mapSlotSeconds=690,reduceSlotSeconds=39,jobName=word
count
> 2014-07-05 21:41:12,298 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Deleting
JobSummary file:
> {code}
> AM LOG
> {code}
> 2014-07-05 21:38:19,432 INFO [Thread-74] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
JobHistoryEventHandler notified that forceJobCompletion is true
> 2014-07-05 21:38:19,432 INFO [Thread-74] org.apache.hadoop.mapreduce.v2.app.MRAppMaster:
Calling stop for all the services
> 2014-07-05 21:38:19,433 INFO [Thread-74] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0
> 2014-07-05 21:38:19,556 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Copying hdfs://mycluster/home/testos/staging-dir/testos/.staging/job_1404572770516_0057/job_1404572770516_0057_2.jhist
to hdfs://mycluster/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0057-1404576372149-testos-word+count-1404576499406-85-10-SUCCEEDED-default--1.jhist_tmp
> 2014-07-05 21:38:19,770 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Copied to done location: hdfs://mycluster/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0057-1404576372149-testos-word+count-1404576499406-85-10-SUCCEEDED-default--1.jhist_tmp
> 2014-07-05 21:38:19,785 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Copying hdfs://mycluster/home/testos/staging-dir/testos/.staging/job_1404572770516_0057/job_1404572770516_0057_2_conf.xml
to hdfs://mycluster/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0057_conf.xml_tmp
> 2014-07-05 21:38:19,862 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Copied to done location: hdfs://mycluster/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0057_conf.xml_tmp
> 2014-07-05 21:38:19,886 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Moved tmp to done: hdfs://mycluster/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0057.summary_tmp
to hdfs://mycluster/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0057.summary
> 2014-07-05 21:38:19,898 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Moved tmp to done: hdfs://mycluster/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0057_conf.xml_tmp
to hdfs://mycluster/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0057_conf.xml
> 2014-07-05 21:38:19,910 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Moved tmp to done: hdfs://mycluster/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0057-1404576372149-testos-word+count-1404576499406-85-10-SUCCEEDED-default--1.jhist_tmp
to hdfs://mycluster/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0057-1404576372149-testos-word+count-1404576499406-85-10-SUCCEEDED-default--1.jhist
> {code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message