hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "yuan kui" <zhenhe...@gmail.com>
Subject The distributed cache object hdfs://xxxxxxxx changed during the job from TIMESTAMP to TIMESTAMP
Date Fri, 24 Feb 2012 01:52:31 GMT
Hi,all
I was running a hbase bulkload job with ImportTsv.jar when I got an Exception:


-----------------------------------------------
12/02/24 08:05:42 INFO mapred.JobClient: Running job: job_201202092344_617328
12/02/24 08:05:43 INFO mapred.JobClient:  map 0% reduce 0% 
12/02/24 08:06:52 INFO mapred.JobClient: Task Id : attempt_201202092344_617328_m_000000_0,
Status : FAILED
Error initializing attempt_201202092344_617328_m_000000_0:
java.io.IOException: The distributed cache object hdfs://dump002002.cm8:9000/user/admin/partitions_1330041940677#_partition.lst
changed during the job from 2/24/12 8:05 AM to 2/24/12 8:06 AM
    at org.apache.hadoop.filecache.TrackerDistributedCacheManager.downloadCacheObject(TrackerDistributedCacheManager.java:391)
    at org.apache.hadoop.filecache.TrackerDistributedCacheManager.localizePublicCacheObject(TrackerDistributedCacheManager.java:465)
    at org.apache.hadoop.filecache.TrackerDistributedCacheManager.getLocalCache(TrackerDistributedCacheManager.java:191)
    at org.apache.hadoop.filecache.TaskDistributedCacheManager.setupCache(TaskDistributedCacheManager.java:183)
    at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1184)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
    at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1175)
    at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1090)
    at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:2291)
    at org.apache.hadoop.mapred.TaskTracker$StartNewTask.run(TaskTracker.java:2136)

12/02/24 08:06:52 WARN mapred.JobClient: Error reading task outputhttp://dump002102.cm8:50060/tasklog?plaintext=true&attemptid=attempt_201202092344_617328_m_000000_0&filter=stdout
12/02/24 08:06:52 WARN mapred.JobClient: Error reading task outputhttp://dump002102.cm8:50060/tasklog?plaintext=true&attemptid=attempt_201202092344_617328_m_000000_0&filter=stderr
12/02/24 08:06:52 INFO mapred.JobClient: Task Id : attempt_201202092344_617328_m_000001_0,
Status : FAILED
Error initializing attempt_201202092344_617328_m_000001_0:
java.io.IOException: The distributed cache object hdfs://dump002002.cm8:9000/user/admin/partitions_1330041940677#_partition.lst
changed during the job from 2/24/12 8:05 AM to 2/24/12 8:06 AM
    at org.apache.hadoop.filecache.TrackerDistributedCacheManager.downloadCacheObject(TrackerDistributedCacheManager.java:391)
    at org.apache.hadoop.filecache.TrackerDistributedCacheManager.localizePublicCacheObject(TrackerDistributedCacheManager.java:465)
    at org.apache.hadoop.filecache.TrackerDistributedCacheManager.getLocalCache(TrackerDistributedCacheManager.java:191)
    at org.apache.hadoop.filecache.TaskDistributedCacheManager.setupCache(TaskDistributedCacheManager.java:183)
    at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1184)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
    at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1175)
    at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1090)
    at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:2291)
---------------------------------------------------------------------

Although the same job may run successfully later again. But failure Makes me miserable.
Is this a hadoop bug? How to avoid this?


Mime
View raw message