hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lance Riedel <la...@dotspots.com>
Subject Constantly getting DiskErrorExceptions - but logged as INFO
Date Mon, 11 May 2009 17:34:52 GMT
Trying to figure out what the scenario that would cause the following
errors. Since it is logged as INFO I wasn't sure if it was from speculative
execution, or if there is something more serious happening. Anyone seen
these errors? They occur a lot.

Also, note: We have plenty of disk space on this machine, and we aren't
using /tmp - so doesn't seem like the folders would be deleted by a cron
job/other.


Logs:

2009-05-10 23:58:18,737 INFO org.apache.hadoop.mapred.TaskTracker:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
in any of the configured local directories
2009-05-10 23:58:18,737 INFO org.apache.hadoop.mapred.TaskTracker:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
in any of the configured local directories
2009-05-10 23:58:23,808 INFO org.apache.hadoop.mapred.TaskTracker:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
in any of the configured local directories
2009-05-10 23:58:23,809 INFO org.apache.hadoop.mapred.TaskTracker:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
in any of the configured local directories
2009-05-10 23:58:28,810 INFO org.apache.hadoop.mapred.TaskTracker:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
in any of the configured local directories
2009-05-10 23:58:28,810 INFO org.apache.hadoop.mapred.TaskTracker:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
in any of the configured local directories
2009-05-10 23:58:33,811 INFO org.apache.hadoop.mapred.TaskTracker:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
in any of the configured local directories
2009-05-10 23:58:33,812 INFO org.apache.hadoop.mapred.TaskTracker:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
in any of the configured local directories
2009-05-10 23:58:38,813 INFO org.apache.hadoop.mapred.TaskTracker:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
in any of the configured local directories
2009-05-10 23:58:38,813 INFO org.apache.hadoop.mapred.TaskTracker:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
in any of the configured local directories
2009-05-10 23:58:43,814 INFO org.apache.hadoop.mapred.TaskTracker:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
in any of the configured local directories
2009-05-10 23:58:43,814 INFO org.apache.hadoop.mapred.TaskTracker:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
in any of the configured local directories
2009-05-10 23:58:48,815 INFO org.apache.hadoop.mapred.TaskTracker:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
in any of the configured local directories
2009-05-10 23:58:48,815 INFO org.apache.hadoop.mapred.TaskTracker:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
in any of the configured local directories
2009-05-10 23:58:53,816 INFO org.apache.hadoop.mapred.TaskTracker:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
in any of the configured local directories

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message