hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lance Riedel <la...@dotspots.com>
Subject Re: Constantly getting DiskErrorExceptions - but logged as INFO
Date Wed, 20 May 2009 15:15:18 GMT
We're still seeing this error in our log files.  Is this an expected output?
(the fact that it is INFO makes it seem not so bad, but anythng to do with
DiskChecker exceptions scares me). I posted this over a week ago but haven't
had a response.. any help?

Thanks!
lance

On Mon, May 11, 2009 at 10:34 AM, Lance Riedel <lance@dotspots.com> wrote:

> Trying to figure out what the scenario that would cause the following
> errors. Since it is logged as INFO I wasn't sure if it was from speculative
> execution, or if there is something more serious happening. Anyone seen
> these errors? They occur a lot.
>
> Also, note: We have plenty of disk space on this machine, and we aren't
> using /tmp - so doesn't seem like the folders would be deleted by a cron
> job/other.
>
>
> Logs:
>
> 2009-05-10 23:58:18,737 INFO org.apache.hadoop.mapred.TaskTracker:
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
> in any of the configured local directories
> 2009-05-10 23:58:18,737 INFO org.apache.hadoop.mapred.TaskTracker:
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
> in any of the configured local directories
> 2009-05-10 23:58:23,808 INFO org.apache.hadoop.mapred.TaskTracker:
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
> in any of the configured local directories
> 2009-05-10 23:58:23,809 INFO org.apache.hadoop.mapred.TaskTracker:
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
> in any of the configured local directories
> 2009-05-10 23:58:28,810 INFO org.apache.hadoop.mapred.TaskTracker:
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
> in any of the configured local directories
> 2009-05-10 23:58:28,810 INFO org.apache.hadoop.mapred.TaskTracker:
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
> in any of the configured local directories
> 2009-05-10 23:58:33,811 INFO org.apache.hadoop.mapred.TaskTracker:
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
> in any of the configured local directories
> 2009-05-10 23:58:33,812 INFO org.apache.hadoop.mapred.TaskTracker:
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
> in any of the configured local directories
> 2009-05-10 23:58:38,813 INFO org.apache.hadoop.mapred.TaskTracker:
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
> in any of the configured local directories
> 2009-05-10 23:58:38,813 INFO org.apache.hadoop.mapred.TaskTracker:
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
> in any of the configured local directories
> 2009-05-10 23:58:43,814 INFO org.apache.hadoop.mapred.TaskTracker:
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
> in any of the configured local directories
> 2009-05-10 23:58:43,814 INFO org.apache.hadoop.mapred.TaskTracker:
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
> in any of the configured local directories
> 2009-05-10 23:58:48,815 INFO org.apache.hadoop.mapred.TaskTracker:
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
> in any of the configured local directories
> 2009-05-10 23:58:48,815 INFO org.apache.hadoop.mapred.TaskTracker:
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
> in any of the configured local directories
> 2009-05-10 23:58:53,816 INFO org.apache.hadoop.mapred.TaskTracker:
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
> in any of the configured local directories
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message