hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lance Riedel <la...@dotspots.com>
Subject Re: Constantly getting DiskErrorExceptions - but logged as INFO
Date Thu, 21 May 2009 00:55:25 GMT
Thanks, found it:
http://issues.apache.org/jira/browse/HADOOP-4963

Lance

On Wed, May 20, 2009 at 8:15 AM, Lance Riedel <lance@dotspots.com> wrote:

> We're still seeing this error in our log files.  Is this an expected
> output? (the fact that it is INFO makes it seem not so bad, but anythng to
> do with DiskChecker exceptions scares me). I posted this over a week ago but
> haven't had a response.. any help?
>
> Thanks!
> lance
>
>
> On Mon, May 11, 2009 at 10:34 AM, Lance Riedel <lance@dotspots.com> wrote:
>
>> Trying to figure out what the scenario that would cause the following
>> errors. Since it is logged as INFO I wasn't sure if it was from speculative
>> execution, or if there is something more serious happening. Anyone seen
>> these errors? They occur a lot.
>>
>> Also, note: We have plenty of disk space on this machine, and we aren't
>> using /tmp - so doesn't seem like the folders would be deleted by a cron
>> job/other.
>>
>>
>> Logs:
>>
>> 2009-05-10 23:58:18,737 INFO org.apache.hadoop.mapred.TaskTracker:
>> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
>> taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
>> in any of the configured local directories
>> 2009-05-10 23:58:18,737 INFO org.apache.hadoop.mapred.TaskTracker:
>> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
>> taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
>> in any of the configured local directories
>> 2009-05-10 23:58:23,808 INFO org.apache.hadoop.mapred.TaskTracker:
>> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
>> taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
>> in any of the configured local directories
>> 2009-05-10 23:58:23,809 INFO org.apache.hadoop.mapred.TaskTracker:
>> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
>> taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
>> in any of the configured local directories
>> 2009-05-10 23:58:28,810 INFO org.apache.hadoop.mapred.TaskTracker:
>> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
>> taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
>> in any of the configured local directories
>> 2009-05-10 23:58:28,810 INFO org.apache.hadoop.mapred.TaskTracker:
>> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
>> taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
>> in any of the configured local directories
>> 2009-05-10 23:58:33,811 INFO org.apache.hadoop.mapred.TaskTracker:
>> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
>> taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
>> in any of the configured local directories
>> 2009-05-10 23:58:33,812 INFO org.apache.hadoop.mapred.TaskTracker:
>> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
>> taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
>> in any of the configured local directories
>> 2009-05-10 23:58:38,813 INFO org.apache.hadoop.mapred.TaskTracker:
>> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
>> taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
>> in any of the configured local directories
>> 2009-05-10 23:58:38,813 INFO org.apache.hadoop.mapred.TaskTracker:
>> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
>> taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
>> in any of the configured local directories
>> 2009-05-10 23:58:43,814 INFO org.apache.hadoop.mapred.TaskTracker:
>> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
>> taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
>> in any of the configured local directories
>> 2009-05-10 23:58:43,814 INFO org.apache.hadoop.mapred.TaskTracker:
>> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
>> taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
>> in any of the configured local directories
>> 2009-05-10 23:58:48,815 INFO org.apache.hadoop.mapred.TaskTracker:
>> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
>> taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
>> in any of the configured local directories
>> 2009-05-10 23:58:48,815 INFO org.apache.hadoop.mapred.TaskTracker:
>> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
>> taskTracker/jobcache/job_200905071127_3408/attempt_200905071127_3408_r_000015_1/output/file.out
>> in any of the configured local directories
>> 2009-05-10 23:58:53,816 INFO org.apache.hadoop.mapred.TaskTracker:
>> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
>> taskTracker/jobcache/job_200905071127_2997/attempt_200905071127_2997_m_000001_1/output/file.out
>> in any of the configured local directories
>>
>>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message