hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Todd Lipcon <t...@cloudera.com>
Subject Re: DiskErrorException and Error reading task output
Date Sun, 19 Jul 2009 03:01:30 GMT
Hi Akhil,

Your mapred.local.dir is pointing to a directory which either does not have
permissions for the user running the daemon, or has been removed. Check that
configuration variable and make sure it's pointing to a directory that's
writable by the hadoop user.

-Todd

On Sat, Jul 18, 2009 at 3:32 PM, akhil1988 <akhilanger@gmail.com> wrote:

>
> Hi All,
>
> Can anyone tell when does one get these errors?
>
> Error initializing attempt_200907151459_0096_m_000001_1:
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any
> valid local directory for
> taskTracker/jobcache/job_200907151459_0096/job.xml
>        at
>
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:335)
>        at
>
> org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:124)
>        at
> org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:729)
>        at
> org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1656)
>        at
> org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:102)
>        at
>
> org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1621)
>
> 09/07/18 17:12:04 WARN mapred.JobClient: Error reading task
> outputhttp://
> cn83.cloud.cs.illinois.edu:50003/tasklog?plaintext=true&taskid=attempt_200907151459_0096_m_000001_1&filter=stdout
> 09/07/18<http://cn83.cloud.cs.illinois.edu:50003/tasklog?plaintext=true&taskid=attempt_200907151459_0096_m_000001_1&filter=stdout%0A09/07/18>17:12:04
WARN mapred.JobClient: Error reading task
> outputhttp://
> cn83.cloud.cs.illinois.edu:50003/tasklog?plaintext=true&taskid=attempt_200907151459_0096_m_000001_1&filter=stderr
>
>
> After few error messages like this, the job fails.
>
> Thanks,
> Akhil
>
> --
> View this message in context:
> http://www.nabble.com/DiskErrorException-and-Error-reading-task-output-tp24552396p24552396.html
> Sent from the Hadoop core-user mailing list archive at Nabble.com.
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message