hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Allen Wittenauer ...@apache.org>
Subject Re: "No space left on device" and "Could not find any valid local directory for taskTracker/jobcache/"
Date Thu, 23 Jun 2011 19:14:28 GMT

On Jun 23, 2011, at 7:09 AM, Virajith Jalaparti wrote:

> Hi,
> I am trying to run a sort job (from hadoop-0.20.2-examples.jar) on 50GB of
> data (generated using randomwriter). I am using hadoop-0.20.2 on a cluster
> of 3 machines with one machine serving as the master and the other two as
> slaves.
> I get the following errors for various the task attempts:
> Error: java.io.IOException: No space left on device
>        at java.io.FileOutputStream.writeBytes(Native Method)
>        at java.io.FileOutputStream.write(FileOutputStream.java:282)
>        at
> org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.write(RawLocalFileSystem.java:190)

	This usually means you're out of temp mapred space.

> /mnt/ is on a local disk at each node in my cluster and it is just 17% full
> with a total disk capacity of around 220GB. Each of the above directories
> are created with read/write permissions.

	Watch how much space you have while the jobs are running.
View raw message