hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: REG:error details(temporary directory does not exist)
Date Wed, 21 Dec 2011 09:55:39 GMT
Hey Jayaseelan,

You can't distcp to a file:// destination URI, unless that location is a NFS point commonly
available across all your nodes.

What you probably need for 3 GB worth of data is a simple "hadoop fs -copyToLocal src dest"

On 21-Dec-2011, at 12:20 PM, Jayaseelan E wrote:

> Hi Folks!
> I am have some 40 folders whose size of each folders are aproximately 3GB.I used distcp
command to take a copy from HDFS to local machine.
> But it fails with the following error.
> /opt/hadoop/bin/hadoop distcp   hdfs://bl460x1890:9000/<<Source location>>
> java.io.IOException: The temporary job-output directory file:/archive/_distcp_logs_ndyr8m/_temporarydoesn't
>         at org.apache.hadoop.mapred.FileOutputCommitter.getWorkPath(FileOutputCommitter.java:204)
>         at org.apache.hadoop.mapred.FileOutputFormat.getTaskOutputPath(FileOutputFormat.java:234)
> My hadoop version is 2.0.1
> If any one can please help me resolve this
> Thanks indeed
> jayaseelan

View raw message