hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Daniel Haviv <danielru...@gmail.com>
Subject Re: Copy data between clusters during the job execution.
Date Mon, 02 Feb 2015 10:20:40 GMT
You can use distcp

Daniel

> On 2 בפבר׳ 2015, at 11:12, xeon Mailinglist <xeonmailinglist@gmail.com> wrote:
> 
> Hi
> 
> I want to have a job that copies the map output, or the reduce output to another hdfs.
Is is possible?
> 
> E.g., the job runs in cluster 1 and takes the input from this cluster.  Then, before
the job finishes, it copies the map output or the reduce output to the hdfs in the cluster
2.
> 
> Thanks,

Mime
View raw message