hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From nataraj jonnalagadda <nataraj.jonnalaga...@gmail.com>
Subject Re: Specifying replication factor & block size during distcp
Date Wed, 19 Aug 2015 21:31:08 GMT
Not sure if this feature is available. A workaround would be to update
replication factor and block size at the HDFS level and reverting the
changes after the distcp is complete. This is good for a one time copy. :-)


On Wed, Aug 19, 2015 at 12:52 PM, Ted Yu <yuzhihong@gmail.com> wrote:

> I looked at
> hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpOptionSwitch.java
> but didn't find such switch.
>
> FYI
>
> On Wed, Aug 19, 2015 at 12:20 PM, Varun Sharma <varun13687@gmail.com>
> wrote:
>
>> Hi,
>>
>> I am running a Distcp programmatically from Hadoop cluster to another -
>> using Hadoop 2.7 and distcp v2. I would like to set a custom block size and
>> replication factor for my files. How can I achieve that ?
>>
>> Thanks !
>> Varun
>>
>
>

Mime
View raw message