hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Linden Hillenbrand <lin...@cloudera.com>
Subject Re: Copying data between Hadoop
Date Sat, 26 Nov 2011 15:57:10 GMT
I agree, distcp is the way to go here, you can specify down to the
individual directory on HDFS. Also, you can add some flags to overwrite/not
overwrite. It's pretty flexible IMO.

On Thu, Nov 24, 2011 at 6:15 AM, Uma Maheswara Rao G
<maheswara@huawei.com>wrote:

> Why con't you use distcp command here?
>
> Regards,
> Uma
> ________________________________________
> From: arindam choudhury [arindam732111@gmail.com]
> Sent: Thursday, November 24, 2011 4:38 PM
> To: common-dev@hadoop.apache.org
> Subject: Copying data between Hadoop
>
> HI,
>
> I want to copy some files from one HDFS to another. is it possible to do it
> split by split like split a1 from node a go to node b?
>
> -Arindam
>



-- 
Linden Hillenbrand
Customer Operations Engineer

Phone:  650.644.3900 x4946
Email:   linden@cloudera.com
Twitter: @lhillenbrand
Data:    http://www.cloudera.com

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message