Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of stutiawasthi@hcl.com designates
 203.105.185.23 as permitted sender)
From: Stuti Awasthi <stutiawasthi@hcl.com>
To: "user@hadoop.apache.org" <user@hadoop.apache.org>
Date: Tue, 25 Sep 2012 11:28:59 +0530
Subject: Copying directories using distcp
Thread-Topic: Copying directories using distcp
Thread-Index: Ac2a4gKfWhxDg4q6TzyMSuUEfTJRgA==
Message-ID: 
 <50CFD234CC7D3A4EA1E8910D3866F70004419B8D47@NDA-HCLC-EVS02.HCLC.CORP.HCL.IN>
Accept-Language: en-US
Content-Language: en-US
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: quoted-printable

Hi all,

I have data in S3 bucket in different folders and want to copy to HDFS dire=
ctly . I used Distcp to copy files to HDFS by specifying complete s3 path o=
f the file.
I have 2 queries :

1. Can I copy the entire folder from S3 to HDFS using distcp.
2. Can I generate the exact input folder replica on HDFS as destination fol=
der.

I tried using -f <uri_list> but in that also, I need to provide the complet=
e path of the S3 files.
Please suggest

Stuti


::DISCLAIMER::
---------------------------------------------------------------------------=
-------------------------------------------------------------------------

The contents of this e-mail and any attachment(s) are confidential and inte=
nded for the named recipient(s) only.
E-mail transmission is not guaranteed to be secure or error-free as informa=
tion could be intercepted, corrupted,
lost, destroyed, arrive late or incomplete, or may contain viruses in trans=
mission. The e mail and its contents
(with or without referred errors) shall therefore not attach any liability =
on the originator or HCL or its affiliates.
Views or opinions, if any, presented in this email are solely those of the =
author and may not necessarily reflect the
views or opinions of HCL or its affiliates. Any form of reproduction, disse=
mination, copying, disclosure, modification,
distribution and / or publication of this message without the prior written=
 consent of authorized representative of
HCL is strictly prohibited. If you have received this email in error please=
 delete it and notify the sender immediately.
Before opening any email and/or attachments, please check them for viruses =
and other defects.

---------------------------------------------------------------------------=
-------------------------------------------------------------------------