hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dan Young <danoyo...@gmail.com>
Subject Re: Loading data from S3
Date Wed, 08 Aug 2012 13:24:16 GMT
Have you looked into s3distcp ?

Regards ,

Dano
On Aug 8, 2012 7:21 AM, "prem yadav" <ipremyadav@gmail.com> wrote:

> Hi,
> I recently used a backup tool to back up all my HDFS data to S3. The data
> is on S3 in multiparts.
> I need to test the restore now. Could you please give me some pointers on
> how to test this.
>
> 1) Do I need to create another cluster? The data is around 3 TB in size.
> 2) How do I upload multipart data from S3 to HDFS cluster?
>
>
> regards,
> Prem
>
>

Mime
View raw message