Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 461B6E672 for ; Thu, 31 Jan 2013 05:45:07 +0000 (UTC) Received: (qmail 27872 invoked by uid 500); 31 Jan 2013 05:45:02 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 27710 invoked by uid 500); 31 Jan 2013 05:45:02 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 27483 invoked by uid 99); 31 Jan 2013 05:44:52 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 31 Jan 2013 05:44:52 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of samir.helpdoc@gmail.com designates 209.85.128.180 as permitted sender) Received: from [209.85.128.180] (HELO mail-ve0-f180.google.com) (209.85.128.180) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 31 Jan 2013 05:44:45 +0000 Received: by mail-ve0-f180.google.com with SMTP id jx10so1720656veb.39 for ; Wed, 30 Jan 2013 21:44:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:date:message-id:subject:from:to :content-type; bh=4j8Msd584/wiHzVWfOyTD32NqdXXi8iutTp9m0QGcPo=; b=aKgqjOaoexntxvzoJCS89SbTtow96UFJXTX98GQuWOGfuW3rStI3rDgar1VCAWkbiH u5hEfal8+w6ds7t8MvLOP82THFa5/OSbIN69I5SCc4waMJqXhEKkqTGJ8MeoqQI48sNN XXpe2fPdH/bwxvmT9oBcWz+XyBi2/RmN2oegFtiuWLKi5EhY6dA4gTlLjPc4778zkgKO Eucfb2B7w+/l+B8IgzTVqF2qcCTBn1nGtVCWD08qsWZQJMyyuRGIZaqqce9dWQGp4TZp 8pN4XRUYNNw6uwFeCGevSoAe+yQi+Ux0xSM4/uE8J0nTn0jk85giY+3ifE2IEMph707t aojw== MIME-Version: 1.0 X-Received: by 10.52.16.65 with SMTP id e1mr6344773vdd.127.1359611065286; Wed, 30 Jan 2013 21:44:25 -0800 (PST) Received: by 10.58.28.146 with HTTP; Wed, 30 Jan 2013 21:44:25 -0800 (PST) Date: Thu, 31 Jan 2013 11:14:25 +0530 Message-ID: Subject: What is the best way to load data from one cluster to another cluster (Urgent requirement) From: samir das mohapatra To: user@hadoop.apache.org, cdh-user@cloudera.org, cdh-user@cloudera.com Content-Type: multipart/alternative; boundary=bcaec502d692943efd04d48f1e97 X-Virus-Checked: Checked by ClamAV on apache.org --bcaec502d692943efd04d48f1e97 Content-Type: text/plain; charset=ISO-8859-1 Hi All, Any one knows, how to load data from one hadoop cluster(CDH4) to another Cluster (CDH4) . They way our project needs are 1) It should be delta load or incremental load. 2) It should be based on the timestamp 3) Data volume are 5PB Any Help ???????????? Regards, samir. --bcaec502d692943efd04d48f1e97 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi All,

=A0=A0 Any o= ne knows,=A0 how to load data from one hadoop cluster(CDH4) to another Clus= ter (CDH4) . They way our project needs are
=A0=A0 1) It should= =A0 be delta load or incremental load.
=A0=A0 2) It should be based on the timestamp
=A0=A0 3)= Data volume are 5PB

Any Help ????????????

<= /div>Regards,
samir.
--bcaec502d692943efd04d48f1e97--