Return-Path: 
 <common-user-return-16562-apmail-hadoop-common-user-archive=hadoop.apache.org@hadoop.apache.org>
Delivered-To: apmail-hadoop-common-user-archive@www.apache.org
Received: (qmail 26522 invoked from network); 5 Aug 2009 17:38:40 -0000
Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3)
  by minotaur.apache.org with SMTP; 5 Aug 2009 17:38:40 -0000
Received: (qmail 57975 invoked by uid 500); 5 Aug 2009 17:28:36 -0000
Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org
Received: (qmail 57947 invoked by uid 500); 5 Aug 2009 17:28:36 -0000
Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-user@hadoop.apache.org>
List-Id: <common-user.hadoop.apache.org>
Reply-To: common-user@hadoop.apache.org
Delivered-To: mailing list common-user@hadoop.apache.org
Received: (qmail 57897 invoked by uid 500); 5 Aug 2009 17:28:35 -0000
Delivered-To: apmail-hadoop-core-user@hadoop.apache.org
Received: (qmail 57892 invoked by uid 99); 5 Aug 2009 17:28:35 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Aug 2009 17:28:35 +0000
X-ASF-Spam-Status: No, hits=3.4 required=10.0
	tests=HTML_MESSAGE,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Received: from [209.85.221.188] (HELO mail-qy0-f188.google.com)
 (209.85.221.188)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Aug 2009 17:28:23 +0000
Received: by qyk26 with SMTP id 26so253822qyk.5
        for <multiple recipients>; Wed, 05 Aug 2009 10:28:02 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.224.54.3 with SMTP id o3mr7388424qag.92.1249493282124;
 Wed, 05
	Aug 2009 10:28:02 -0700 (PDT)
In-Reply-To: <bcaf338a0908032015h41cff744l1b0f74ea60cc32df@mail.gmail.com>
References: <bcaf338a0908032015h41cff744l1b0f74ea60cc32df@mail.gmail.com>
From: Aaron Kimball <aaron@cloudera.com>
Date: Wed, 5 Aug 2009 10:27:42 -0700
Message-ID: <d6d7c4410908051027y22f68eb5ufa9989be16d3e846@mail.gmail.com>
Subject: Re: how to dump data from a mysql cluster to hdfs?
To: common-user@hadoop.apache.org
Cc: core-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=0015175d67723af325047068535b
X-Virus-Checked: Checked by ClamAV on apache.org

--0015175d67723af325047068535b
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

mysqldump to local files on all 50 nodes, scp them to datanodes, and then
bin/hadoop fs -put?
- Aaron

On Mon, Aug 3, 2009 at 8:15 PM, Min Zhou <coderplay@gmail.com> wrote:

> hi all,
>
> We need to dump data from a mysql cluster with about 50 nodes to a hdfs
> file. Considered about the issues on security , we can't use tools like
> sqoop, where all datanodes must hold a connection to mysql. any
> suggestions?
>
>
> Thanks,
> Min
> --
> My research interests are distributed systems, parallel computing and
> bytecode based virtual machine.
>
> My profile:
> http://www.linkedin.com/in/coderplay
> My blog:
> http://coderplay.javaeye.com
>

--0015175d67723af325047068535b--