Return-Path: Delivered-To: apmail-hadoop-zookeeper-user-archive@minotaur.apache.org Received: (qmail 5889 invoked from network); 10 Nov 2009 17:16:26 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 10 Nov 2009 17:16:26 -0000 Received: (qmail 18447 invoked by uid 500); 10 Nov 2009 17:16:25 -0000 Delivered-To: apmail-hadoop-zookeeper-user-archive@hadoop.apache.org Received: (qmail 18372 invoked by uid 500); 10 Nov 2009 17:16:25 -0000 Mailing-List: contact zookeeper-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: zookeeper-user@hadoop.apache.org Delivered-To: mailing list zookeeper-user@hadoop.apache.org Received: (qmail 18362 invoked by uid 99); 10 Nov 2009 17:16:24 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Nov 2009 17:16:24 +0000 X-ASF-Spam-Status: No, hits=-2.9 required=5.0 tests=AWL,BAYES_00,HTML_MESSAGE X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ted.dunning@gmail.com designates 209.85.222.195 as permitted sender) Received: from [209.85.222.195] (HELO mail-pz0-f195.google.com) (209.85.222.195) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Nov 2009 17:16:22 +0000 Received: by pzk33 with SMTP id 33so150100pzk.2 for ; Tue, 10 Nov 2009 09:16:02 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :from:date:message-id:subject:to:content-type; bh=FgKL8CKuCLXlC3x3OLAhH+AzbnTTWoR2JHK0PxvxlL0=; b=S+sJOtpIgLMkuSsBchaNH1XC2dDjL0omcyusX/474LJdQ5YY5I4Lw07IoiscXeEWPW 000CGvjAF6nYsbFdUmDwtTO2rKnWOarqFyWGofav1qZTliLXPIGAYmaY8mtAkuDPmW0W OUAjwHk4W0YJoSobd1FV3Nj2fRdSIiGcSjNi4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; b=S/JyfcLaqWyCJxpnd2jTasMk1B/3IDSntTdaJ4zULrNM2PxcG/ZAxhc6HTcwq7Iq3U Hxh75VBGSGWax91j4DWbkfU/UGwIBDBXRYnMx8frbradn+rhbSCRfRxA7DrTtfhAjBCY gZkpccPkDdbsKZ6nlLMK0zR+b9RXt5kiqmxbQ= MIME-Version: 1.0 Received: by 10.115.101.18 with SMTP id d18mr544222wam.191.1257873357087; Tue, 10 Nov 2009 09:15:57 -0800 (PST) In-Reply-To: <4AF8FE63.4060905@apache.org> References: <4AF8B9DF.50002@apache.org> <4AF8FE63.4060905@apache.org> From: Ted Dunning Date: Tue, 10 Nov 2009 09:15:37 -0800 Message-ID: Subject: Re: ZK on EC2 To: zookeeper-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=0016e64b96de9f24fe0478077613 --0016e64b96de9f24fe0478077613 Content-Type: text/plain; charset=UTF-8 I only have one large instance live. My impression from previously is that between host bandwidth is generally about what you saw. We have been able to sustain 20-30MB/s into EC2 to a single node which should be harder than moving data between nodes. I have heard rumors that others were able to get double what I got for incoming transfer. On Mon, Nov 9, 2009 at 9:47 PM, Patrick Hunt wrote: > Could you test networking - scping data between hosts? (I was seeing > 64.1MB/s for a 512mb file - the one created by dd, random data) > -- Ted Dunning, CTO DeepDyve --0016e64b96de9f24fe0478077613--