Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 93765 invoked from network); 11 Apr 2008 01:52:29 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 11 Apr 2008 01:52:29 -0000 Received: (qmail 45518 invoked by uid 500); 11 Apr 2008 01:52:23 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 45476 invoked by uid 500); 11 Apr 2008 01:52:23 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 45467 invoked by uid 99); 11 Apr 2008 01:52:23 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Apr 2008 18:52:23 -0700 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of natecars@natecarlson.com designates 216.250.164.46 as permitted sender) Received: from [216.250.164.46] (HELO tungsten.msp.technicality.org) (216.250.164.46) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Apr 2008 01:51:39 +0000 Received: from iron.msp.technicality.org (iron.msp.technicality.org [216.250.164.48]) by tungsten.msp.technicality.org (8.14.2/8.14.2/Debian-3) with ESMTP id m3B1ppKf004340 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT) for ; Thu, 10 Apr 2008 20:51:51 -0500 Date: Thu, 10 Apr 2008 20:51:51 -0500 (CDT) From: Nate Carlson X-X-Sender: natecars@iron.msp.technicality.org To: core-user@hadoop.apache.org Subject: Re: Hadoop performance on EC2? In-Reply-To: Message-ID: References: User-Agent: Alpine 1.00 (DEB 882 2007-12-20) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Virus-Checked: Checked by ClamAV on apache.org On Thu, 10 Apr 2008, Ted Dunning wrote: > Are you trying to read from mySQL? No, we're outputting to MySQL. I've also verified that the MySQL server is hardly seeing any load, isn't waiting on slow queries, etc. > If so, it isn't very surprising that you could get lower performance > with more readers. Indeed! ------------------------------------------------------------------------ | nate carlson | natecars@natecarlson.com | http://www.natecarlson.com | | depriving some poor village of its idiot since 1981 | ------------------------------------------------------------------------