Return-Path: X-Original-To: apmail-hadoop-general-archive@minotaur.apache.org Delivered-To: apmail-hadoop-general-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F2E576FF1 for ; Sat, 18 Jun 2011 06:11:55 +0000 (UTC) Received: (qmail 64851 invoked by uid 500); 18 Jun 2011 06:11:54 -0000 Delivered-To: apmail-hadoop-general-archive@hadoop.apache.org Received: (qmail 64738 invoked by uid 500); 18 Jun 2011 06:11:53 -0000 Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@hadoop.apache.org Delivered-To: mailing list general@hadoop.apache.org Received: (qmail 64728 invoked by uid 99); 18 Jun 2011 06:11:52 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Jun 2011 06:11:52 +0000 X-ASF-Spam-Status: No, hits=0.7 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: 216.145.54.173 is neither permitted nor denied by domain of eric14@yahoo-inc.com) Received: from [216.145.54.173] (HELO mrout3.yahoo.com) (216.145.54.173) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Jun 2011 06:11:39 +0000 Received: from [10.0.1.3] (snvvpn4-10-72-168-c87.hq.corp.yahoo.com [10.72.168.87]) by mrout3.yahoo.com (8.13.8/8.13.8/y.out) with ESMTP id p5I6AY7Q094629 for ; Fri, 17 Jun 2011 23:10:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=yahoo-inc.com; s=cobra; t=1308377435; bh=+yRlYQBEJCdtrlVNFzr+WnSgXwffZieS1ybdpGPEa/U=; h=Content-Type:Mime-Version:Subject:From:In-Reply-To:Date: Content-Transfer-Encoding:Message-Id:References:To; b=qOUi30pM2POHjje6KlcDZvNpFLNY/c8HHXDVUQqlAGpPk9Qx9COBzAtqyg1b9iR3U y6JlDBf6Zc7OPYaHcUluPZT7BIRmWrAVzWdblvpFc2vxyIoFIUUgyAMSSuENa7eFiQ g0YgHE93Uxr4UBPdSxgEoFDbYCgMMkpbB10k2YlM= Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Apple Message framework v1084) Subject: Re: Thinking about the next hadoop mainline release From: Eric Baldeschwieler In-Reply-To: <43D4BB64-1B14-45F6-941B-B65F31636266@apache.org> Date: Fri, 17 Jun 2011 23:10:33 -0700 Content-Transfer-Encoding: quoted-printable Message-Id: <76BC80C1-7A3B-4B80-93C2-DBF1EF3152F0@yahoo-inc.com> References: <43D4BB64-1B14-45F6-941B-B65F31636266@apache.org> To: "general@hadoop.apache.org" X-Mailer: Apple Mail (2.1084) Hey Allen, I agree with you that we should avoid future regressions like this. I = think the tradeoff that got security working well on one heavily used = platform was the right one for hadoop-with-security, but I'll be sure to = raise such issues for discussion in the future as soon as I become aware = of them. I agree that we should think about how to generalize the security work = for other platforms. That work is just waiting for someone to jump = in.... On ganglia and the metrics framework, it would be great if you could put = your head together with rajive and come up with a joint proposal on what = docs / code is needed to fix the regression in a clean way. That sounds = like something we should be thinking about fixing in the 20 line and all = future releases. thanks, E14 On Jun 17, 2011, at 10:33 AM, Allen Wittenauer wrote: >=20 > On Jun 17, 2011, at 12:36 AM, Ryan Rawson wrote: >=20 >> HDFS-918 and HDFS-347 are absolutely critical for random read >> performance. The smarter sites are already running HDFS-347 (I guess >> they aren't running "Hadoop" then?), and soon they will be testing = and >> running HDFS-918 as well. Opening 1 socket for every read just isn't >> really scalable. >=20 > Isn't "random read [on HDFS]" and "smarter sites" in the same = breath an oxymoron? >=20 >=20