Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 083687740 for ; Thu, 11 Aug 2011 22:27:32 +0000 (UTC) Received: (qmail 51119 invoked by uid 500); 11 Aug 2011 22:27:29 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 50940 invoked by uid 500); 11 Aug 2011 22:27:28 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 50932 invoked by uid 99); 11 Aug 2011 22:27:28 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Aug 2011 22:27:28 +0000 X-ASF-Spam-Status: No, hits=3.3 required=5.0 tests=HTML_MESSAGE,NO_RDNS_DOTCOM_HELO,RCVD_IN_DNSWL_NONE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: 216.145.54.173 is neither permitted nor denied by domain of cwimmer@yahoo-inc.com) Received: from [216.145.54.173] (HELO mrout3.yahoo.com) (216.145.54.173) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Aug 2011 22:27:22 +0000 Received: from SP2-EX07CAS04.ds.corp.yahoo.com (sp2-ex07cas04.corp.sp2.yahoo.com [98.137.59.5]) by mrout3.yahoo.com (8.14.4/8.14.4/y.out) with ESMTP id p7BMQnFw073213 for ; Thu, 11 Aug 2011 15:26:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=yahoo-inc.com; s=cobra; t=1313101609; bh=ZPCbbZa+sXDbBNHLo5ra/htP49IfEcHi9PhhT8foMLQ=; h=From:To:Date:Subject:Message-ID:In-Reply-To:Content-Type: MIME-Version; b=A0RrM5YFVdi+QenK0gUK6L8EG8c0LYVUbk1p6DaNu3Uw6s9+7UwjKUSPc2HyvLXmI 8+q5J3JJzVhR1SJITt1Aj9GkyOwdQOszHj6bSn172k4bD04Z+SBmBBwL7mQkncV6iC 95/7nCJsmYT1meoCBthjjkqkqmNvHp88qu/do7Rc= Received: from SP2-EX07VS07.ds.corp.yahoo.com ([98.137.59.26]) by SP2-EX07CAS04.ds.corp.yahoo.com ([98.137.59.5]) with mapi; Thu, 11 Aug 2011 15:26:48 -0700 From: Charles Wimmer To: "common-user@hadoop.apache.org" Date: Thu, 11 Aug 2011 15:26:48 -0700 Subject: Re: Question about RAID controllers and hadoop Thread-Topic: Question about RAID controllers and hadoop Thread-Index: AQHMWHDTnNcTnKLEYU+PUBGmmZbyGJUYhtoA//+vUKCAAFWXAP//rVvQgAABhnM= Message-ID: In-Reply-To: Accept-Language: en-US Content-Language: en X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: multipart/alternative; boundary="_000_CA69A5384FDDBcwimmeryahooinccom_" MIME-Version: 1.0 --_000_CA69A5384FDDBcwimmeryahooinccom_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable We currently use P410s in 12 disk system. Each disk is set up as a RAID0 v= olume. Performance is at least as good as a bare disk. On 8/11/11 3:23 PM, "GOEKE, MATTHEW (AG/1000)" = wrote: If I read that email chain correctly then they were referring to the classi= c JBOD vs multiple disks striped together conversation. The conversation th= at was started here is referring to JBOD vs 1 RAID 0 per disk and the effec= ts of the raid controller on those independent raids. Matt -----Original Message----- From: Kai Voigt [mailto:k@123.org] Sent: Thursday, August 11, 2011 5:17 PM To: common-user@hadoop.apache.org Subject: Re: Question about RAID controllers and hadoop Yahoo did some testing 2 years ago: http://markmail.org/message/xmzc45zi25h= tr7ry But updated benchmark would be interesting to see. Kai Am 12.08.2011 um 00:13 schrieb GOEKE, MATTHEW (AG/1000): > My assumption would be that having a set of 4 raid 0 disks would actually= be better than having a controller that allowed pure JBOD of 4 disks due t= o the cache on the controller. If anyone has any personal experience with t= his I would love to know performance numbers but our infrastructure guy is = doing tests on exactly this over the next couple days so I will pass it alo= ng once we have it. > > Matt > > -----Original Message----- > From: Bharath Mundlapudi [mailto:bharathwork@yahoo.com] > Sent: Thursday, August 11, 2011 5:00 PM > To: common-user@hadoop.apache.org > Subject: Re: Question about RAID controllers and hadoop > > True, you need a P410 controller. You can create RAID0 for each disk to m= ake it as JBOD. > > > -Bharath > > > > ________________________________ > From: Koert Kuipers > To: common-user@hadoop.apache.org > Sent: Thursday, August 11, 2011 2:50 PM > Subject: Question about RAID controllers and hadoop > > Hello all, > We are considering using low end HP proliant machines (DL160s and DL180s) > for cluster nodes. However with these machines if you want to do more tha= n 4 > hard drives then HP puts in a P410 raid controller. We would configure th= e > RAID controller to function as JBOD, by simply creating multiple RAID > volumes with one disk. Does anyone have experience with this setup? Is it= a > good idea, or am i introducing a i/o bottleneck? > Thanks for your help! > Best, Koert > This e-mail message may contain privileged and/or confidential informatio= n, and is intended to be received only by persons entitled > to receive such information. If you have received this e-mail in error, p= lease notify the sender immediately. Please delete it and > all attachments from any servers, hard drives or any other media. Other u= se of this e-mail by you is strictly prohibited. > > All e-mails and attachments sent and received are subject to monitoring, = reading and archival by Monsanto, including its > subsidiaries. The recipient of this e-mail is solely responsible for chec= king for the presence of "Viruses" or other "Malware". > Monsanto, along with its subsidiaries, accepts no liability for any damag= e caused by any such code transmitted by or accompanying > this e-mail or any attachment. > > > The information contained in this email may be subject to the export cont= rol laws and regulations of the United States, potentially > including but not limited to the Export Administration Regulations (EAR) = and sanctions regulations issued by the U.S. Department of > Treasury, Office of Foreign Asset Controls (OFAC). As a recipient of thi= s information you are obligated to comply with all > applicable U.S. export laws and regulations. > > -- Kai Voigt k@123.org --_000_CA69A5384FDDBcwimmeryahooinccom_--