Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 73531107F9 for ; Mon, 29 Apr 2013 18:53:37 +0000 (UTC) Received: (qmail 40161 invoked by uid 500); 29 Apr 2013 18:53:32 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 39957 invoked by uid 500); 29 Apr 2013 18:53:32 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 39950 invoked by uid 99); 29 Apr 2013 18:53:32 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 Apr 2013 18:53:32 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW X-Spam-Check-By: apache.org Received-SPF: error (nike.apache.org: local policy) Received: from [209.85.217.179] (HELO mail-lb0-f179.google.com) (209.85.217.179) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 Apr 2013 18:53:27 +0000 Received: by mail-lb0-f179.google.com with SMTP id t10so747322lbi.10 for ; Mon, 29 Apr 2013 11:52:46 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:to:content-type:x-gm-message-state; bh=6RP4fgPwl6NkesIR3TXjQmZWr4n7dvmzAAnPs6PennE=; b=WOVb0h0e4eqliaDLp/5OtFAXhGUkAdZfpA+3rR81oklmEGLGSt5abclsgm8fMfCMRk ryJR88Fwk6bEwDqY7fBP9CfY3YvuV7HZyEig9U+UHCQWKDchQoC7ziT/B9pvzmqmF4+7 p6tTJSMaKjjhNrBhgRzdMX0nFMIXO5lJ1O7ti63VCNtd4ghmtf1osHdCCVwXM6v6Ctk1 Qwa2ahEPSJd5pYnB3YNu4Qn61B44wz/4E5gpmIlfEJqcXAx2uMT6CnkM9N3gh+S1Opil qt9SuvblN0W1gfvVUb1UmRDGj6SSrAyXpopxuXtsTw1L9gxmE90jin6RE5mu3Wr08esI v4iQ== X-Received: by 10.152.5.194 with SMTP id u2mr14082575lau.17.1367261565812; Mon, 29 Apr 2013 11:52:45 -0700 (PDT) MIME-Version: 1.0 Received: by 10.114.1.74 with HTTP; Mon, 29 Apr 2013 11:52:25 -0700 (PDT) In-Reply-To: <993F1D70-F3A3-4F63-9D30-8DC40C0C7231@turn.com> References: <1367252654.91414.YahooMailNeo@web162202.mail.bf1.yahoo.com> <993F1D70-F3A3-4F63-9D30-8DC40C0C7231@turn.com> From: Ted Dunning Date: Mon, 29 Apr 2013 11:52:25 -0700 Message-ID: Subject: Re: Hardware Selection for Hadoop To: "common-user@hadoop.apache.org" Content-Type: multipart/alternative; boundary=089e013d173af2102404db846323 X-Gm-Message-State: ALoCoQljAUAsV2JdLpwMSbVmCUL/fqfeyDnwxURfYL2BPt/Q0dbhxqxOSGqr2nDTW0TWeeO6I7zN X-Virus-Checked: Checked by ClamAV on apache.org --089e013d173af2102404db846323 Content-Type: text/plain; charset=ISO-8859-1 I think that having more than 6 drives is better. More memory never hurts. If you have too little, you may have to run with fewer slots than optimal. 10GB networking is good. If not, having more than 2 1GBe ports is good, at least on distributions that can deal with them properly. On Mon, Apr 29, 2013 at 11:49 AM, Patai Sangbutsarakum < Patai.Sangbutsarakum@turn.com> wrote: > 2 x Quad cores Intel > 2-3 TB x 6 SATA > 64GB mem > 2 NICs teaming > > my 2 cents > > > On Apr 29, 2013, at 9:24 AM, Raj Hadoop > wrote: > > Hi, > > I have to propose some hardware requirements in my company for a Proof of > Concept with Hadoop. I was reading Hadoop Operations and also saw Cloudera > Website. But just wanted to know from the group - what is the requirements > if I have to plan for a 5 node cluster. I dont know at this time, the data > that need to be processed at this time for the Proof of Concept. So - can > you suggest something to me? > > Regards, > Raj > > > --089e013d173af2102404db846323 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
I think that having more than 6 drives is better.

=
More memory never hurts. =A0If you have too little, you ma= y have to run with fewer slots than optimal.

10GB networking is good. =A0If not, having more than 2 1GBe ports is good, = at least on distributions that can deal with them properly.


On Mon, Apr 29, 2= 013 at 11:49 AM, Patai Sangbutsarakum <Patai.Sangbutsarakum@tu= rn.com> wrote:
2 x Quad cores Intel
2-3 TB x 6 SATA
64GB mem
2 NICs teaming

my 2 cents


On Apr 29, 2013, at 9:24 AM, Raj Hadoop <hadoopraj@yahoo.com>
=A0wrote:

Hi,
=A0
I have to propose some hardware requirements in my company for a Proof= of Concept with Hadoop. I was reading Hadoop Operations and also saw Cloud= era Website. But just wanted to know from the group - what is the requireme= nts if I have to plan for a 5 node cluster. I dont know at this time, the data that need= to be processed at this time for the Proof of Concept. So - can you sugges= t something to me?
=A0
Regards,
Raj


--089e013d173af2102404db846323--