Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 95B8FE16F for ; Thu, 31 Jan 2013 19:29:42 +0000 (UTC) Received: (qmail 7823 invoked by uid 500); 31 Jan 2013 19:29:37 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 7660 invoked by uid 500); 31 Jan 2013 19:29:37 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 7653 invoked by uid 99); 31 Jan 2013 19:29:37 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 31 Jan 2013 19:29:37 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [209.85.219.43] (HELO mail-oa0-f43.google.com) (209.85.219.43) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 31 Jan 2013 19:29:33 +0000 Received: by mail-oa0-f43.google.com with SMTP id l10so3399605oag.30 for ; Thu, 31 Jan 2013 11:29:12 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:to:content-type:x-gm-message-state; bh=FxhRz7WiM/Ek8vC5/xG1bgvegP47evzXEyA7U5qaQGI=; b=lgHp/bMZVaVOAAaZhX3J3zVtSGrdZbJOU/buAtG68HqbP2V0eoywg9ByUPMYzlqaLN JOSDmX5sd87OiMuzWRyZXDIpTKBRlUTOeX3zKXmqTzEo21O3sV/gt0IZhLJJmC6ag70Q 07ZWrNmV7uJicOvrhdb3VAEoAWrYQYhP1+n+TRtmbf8NyfuP1Jx92nK2w0s5mrWO7D/v vnrpLWvAZSTFISbIUpeBHJ4QFITBHWsGjAieddR3HR8sXzhXAx9C4xO/+rlOE9EciEEz 4jCh70fn2Ce0+4JccDlPV/1Jt9UwhsNF4zNSwr2wat9Vg+gIDvLKwfuoFYczPrjqUZ1c U58Q== X-Received: by 10.60.4.35 with SMTP id h3mr7607237oeh.123.1359660552094; Thu, 31 Jan 2013 11:29:12 -0800 (PST) MIME-Version: 1.0 Received: by 10.76.68.197 with HTTP; Thu, 31 Jan 2013 11:28:52 -0800 (PST) In-Reply-To: References: <22324_1359651197_0MHI005OM1K8FF00_99DD75DC8938B743BBBC2CA54F7224A706D67714@NYSGMBXB06.a.wcmc-ad.net> From: Ted Dunning Date: Thu, 31 Jan 2013 11:28:52 -0800 Message-ID: Subject: Re: Dell Hardware To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=e89a8ff2534a39045c04d49aa437 X-Gm-Message-State: ALoCoQnHxE8LxBKb+dCT9debHM6RcNLaKsbgAjhZQ/Qkog0qzw9cFnWOo362rt8Rbx9jtUldTUVO X-Virus-Checked: Checked by ClamAV on apache.org --e89a8ff2534a39045c04d49aa437 Content-Type: text/plain; charset=ISO-8859-1 We have tested both machines in our labs at MapR and both work well. Both run pretty hot so you need to keep a good eye on that. The R720 will have higher wattage per unit of storage due to the smaller number of drives per chassis. That may be a good match for ordinary Hadoop due to the lower I/O efficiency, but with higher performance distributions like MapR, you will probably do better on combined acquisition, ops and power costs per terabyte with the C2100 series. As you do your selection, you need to determine what your primary constraint will be. Will it be storage size? I/O rates? Compute load? Once you have that figured out, the hardware selection should fall out directly from a TCO analysis that looks at the different scenarios. On Thu, Jan 31, 2013 at 11:13 AM, Andy Isaacson wrote: > On Thu, Jan 31, 2013 at 8:53 AM, Artem Ervits wrote: > > Does anyone run Hadoop on Dell R720 model of servers? Dell site lists > C2100 > > model of servers as best fit for Hadoop workloads. What does community > > recommend? > > The R720 supports up to 2 xeon CPUs and 8 drives in 2U. If configured > appropriately it will work fine as a Hadoop node. For example, 2x > Xeon, 64GB RAM, 8x 2TB SATA configured as JBOD, would be a reasonable > worker node. Buy 20 of those and now you're cooking with gas. :) > > The C2100 is probably somewhat cheaper for a given storage amount > since it fits 12 disks in a 2U chassis (so you don't need to buy as > many machines to achieve a given amount of capacity). Dell doesn't > provide a configurator for that model so I can't compare prices. > Apparently it's using the previous generation of Xeon -- 5500/5600 > versus e5 on the R720 -- which probably means poorer throughput per > watt. > > The right answer will depend on your application and workload. > > -andy > --e89a8ff2534a39045c04d49aa437 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable We have tested both machines in our labs at MapR and both work well. =A0Bot= h run pretty hot so you need to keep a good eye on that.

The R720 will have higher wattage per unit of storage due to the smaller n= umber of drives per chassis. =A0That may be a good match for ordinary Hadoo= p due to the lower I/O efficiency, but with higher performance distribution= s like MapR, you will probably do better on combined acquisition, ops and p= ower costs per terabyte with the C2100 series.

As you do your selection, you need to determine what yo= ur primary constraint will be. =A0Will it be storage size? =A0I/O rates? = =A0Compute load?

Once you have that figured out, t= he hardware selection should fall out directly from a TCO analysis that loo= ks at the different scenarios.

On Thu, Jan 31, 2013 at 11:13 AM, Andy Isaac= son <adi@cloudera.com> wrote:
On Thu, Jan 31, 2013 at 8:53 AM, Artem Ervits <are9004@nyp.org> wrote:
> Does anyone run Hadoop on Dell R720 model of servers? Dell site lists = C2100
> model of servers as best fit for Hadoop workloads. What does community=
> recommend?

The R720 supports up to 2 xeon CPUs and 8 drives in 2U. If configured
appropriately it will work fine as a Hadoop node. For example, 2x
Xeon, 64GB RAM, 8x 2TB SATA configured as JBOD, would be a reasonable
worker node. Buy 20 of those and now you're cooking with gas. :)

The C2100 is probably somewhat cheaper for a given storage amount
since it fits 12 disks in a 2U chassis (so you don't need to buy as
many machines to achieve a given amount of capacity). Dell doesn't
provide a configurator for that model so I can't compare prices.
Apparently it's using the previous generation of Xeon -- 5500/5600
versus e5 on the R720 -- which probably means poorer throughput per
watt.

The right answer will depend on your application and workload.

-andy

--e89a8ff2534a39045c04d49aa437--