Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 58020EF3D for ; Wed, 30 Jan 2013 10:40:58 +0000 (UTC) Received: (qmail 43947 invoked by uid 500); 30 Jan 2013 10:40:53 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 43848 invoked by uid 500); 30 Jan 2013 10:40:53 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 43766 invoked by uid 99); 30 Jan 2013 10:40:50 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Jan 2013 10:40:50 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [98.139.212.164] (HELO nm5.bullet.mail.bf1.yahoo.com) (98.139.212.164) by apache.org (qpsmtpd/0.29) with SMTP; Wed, 30 Jan 2013 10:40:38 +0000 Received: from [98.139.215.142] by nm5.bullet.mail.bf1.yahoo.com with NNFMP; 30 Jan 2013 10:40:17 -0000 Received: from [98.139.212.229] by tm13.bullet.mail.bf1.yahoo.com with NNFMP; 30 Jan 2013 10:40:17 -0000 Received: from [127.0.0.1] by omp1038.mail.bf1.yahoo.com with NNFMP; 30 Jan 2013 10:40:17 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 370632.29792.bm@omp1038.mail.bf1.yahoo.com Received: (qmail 63181 invoked by uid 60001); 30 Jan 2013 10:40:17 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1359542417; bh=sXWpsy+q7MbQqIwWiGXIN5K0Eao9/AypnaO9A3Yk8p4=; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=1jUSFZ4jdwKIWO1v+RCDIF2DVHSrokr0eGX+/SxnxiRos9yFHRSqW/ipUGu2cojPl7kxFW1D4F8YizqWdpTyFrmLcbMaCm6MtWJ+tkbwYajq59g6ZA+uN8zKL7zc/RaaBiuzInZM/wbdXDJbdLK+XHa/rLqO+2njXh+rBXw/oMs= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=w6Hj+2z97Uk4XeAK7DVV4CiMX5ntXN+ci8QWIIW72gwMpzmYMoUsye4rNCR+Hffz1O/ajCLKNaUDLhI+Lu20vb/sbnerfmayimipa50prQQsBGjhO0pkTwPofFc8aZj9ktw0hSiP7TnukAMSU7d48oOaHTvserh6J9f3cCAukAg= ; X-YMail-OSG: WqCDxPkVM1mBx6SlC2D8UBLwLdxaowCF_7owBnH.60CX8.9 nGeHBDiw7dwIzL6MrgH0zK3QEFoURnq.E3Pzo84RPs0hstwnbFj46a2V00LO _zVAGs3Y4oQ3srnNEW_ltkaxHDD5Bl2hJozPbiRJ7Hjy4E16wjG88uXIZyxu 7WWS98kf_BJoiJ2izkMov8Zh56WHiuY6vOmusTcz9PeRIuQeKtgOV0q5K9wZ ev5vxX8N8KVsSuwFXDC_RvbGCH0TZjTL6ik0px_7zRD8C1M3NFqtT9EWIPgt f1LBQplPufd4myryNK4XyPvW94MWMyW_wJvm1a9olgpdXNil3kBJQKA0e_Ql YMMJq6mCsAXCDguR2cdkfArBE4GNOOHvoltwGKyRL5g1vPQMcaLGcqH81ETs 9t5BDYq0vLZ5kPLAIJJK3xoN7OIXwrI2nT5ia03atHSI5nFGXJP.1uvsJ2EQ FCOnj5W.siWqqoCshW6JIF4aWD2mQncmrEIzSZNmVKg0k9s_EeLCj Received: from [115.254.80.213] by web160805.mail.bf1.yahoo.com via HTTP; Wed, 30 Jan 2013 02:40:17 PST X-Rocket-MIMEInfo: 001.001,CgpJIHdhbnQgdG8gdXNlIGVpdGhlciBVQlVOVFUgb3IgUkVESEFUIC4KSSBqdXN0IHdhbnQgdG8ga25vdyBob3cgbXVjaCBzdG9yYWdlIHNwYWNlIHdlIGNhbiBhbGxvY2F0ZSBpbiBhIHNpbmdsZSBkYXRhIG5vZGUuCgpJcyB0aGVyZSBhbnkgbGltaXRhdGlvbnMgaW4gaGFkb29wIGZvciBzdG9yYWdlIGluIHNpbmdsZSBub2RlPwoKCgrCoApSZWdhcmRzLAoKSmViYQoKCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCiBGcm9tOiAiUGFtZWNoYSwgQWJoaXNoZWsiIDxhcGFtZWNoYUBlYmF5LmNvbT4BMAEBAQE- X-Mailer: YahooMailWebService/0.8.131.499 References: <1359533336.28996.YahooMailNeo@web160802.mail.bf1.yahoo.com> <2E362ACC9493D747B488241C66B3B665366E37@RHV-EXRDA-S11.corp.ebay.com> Message-ID: <1359542417.62929.YahooMailNeo@web160805.mail.bf1.yahoo.com> Date: Wed, 30 Jan 2013 02:40:17 -0800 (PST) From: jeba earnest Reply-To: jeba earnest Subject: Re: Maximum Storage size in a Single datanode To: "user@hadoop.apache.org" In-Reply-To: <2E362ACC9493D747B488241C66B3B665366E37@RHV-EXRDA-S11.corp.ebay.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="-185498972-795212437-1359542417=:62929" X-Virus-Checked: Checked by ClamAV on apache.org ---185498972-795212437-1359542417=:62929 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable =0A=0AI want to use either UBUNTU or REDHAT .=0AI just want to know how muc= h storage space we can allocate in a single data node.=0A=0AIs there any li= mitations in hadoop for storage in single node?=0A=0A=0A=0A=A0=0ARegards,= =0A=0AJeba=0A=0A=0A________________________________=0A From: "Pamecha, Abhi= shek" =0ATo: "user@hadoop.apache.org" ; jeba earnest =0ASent: Wednesday, 30 January= 2013 2:45 PM=0ASubject: Re: Maximum Storage size in a Single datanode=0A = =0A=0AWhat would be the reason you would do that?=A0=0A=0AYou would want to= leverage distributed dataset for higher availability and better response t= imes.=0A=0AThe maximum storage depends completely on the disks =A0capacity = of your nodes and what your OS supports. Typically I have heard of about 1-= 2 TB/node to start with, but I may be wrong.=0A-abhishek=0A=0AFrom: jeba ea= rnest =0AReply-To: "user@hadoop.apache.org" , jeba earnest =0ADate: Wednesday, J= anuary 30, 2013 1:38 PM=0ATo: "user@hadoop.apache.org" =0ASubject: Maximum Storage size in a Single datanode=0A=0A=0A=0A=0AHi,= =0A=0A=0A=0AIs it possible to keep 1 Petabyte in a single data node?=0A=0AI= f not, How much is the maximum storage for a particular data node? =0A=A0= =0ARegards,=0AM. Jeba ---185498972-795212437-1359542417=:62929 Content-Type: text/html; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable

I want to use either UBUNTU or REDHAT .
= I just want to know how much storage space we can allocate in a singl= e data node.

Is there any limitations in hadoop for storage in single node?


 
Regards,
Jeba=

From= : "Pamecha, Abhishek" <apamecha@ebay.com>
To: "user@hadoop.apache.org" <u= ser@hadoop.apache.org>; jeba earnest <jebaearnest@yahoo.com>
= Sent: Wednesday, 30 Januar= y 2013 2:45 PM
Subject: Re: Maximum Storage size in a Single datanode

=0A=0A =0A=0A
=0A
What would be the reason yo= u would do that? 
=0A

=0A
=0A
You would want to = leverage distributed dataset for higher availability and better response ti= mes.
=0A

=0A
=0A
The maximum storage depends complete= ly on the disks  capacity of your nodes and what your OS supports. Typ= ically I have heard of about 1-2 TB/node to start with, but I may be wrong.=
=0A
-abhishek
=0A

=0A
=0A

=0A
=0A<= span id=3D"yiv1278254586OLK_SRC_BODY_SECTION">=0A
From: jeba earnest <jebaearnest@yahoo.com>
=0AReply-To: "user@hadoop.apache.org" <user@hadoop.apache.org>, jeba earnest <jebaearnest@yahoo.com>
=0ADate: Wednesday, January 30, 2013 1:3= 8 PM
=0ATo: "user@hadoop.apache.org" <user@hadoop.apache.org>
=0ASubject: Maximum Storage size in a Single dat= anode
=0A
=0A

=0A
=0A
=0A
=0A
=0A

=0A
=0A
=0A
Hi,
=0A
= =0A
=0A
=0AIs it possible to keep 1 Petabyte in a single data node?=
=0A
=0AIf not, How much is the maximum storage for a particular da= ta node?=0A
 
=0ARegards,
=0AM. Jeba
=0A
=0A
= =0A
=0A=0A
=0A=0A


---185498972-795212437-1359542417=:62929--