Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F1445E13B for ; Wed, 30 Jan 2013 09:57:20 +0000 (UTC) Received: (qmail 99437 invoked by uid 500); 30 Jan 2013 09:57:16 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 98767 invoked by uid 500); 30 Jan 2013 09:57:15 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Delivered-To: moderator for user@hadoop.apache.org Received: (qmail 84695 invoked by uid 99); 30 Jan 2013 09:16:26 -0000 X-ASF-Spam-Status: No, hits=-2.8 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_HI X-Spam-Check-By: apache.org Received-SPF: unknown (athena.apache.org: error in processing during lookup of apamecha@ebay.com) DomainKey-Signature: s=ebaycorp; d=ebay.com; c=nofws; q=dns; h=X-EBay-Corp:X-IronPort-AV:Received:Received:From:To: Subject:Thread-Topic:Thread-Index:Date:Message-ID: In-Reply-To:Accept-Language:Content-Language: X-MS-Has-Attach:X-MS-TNEF-Correlator:user-agent: x-originating-ip:Content-Type:MIME-Version:X-CFilter-Loop; b=h5SNUr9NTt87lyPiiDSVnmtiL5D5zuUDF/FQFxL64t9Q2xn5sT9zCUek 0oAgMplSIoYgl81Z9CoTl/s+DAn6Nbt65EhdoR7m/M1kowVXHIGxaCgzZ dL3XgDL4pQmd9y0i+iwM5mDHRh/1xGn78docb3nHFwj28QjHFA0gV/ReM s=; DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=ebay.com; i=apamecha@ebay.com; q=dns/txt; s=ebaycorp; t=1359537380; x=1391073380; h=from:to:subject:date:message-id:in-reply-to:mime-version; bh=1b/FRXR18VacsFRfJHu5NkmY3KTJ0tYEeQFksoWdfGo=; b=COa/idpa0a0q3+n4/xl81nVcbitwgxnvg8RVjCBMOLspRiVBoCWSvrUJ +aAjsqrjk/Kah95YCa1NX6iWDVz4tEtjpnNdqznk3ftTENpbR3VtsLYPn h7fw0HGQc3f2v9TyR/qpNsqTMmxUzKeYnypD7cA8IobSRniBRdCAtIci8 w=; X-EBay-Corp: Yes X-IronPort-AV: E=Sophos;i="4.84,566,1355126400"; d="scan'208,217";a="104276810" From: "Pamecha, Abhishek" To: "user@hadoop.apache.org" , jeba earnest Subject: Re: Maximum Storage size in a Single datanode Thread-Topic: Maximum Storage size in a Single datanode Thread-Index: AQHN/shcph/Jodp4P0uh7fAKlX6dzphieY4A Date: Wed, 30 Jan 2013 09:15:55 +0000 Message-ID: <2E362ACC9493D747B488241C66B3B665366E37@RHV-EXRDA-S11.corp.ebay.com> In-Reply-To: <1359533336.28996.YahooMailNeo@web160802.mail.bf1.yahoo.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.2.5.121010 x-originating-ip: [10.245.27.242] Content-Type: multipart/alternative; boundary="_000_2E362ACC9493D747B488241C66B3B665366E37RHVEXRDAS11corpeb_" MIME-Version: 1.0 X-CFilter-Loop: Reflected X-Virus-Checked: Checked by ClamAV on apache.org --_000_2E362ACC9493D747B488241C66B3B665366E37RHVEXRDAS11corpeb_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable What would be the reason you would do that? You would want to leverage distributed dataset for higher availability and = better response times. The maximum storage depends completely on the disks capacity of your nodes= and what your OS supports. Typically I have heard of about 1-2 TB/node to = start with, but I may be wrong. -abhishek From: jeba earnest > Reply-To: "user@hadoop.apache.org" >, jeba earnest > Date: Wednesday, January 30, 2013 1:38 PM To: "user@hadoop.apache.org" > Subject: Maximum Storage size in a Single datanode Hi, Is it possible to keep 1 Petabyte in a single data node? If not, How much is the maximum storage for a particular data node? Regards, M. Jeba --_000_2E362ACC9493D747B488241C66B3B665366E37RHVEXRDAS11corpeb_ Content-Type: text/html; charset="us-ascii" Content-ID: Content-Transfer-Encoding: quoted-printable
What would be the reason you would do that? 

You would want to leverage distributed dataset for higher availability= and better response times.

The maximum storage depends completely on the disks  capacity of = your nodes and what your OS supports. Typically I have heard of about 1-2 T= B/node to start with, but I may be wrong.
-abhishek


From: jeba earnest <jebaearnest@yahoo.com>
Reply-To: "user@hadoop.apache.org" <user@hadoop.apache.org>, jeba earnest <= ;jebaearnest@yahoo.com>
Date: Wednesday, January 30, 2013 1= :38 PM
To: "user@hadoop.apache.org" <user@hadoop.apache.org>
Subject: Maximum Storage size in a = Single datanode


Hi,


Is it possible to keep 1 Petabyte in a single data node?
If not, How much is the maximum storage for a particular data node?
 
Regards,
M. Jeba
 --_000_2E362ACC9493D747B488241C66B3B665366E37RHVEXRDAS11corpeb_--