Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A71E4DD27 for ; Thu, 20 Dec 2012 14:40:54 +0000 (UTC) Received: (qmail 2931 invoked by uid 500); 20 Dec 2012 14:40:49 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 2847 invoked by uid 500); 20 Dec 2012 14:40:49 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 2829 invoked by uid 99); 20 Dec 2012 14:40:49 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Dec 2012 14:40:49 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of stephenf@cloudera.com designates 209.85.216.46 as permitted sender) Received: from [209.85.216.46] (HELO mail-qa0-f46.google.com) (209.85.216.46) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Dec 2012 14:40:43 +0000 Received: by mail-qa0-f46.google.com with SMTP id r4so5315407qaq.19 for ; Thu, 20 Dec 2012 06:40:23 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:x-gm-message-state; bh=gl/LRtksODmKunaGxOzet0iuGEf+f2EzNhs5Eabq3h8=; b=UKb4GOYIS5wXB+AgE8jkdulvBd5qOEV1uwe3m1q4zyjOp+WnQT177hd8DeT8iSZw5d 5B5Yo2Z2LBStS4KA3xT1bwU4mwiEqeZdlNVYIvHoF30xRGLSAmMF+udUIMZVzi9uYoJu Hx0LDnznaNWX3HSLRe2SIPcQy4P9j2pzWRms0HIfGd6OdrPMN1jANYbocdS98jDFKin1 +GxyZ3BD8LD+qikjjM6GaoL39K2lTG59s86XFNXdzBEEobnEKniNo6sChcO6nfu6+DFW fLqSMri6kIg5DphvM61h49wUj4R7pYUspy5klrF5JpS7TefnjgUIvNJFrp8UGjp8BzmS mU0g== MIME-Version: 1.0 Received: by 10.224.108.6 with SMTP id d6mr4679368qap.57.1356014422932; Thu, 20 Dec 2012 06:40:22 -0800 (PST) Received: by 10.49.51.67 with HTTP; Thu, 20 Dec 2012 06:40:22 -0800 (PST) In-Reply-To: References: Date: Thu, 20 Dec 2012 09:40:22 -0500 Message-ID: Subject: Re: Metadata size for 1 TB HDFS data? From: Stephen Fritz To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=20cf3074d7d8fd3e0704d149b563 X-Gm-Message-State: ALoCoQk3GmgwTJa9kE6rUnLsDZz2RyWR/2kt4QoVzV2ihy8ddwr+9+DZcZnXtEMca0eSmYfVThaj X-Virus-Checked: Checked by ClamAV on apache.org --20cf3074d7d8fd3e0704d149b563 Content-Type: text/plain; charset=ISO-8859-1 Each block, file, and directory is an object in the namenodes heap, so it depends on how you're storing your data. You may need to account for those in your calculations. On Thu, Dec 20, 2012 at 7:01 AM, Mohammad Tariq wrote: > Hello group, > > What could be the approx. size of the metadata if I have 1 TB of > data in my HDFS?I am not doing anything additional but just a simple put. > Will it be ((1*1024*1024)/64)*200 Bytes? > *Keeping 64M as the block size. > > Is my understanding right?Please correct me if i'm wrong. > > Many thanks. > > Best Regards, > Tariq > +91-9741563634 > https://mtariq.jux.com/ > --20cf3074d7d8fd3e0704d149b563 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Each block, file, and directory is an object in the namenodes heap, so it d= epends on how you're storing your data.=A0 You may need to account for = those in your calculations.


On Thu, D= ec 20, 2012 at 7:01 AM, Mohammad Tariq <dontariq@gmail.com>= wrote:
Hello group,

=
=A0 =A0 =A0 =A0 What could be the approx. size of the metadata if I ha= ve 1 TB of data in my HDFS?I am not doing anything additional but just a si= mple put.
Will it be ((1*1024*1024)/64)*200 Bytes?
*Keeping 64M as the block size.

Is my underst= anding right?Please correct me if i'm wrong.

M= any thanks.

--20cf3074d7d8fd3e0704d149b563--