Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BB8A010220 for ; Thu, 5 Sep 2013 17:18:49 +0000 (UTC) Received: (qmail 18163 invoked by uid 500); 5 Sep 2013 17:18:44 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 17717 invoked by uid 500); 5 Sep 2013 17:18:44 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 17708 invoked by uid 99); 5 Sep 2013 17:18:43 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Sep 2013 17:18:43 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jayamviswanathan@gmail.com designates 209.85.160.41 as permitted sender) Received: from [209.85.160.41] (HELO mail-pb0-f41.google.com) (209.85.160.41) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Sep 2013 17:18:38 +0000 Received: by mail-pb0-f41.google.com with SMTP id rp2so2056225pbb.28 for ; Thu, 05 Sep 2013 10:18:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=Qu3sLAvGjQks9MbcGN7O4TR9/PPk4d4hCLFs7iNyh64=; b=bi0ib7bjtT5X+keoUqH4GfXzYhS08oyWRef7lvM2UzAfVC2lQy8Phc9LncSqo1g+QM IXO1HOgl/V+nmDTmjLOy4rX5KwSx+6ERPhV1BDnvyDtWdRQYYZ9fWe0Ah+igVNsJ1cdd 5Z/z9LkYuOdYhYeoTBmi6T7OXUJxhMZp5XC+WQLmRSr0gKe5Z7OSm8PxAsL+PM4/N2Fa Zo6y6t4Gl3ZPUyZubxjEzA6QqQPs0NpcLX1a2mYQ1UTncunUdOF47jgACboC84bPf1H9 Ec45RK/oUD2oceWT0rHYzU4K58IIGSQ3LP1S7OK+mqTTDfufEBSTKEKx4iknJ1NAf1wi zePQ== MIME-Version: 1.0 X-Received: by 10.66.27.143 with SMTP id t15mr10302417pag.171.1378401498015; Thu, 05 Sep 2013 10:18:18 -0700 (PDT) Received: by 10.70.130.229 with HTTP; Thu, 5 Sep 2013 10:18:17 -0700 (PDT) Received: by 10.70.130.229 with HTTP; Thu, 5 Sep 2013 10:18:17 -0700 (PDT) Date: Thu, 5 Sep 2013 22:48:17 +0530 Message-ID: Subject: Disc not equally utilized in hdfs data nodes From: Viswanathan J To: "user@hadoop.apache.org" , Harsh J Content-Type: multipart/alternative; boundary=bcaec52bea19a5abfd04e5a61b72 X-Virus-Checked: Checked by ClamAV on apache.org --bcaec52bea19a5abfd04e5a61b72 Content-Type: text/plain; charset=ISO-8859-1 Hi, The data which are storing in data nodes are not equally utilized in all the data directories. We having 4x1 TB drives, but huge data storing in single disc only at all the nodes. How to balance for utilize all the drives. This causes the hdfs storage size becomes high very soon even though we have available space. Thanks, Viswa.J --bcaec52bea19a5abfd04e5a61b72 Content-Type: text/html; charset=ISO-8859-1

Hi,

The data which are storing in data nodes are not equally utilized in all the data directories.

We having 4x1 TB drives, but huge data storing in single disc only at all the nodes. How to balance for utilize all the drives.

This causes the hdfs storage size becomes high very soon even though we have available space.

Thanks,
Viswa.J

--bcaec52bea19a5abfd04e5a61b72--