Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hdfs-dev@hadoop.apache.org
Date: Tue, 5 Nov 2013 13:12:21 +0000 (UTC)
From: "Vinay (JIRA)" <jira@apache.org>
To: hdfs-dev@hadoop.apache.org
Message-ID: <JIRA.12677564.1383657106762.22442.1383657141674@arcas>
In-Reply-To: <JIRA.12677564.1383657106762@arcas>
References: <JIRA.12677564.1383657106762@arcas>
Subject: [jira] [Created] (HDFS-5463) NameNode should limit to number of
 blocks per file
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Vinay created HDFS-5463:
---------------------------

             Summary: NameNode should limit to number of blocks per file
                 Key: HDFS-5463
                 URL: https://issues.apache.org/jira/browse/HDFS-5463
             Project: Hadoop HDFS
          Issue Type: Bug
            Reporter: Vinay
            Assignee: Vinay


Currently there is no limit to number of blocks user can write to a file.

And blocksize also can be set to minimum possible.

User can write any number of blocks continously, which may create problems in NameNodes performance and service as the number of blocks of file increases.
Because each time new block allocated, all blocks  of the file will be persisted, and this can cause serious performance degradation


So proposal is to limit the number of maximum blocks a user can write to a file.

May be 1024 blocks(if 128*MB is block size then 128 GB can be max file size)


--
This message was sent by Atlassian JIRA
(v6.1#6144)