hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinay (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-5463) NameNode should limit to number of blocks per file
Date Tue, 05 Nov 2013 13:12:21 GMT
Vinay created HDFS-5463:
---------------------------

             Summary: NameNode should limit to number of blocks per file
                 Key: HDFS-5463
                 URL: https://issues.apache.org/jira/browse/HDFS-5463
             Project: Hadoop HDFS
          Issue Type: Bug
            Reporter: Vinay
            Assignee: Vinay


Currently there is no limit to number of blocks user can write to a file.

And blocksize also can be set to minimum possible.

User can write any number of blocks continously, which may create problems in NameNodes performance
and service as the number of blocks of file increases.
Because each time new block allocated, all blocks  of the file will be persisted, and this
can cause serious performance degradation


So proposal is to limit the number of maximum blocks a user can write to a file.

May be 1024 blocks(if 128*MB is block size then 128 GB can be max file size)



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message