hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinay (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-5463) NameNode should limit the number of blocks per file
Date Tue, 05 Nov 2013 13:12:21 GMT

     [ https://issues.apache.org/jira/browse/HDFS-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Vinay updated HDFS-5463:
------------------------

    Summary: NameNode should limit the number of blocks per file  (was: NameNode should limit
to number of blocks per file)

> NameNode should limit the number of blocks per file
> ---------------------------------------------------
>
>                 Key: HDFS-5463
>                 URL: https://issues.apache.org/jira/browse/HDFS-5463
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Vinay
>            Assignee: Vinay
>
> Currently there is no limit to number of blocks user can write to a file.
> And blocksize also can be set to minimum possible.
> User can write any number of blocks continously, which may create problems in NameNodes
performance and service as the number of blocks of file increases.
> Because each time new block allocated, all blocks  of the file will be persisted, and
this can cause serious performance degradation
> So proposal is to limit the number of maximum blocks a user can write to a file.
> May be 1024 blocks(if 128*MB is block size then 128 GB can be max file size)



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message