hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brahma Reddy Battula (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-12084) Scheduled will not decrement when file is deleted before all IBR's received
Date Tue, 04 Jul 2017 13:25:00 GMT

     [ https://issues.apache.org/jira/browse/HDFS-12084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Brahma Reddy Battula updated HDFS-12084:
----------------------------------------
    Description: 
When small files creation && deletion happens so frequently and DN's did not report
blocks to NN before deletion, then scheduled count will keep on increment and which will not
deleted as blocks are deleted.

*Note*: Every 20 mins,this can be rolled, but with in 20 mins, count can be more as so many
operations.
when batchIBR enabled with committed allowed=1 this will be observed more.

  was:
When small files creation && deletion happens so frequently and DN's did not report
blocks to NN before deletion, then scheduled size will keep on increment and which will not
deleted as blocks are deleted.

Note: Every 20 mins,this can be rolled, but with in 20 mins, size can be more as so many operations.
when batchIBR enabled with committed allowed=1 this will be observed more.


> Scheduled will not decrement when file is deleted before all IBR's received
> ---------------------------------------------------------------------------
>
>                 Key: HDFS-12084
>                 URL: https://issues.apache.org/jira/browse/HDFS-12084
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: namenode
>            Reporter: Brahma Reddy Battula
>            Assignee: Brahma Reddy Battula
>         Attachments: HDFS-12084-001.patch
>
>
> When small files creation && deletion happens so frequently and DN's did not
report blocks to NN before deletion, then scheduled count will keep on increment and which
will not deleted as blocks are deleted.
> *Note*: Every 20 mins,this can be rolled, but with in 20 mins, count can be more as so
many operations.
> when batchIBR enabled with committed allowed=1 this will be observed more.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message