hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arpit Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-5390) Incremental block reports should be sent per storage directory
Date Mon, 21 Oct 2013 22:02:45 GMT

     [ https://issues.apache.org/jira/browse/HDFS-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Arpit Agarwal updated HDFS-5390:
--------------------------------

    Attachment: h5390.03.patch

Fix BPServiceActor to track incremental BR state per storage.
Send one incremental BR for each storage to the Namenode. Ideally we'd like to send a single
message with incremental BR for all storages but it cannot be done without an incompatible
change to the protocol.

> Incremental block reports should be sent per storage directory
> --------------------------------------------------------------
>
>                 Key: HDFS-5390
>                 URL: https://issues.apache.org/jira/browse/HDFS-5390
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode
>    Affects Versions: Heterogeneous Storage (HDFS-2832)
>            Reporter: Arpit Agarwal
>            Assignee: Arpit Agarwal
>         Attachments: h5390.03.patch
>
>
> Incremental block reports should be sent per storage directory since the NameNode now
expects all block reports to be sent per storage. Currently the Datanode tracks pending incremental
block reports for all storages in a single queue.
> This is a continuation of the work started by HDFS-5134 and HDFS-4988 to split block
processing per storage directory.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message