hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HDFS-576) Extend Block report to include under-construction replicas
Date Fri, 04 Sep 2009 21:48:58 GMT

     [ https://issues.apache.org/jira/browse/HDFS-576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Konstantin Shvachko updated HDFS-576:
-------------------------------------

    Attachment: NewBlockReport.patch

This patch introduces 
# {{ReplicaUnderConstruction}} as a storage for non-finalized replicas in {{BlockUnderConstruction}}.
# New block-report structure. According to the specs it contains (logically) two arrays of
longs: one for  finalized replicas and another for uc-replicas.
# The two logical arrays are physically implemented as one array of longs that has a header,
containing the lengths of the two logical arrays. The logical arrays are delimited by an illegal
block.
# Data-nodes send the new block report with all finalized and uc-replicas, but not the temporary
ones.
# The preport processing logic on the name-node is not fully implemented. It is restricted
to process finalized and rwr blocks exactly as the current implementation does. The block
report processing will be implemented in the subsequent patch.

> Extend Block report to include under-construction replicas
> ----------------------------------------------------------
>
>                 Key: HDFS-576
>                 URL: https://issues.apache.org/jira/browse/HDFS-576
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: data-node, name-node
>    Affects Versions: Append Branch
>            Reporter: Konstantin Shvachko
>            Assignee: Konstantin Shvachko
>             Fix For: Append Branch
>
>         Attachments: BlockReport.htm, NewBlockReport.patch
>
>
> Current data-node block reports report only finalized (in append terminology) blocks.
Data-nodes should report all block replicas except for the temporary ones so that clients
could read from incomplete replicas and to make block recovery possible.
> The attached design document goes into more details of the new block reports.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message