hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8823) Move replication factor into individual blocks
Date Thu, 27 Aug 2015 20:16:47 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14717434#comment-14717434
] 

Hudson commented on HDFS-8823:
------------------------------

FAILURE: Integrated in Hadoop-trunk-Commit #8358 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/8358/])
HDFS-8969. Clean up findbugs warnings for HDFS-8823 and HDFS-8932. Contributed by Anu Engineer.
(wheat9: rev f97a0f8c2cdad0668a3892319f6969fafc2f04cd)
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java


> Move replication factor into individual blocks
> ----------------------------------------------
>
>                 Key: HDFS-8823
>                 URL: https://issues.apache.org/jira/browse/HDFS-8823
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Haohui Mai
>            Assignee: Haohui Mai
>             Fix For: 2.8.0
>
>         Attachments: HDFS-8823.000.patch, HDFS-8823.001.patch, HDFS-8823.002.patch, HDFS-8823.003.patch,
HDFS-8823.004.patch, HDFS-8823.005.patch, HDFS-8823.006.patch
>
>
> This jira proposes to record the replication factor in the {{BlockInfo}} class. The changes
have two advantages:
> * Decoupling the namespace and the block management layer. It is a prerequisite step
to move block management off the heap or to a separate process.
> * Increased flexibility on replicating blocks. Currently the replication factors of all
blocks have to be the same. The replication factors of these blocks are equal to the highest
replication factor across all snapshots. The changes will allow blocks in a file to have different
replication factor, potentially saving some space.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message