hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jing Zhao (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-7076) Persist Block Storage Policy in FSImage and Edit Log
Date Wed, 24 Sep 2014 19:04:34 GMT

     [ https://issues.apache.org/jira/browse/HDFS-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jing Zhao updated HDFS-7076:
----------------------------
    Attachment: HDFS-7076.001.patch
                editsStored

Rebase the patch after HDFS-7081 got committed.

> Persist Block Storage Policy in FSImage and Edit Log
> ----------------------------------------------------
>
>                 Key: HDFS-7076
>                 URL: https://issues.apache.org/jira/browse/HDFS-7076
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: balancer, namenode
>            Reporter: Jing Zhao
>            Assignee: Jing Zhao
>         Attachments: HDFS-7076.000.patch, HDFS-7076.001.patch, editsStored
>
>
> Currently block storage policies are loaded from a XML file. This may lead to policy
inconsistency if the content of the XML gets modified or if the XML file is replaced by mistake.
Thus it is better to persist policies in editlog/fsimage.
> Specifically we plan to do the following in this jira:
> # Add new DistributedFileSystem API for getting all the existing storage policies
> # Add new DistributedFileSystem/HdfsAdmin API for adding a new storage policy. The new
storage policy is then persisted in editlog and later fsimage while checkpointing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message