hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7076) Persist Block Storage Policy in FSImage and Edit Log
Date Thu, 25 Sep 2014 02:52:34 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14147289#comment-14147289
] 

Hadoop QA commented on HDFS-7076:
---------------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12671095/HDFS-7076.002.patch
  against trunk revision 116f831.

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:green}+1 tests included{color}.  The patch appears to include 7 new or modified
test files.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of
javac compiler warnings.

    {color:green}+1 javadoc{color}.  There were no new javadoc warning messages.

    {color:green}+1 eclipse:eclipse{color}.  The patch built with eclipse:eclipse.

    {color:green}+1 findbugs{color}.  The patch does not introduce any new Findbugs (version
2.0.3) warnings.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number
of release audit warnings.

    {color:red}-1 core tests{color}.  The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs:

                  org.apache.hadoop.hdfs.TestEncryptionZonesWithKMS
                  org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
                  org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer

    {color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/8192//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/8192//console

This message is automatically generated.

> Persist Block Storage Policy in FSImage and Edit Log
> ----------------------------------------------------
>
>                 Key: HDFS-7076
>                 URL: https://issues.apache.org/jira/browse/HDFS-7076
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: balancer, namenode
>            Reporter: Jing Zhao
>            Assignee: Jing Zhao
>         Attachments: HDFS-7076.000.patch, HDFS-7076.001.patch, HDFS-7076.002.patch, editsStored
>
>
> Currently block storage policies are loaded from a XML file. This may lead to policy
inconsistency if the content of the XML gets modified or if the XML file is replaced by mistake.
Thus it is better to persist policies in editlog/fsimage.
> Specifically we plan to do the following in this jira:
> # Add new DistributedFileSystem API for getting all the existing storage policies
> # Add new DistributedFileSystem/HdfsAdmin API for adding a new storage policy. The new
storage policy is then persisted in editlog and later fsimage while checkpointing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message