hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6929) NN periodically unlinks lazy persist files with missing replicas from namespace
Date Wed, 01 Oct 2014 16:14:59 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14155035#comment-14155035
] 

Hudson commented on HDFS-6929:
------------------------------

FAILURE: Integrated in Hadoop-trunk-Commit #6163 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/6163/])
HDFS-6929. NN periodically unlinks lazy persist files with missing replicas from namespace.
(Arpit Agarwal) (aagarwal: rev 2e987148e02d0087fc70ce5b1ce571d3324bf1dd)
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestLazyPersistFiles.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
* hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java


> NN periodically unlinks lazy persist files with missing replicas from namespace
> -------------------------------------------------------------------------------
>
>                 Key: HDFS-6929
>                 URL: https://issues.apache.org/jira/browse/HDFS-6929
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode
>            Reporter: Arpit Agarwal
>            Assignee: Arpit Agarwal
>             Fix For: HDFS-6581
>
>         Attachments: HDFS-6929.01.patch, HDFS-6929.02.patch
>
>
> Occasional data loss is expected when using the lazy persist flag due to node restarts.
The NN will optionally unlink lazy persist files from the namespace to avoid them from showing
up as corrupt files.
> This behavior can be turned off with a global option. In the future this may be made
a per-file option controllable by the client.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message