hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jitendra Nath Pandey (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6929) NN periodically unlinks lazy persist files with missing replicas from namespace
Date Mon, 25 Aug 2014 22:00:58 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14109830#comment-14109830
] 

Jitendra Nath Pandey commented on HDFS-6929:
--------------------------------------------

Does this patch add the global config to disable the scrubbing of corrupted lazy-persist files
or is it planned for a later patch?

> NN periodically unlinks lazy persist files with missing replicas from namespace
> -------------------------------------------------------------------------------
>
>                 Key: HDFS-6929
>                 URL: https://issues.apache.org/jira/browse/HDFS-6929
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode
>            Reporter: Arpit Agarwal
>            Assignee: Arpit Agarwal
>             Fix For: HDFS-6581
>
>         Attachments: HDFS-6929.01.patch
>
>
> Occasional data loss is expected when using the lazy persist flag due to node restarts.
The NN will optionally unlink lazy persist files from the namespace to avoid them from showing
up as corrupt files.
> This behavior can be turned off with a global option. In the future this may be made
a per-file option controllable by the client.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message