hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arpit Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-6929) NN periodically unlinks lazy persist files with missing replicas from namespace
Date Tue, 26 Aug 2014 20:09:59 GMT

     [ https://issues.apache.org/jira/browse/HDFS-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Arpit Agarwal updated HDFS-6929:
--------------------------------

    Attachment: HDFS-6929.02.patch

Updated patch to allow turning off the scrubber, document the option.

> NN periodically unlinks lazy persist files with missing replicas from namespace
> -------------------------------------------------------------------------------
>
>                 Key: HDFS-6929
>                 URL: https://issues.apache.org/jira/browse/HDFS-6929
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode
>            Reporter: Arpit Agarwal
>            Assignee: Arpit Agarwal
>             Fix For: HDFS-6581
>
>         Attachments: HDFS-6929.01.patch, HDFS-6929.02.patch
>
>
> Occasional data loss is expected when using the lazy persist flag due to node restarts.
The NN will optionally unlink lazy persist files from the namespace to avoid them from showing
up as corrupt files.
> This behavior can be turned off with a global option. In the future this may be made
a per-file option controllable by the client.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message