hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arpit Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HDFS-6929) NN periodically unlinks lazy persist files with missing replicas from namespace
Date Wed, 27 Aug 2014 23:00:59 GMT

     [ https://issues.apache.org/jira/browse/HDFS-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Arpit Agarwal resolved HDFS-6929.
---------------------------------

      Resolution: Fixed
    Hadoop Flags: Reviewed

Committed to the feature branch. Thanks [~jnp].

> NN periodically unlinks lazy persist files with missing replicas from namespace
> -------------------------------------------------------------------------------
>
>                 Key: HDFS-6929
>                 URL: https://issues.apache.org/jira/browse/HDFS-6929
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode
>            Reporter: Arpit Agarwal
>            Assignee: Arpit Agarwal
>             Fix For: HDFS-6581
>
>         Attachments: HDFS-6929.01.patch, HDFS-6929.02.patch
>
>
> Occasional data loss is expected when using the lazy persist flag due to node restarts.
The NN will optionally unlink lazy persist files from the namespace to avoid them from showing
up as corrupt files.
> This behavior can be turned off with a global option. In the future this may be made
a per-file option controllable by the client.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message