hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Varun Sharma (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4724) Provide API for checking whether lease is recovered or not
Date Mon, 22 Apr 2013 17:01:18 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638172#comment-13638172

Varun Sharma commented on HDFS-4724:

I guess we still need a client side timeout. Consider the following case:
1) recoverLease called and a bad datanode is chosen as primary or the primary datanode doing
recovery crashes/has issues
2) isFileClosed() will keep returning false but we still need to force a recovery

There is really no way for the Namenode to know what is really going on with the primary datanode
and it seems there is no "timeout" on recoveries within the namenode. So, we would still need
a client side timeout so that we do a forceful recovery if the file is not closed after X

> Provide API for checking whether lease is recovered or not
> ----------------------------------------------------------
>                 Key: HDFS-4724
>                 URL: https://issues.apache.org/jira/browse/HDFS-4724
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Ted Yu
> recoverLease() returns a boolean indicating whether file has been successfully finalized
and closed. In case false is returned, client should use another API to query whether lease
is recovered or not.
> Necessity for this new API stems from the fact that recoverLease() unconditionally enqueues
a block for recovery. So if client calls recoverLease() continuously, previous recovery attempts
would be preempted.
> See HBASE-8389 and HDFS-4721 for such scenario.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message