Return-Path: Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: (qmail 64221 invoked from network); 26 Sep 2009 21:00:38 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 26 Sep 2009 21:00:38 -0000 Received: (qmail 14279 invoked by uid 500); 26 Sep 2009 21:00:38 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 14223 invoked by uid 500); 26 Sep 2009 21:00:38 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 14213 invoked by uid 99); 26 Sep 2009 21:00:38 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 26 Sep 2009 21:00:38 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 26 Sep 2009 21:00:36 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 492F9234C004 for ; Sat, 26 Sep 2009 14:00:16 -0700 (PDT) Message-ID: <1016066968.1253998816288.JavaMail.jira@brutus> Date: Sat, 26 Sep 2009 14:00:16 -0700 (PDT) From: "Konstantin Shvachko (JIRA)" To: hdfs-issues@hadoop.apache.org Subject: [jira] Updated: (HDFS-644) Lease recovery, concurrency support. In-Reply-To: <1203087244.1253662217423.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HDFS-644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-644: ------------------------------------- Attachment: leaseRecovery.patch > Lease recovery, concurrency support. > ------------------------------------ > > Key: HDFS-644 > URL: https://issues.apache.org/jira/browse/HDFS-644 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: data-node, hdfs client, name-node > Affects Versions: Append Branch > Reporter: Konstantin Shvachko > Assignee: Konstantin Shvachko > Fix For: Append Branch > > Attachments: leaseRecovery.patch, leaseRecovery.patch, leaseRecovery.patch, leaseRecovery.patch, leaseRecovery.patch > > > Lease recovery happens if hdfs client does not renew its leases within an hour. Lease recovery triggers block recovery if the block has not been completed during normal write or append operations. Name-node initiates such block recovery by sending BlockRecoveryCommand to data-nodes (via reply to a heartbeat). There could be a race condition if some data-nodes still recover the block when the name-node decides to start a new recovery because the previous one did not complete. This issue should take of the race condition by introducing recovery ids. It should also implement the new recovery protocol, which is described in the append design document, -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.