Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3522618E3B for ; Thu, 3 Mar 2016 14:04:23 +0000 (UTC) Received: (qmail 52273 invoked by uid 500); 3 Mar 2016 14:04:22 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 52208 invoked by uid 500); 3 Mar 2016 14:04:19 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 52155 invoked by uid 99); 3 Mar 2016 14:04:18 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Mar 2016 14:04:18 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 1B2642C1F5C for ; Thu, 3 Mar 2016 14:04:18 +0000 (UTC) Date: Thu, 3 Mar 2016 14:04:18 +0000 (UTC) From: "Liu Shaohui (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Resolved] (HBASE-15385) A failed atomic folder rename operation can never recovery for the destination file is deleted in Wasb filesystem MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-15385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shaohui resolved HBASE-15385. --------------------------------- Resolution: Invalid Fix Version/s: (was: 3.0.0) > A failed atomic folder rename operation can never recovery for the destination file is deleted in Wasb filesystem > ----------------------------------------------------------------------------------------------------------------- > > Key: HBASE-15385 > URL: https://issues.apache.org/jira/browse/HBASE-15385 > Project: HBase > Issue Type: Bug > Components: hadoop-azure > Reporter: Liu Shaohui > Priority: Critical > > When using Wsab file system, we found that a failed atomic folder rename operation can never recovery for the destination file deleted in Wasb filesystem. > {quota} > ls: Attempting to complete rename of file hbase/azurtst-xiaomi/data/default/YCSBTest/.tabledesc during folder rename redo, and file was not found in source or destination. > {quote} > The reason is the the file is renamed to the destination file before the crash, and the destination file is deleted by another process after crash. So the recovery is blocked during finishing the rename operation of this file when found the source and destination files all don't exist. > See: NativeAzureFileSystem.java #finishSingleFileRename > Another serious problem is that the recovery of atomic rename operation may delete new created file which is same name as the source file, because the file system don't check if there are rename operation need be redo. > Suggestions are welcomed~ -- This message was sent by Atlassian JIRA (v6.3.4#6332)