Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9E03118428 for ; Mon, 24 Aug 2015 22:29:47 +0000 (UTC) Received: (qmail 61354 invoked by uid 500); 24 Aug 2015 22:29:47 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 61184 invoked by uid 500); 24 Aug 2015 22:29:47 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 60906 invoked by uid 99); 24 Aug 2015 22:29:47 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 24 Aug 2015 22:29:47 +0000 Date: Mon, 24 Aug 2015 22:29:47 +0000 (UTC) From: "Enis Soztutar (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HBASE-14302) TableSnapshotInputFormat should not create back references when restoring snapshot MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-14302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated HBASE-14302: ---------------------------------- Attachment: hbase-14302_v1.patch Straightforward patch with UT. Back references are not created and also WAL is not instantiated per region at restore. I've tested this manually as well to confirm that snapshot MR job does not require W permission now. > TableSnapshotInputFormat should not create back references when restoring snapshot > ---------------------------------------------------------------------------------- > > Key: HBASE-14302 > URL: https://issues.apache.org/jira/browse/HBASE-14302 > Project: HBase > Issue Type: Bug > Reporter: Enis Soztutar > Assignee: Enis Soztutar > Fix For: 2.0.0, 1.2.0, 1.3.0, 1.0.3, 1.1.3 > > Attachments: hbase-14302_v1.patch > > > TableSnapshotInputFormat restores the snapshot to a temporary directory that is outside the HBase's root directory so that it can read from the restored snapshot and also refer to hfiles in the actual root directory. > In restoring the snapshot, we create new hfilelinks in the ephemeral location. Creating new hfile links also creates "back references" for GC. These back references are dangling since the restore location is outside the root dir, and requires a WRITE permission to the root dir (as opposed to just READ permission) to be able to run the MR-over-snapshot job. -- This message was sent by Atlassian JIRA (v6.3.4#6332)