Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 47DFE112C6 for ; Wed, 23 Jul 2014 18:57:46 +0000 (UTC) Received: (qmail 40416 invoked by uid 500); 23 Jul 2014 18:57:45 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 40327 invoked by uid 500); 23 Jul 2014 18:57:45 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 40315 invoked by uid 99); 23 Jul 2014 18:57:45 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Jul 2014 18:57:45 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ndimiduk@gmail.com designates 209.85.220.169 as permitted sender) Received: from [209.85.220.169] (HELO mail-vc0-f169.google.com) (209.85.220.169) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Jul 2014 18:57:39 +0000 Received: by mail-vc0-f169.google.com with SMTP id hu12so3080521vcb.14 for ; Wed, 23 Jul 2014 11:57:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=u73LKQ/3UrFzL/CnxgnkpAfEmjFDZD7Sa76pJFJIm2c=; b=jvMBLzRdLMPWpSVT8CMUJl9ZQoyscs7D+wrc6o0agXEFcREdms1OMyH7DTg7BlZI1m 28TPu+rlLoFrAIG3csQORHLwNrdvluhwhHdrWWisFcL/VNtHJude4KbzMr6eDaIK5EG0 z2j8kR62pyxio+oU0eobuKRmiOz45d/G9aAFBa4+OCMQyNKR7dFvWr7MhkUPPUxxu5Wi J9jINzZWuxyNvNNUfiRhG0tJemgHYGepLGlFgaKTt7KwVf6wD5vqylxDh6YI8KnDTKtT izCeJAanK6ZjoVKS5dFiU6hT7mctSsowuIPi/6EzsFSm+wrh2CMJyT/q0h/rGlUI5CS6 TFNA== X-Received: by 10.52.64.140 with SMTP id o12mr4217606vds.70.1406141838993; Wed, 23 Jul 2014 11:57:18 -0700 (PDT) MIME-Version: 1.0 Received: by 10.58.18.237 with HTTP; Wed, 23 Jul 2014 11:56:58 -0700 (PDT) From: Nick Dimiduk Date: Wed, 23 Jul 2014 11:56:58 -0700 Message-ID: Subject: HFileLink backreferences To: hbase-dev Content-Type: multipart/alternative; boundary=20cf3079bcc0d1326104fee0e8b3 X-Virus-Checked: Checked by ClamAV on apache.org --20cf3079bcc0d1326104fee0e8b3 Content-Type: text/plain; charset=UTF-8 Heya, I see that we maintain backreferences for hfilelinks. This appears to be used by HFileLinkCleaner to determine when an HFile has no HFileLinks and thus whether it can be deleted without orphaning those links. This is problematic for using the mapreduce over snapshot files feature. However, restoring a snapshot can create HFileLinks to existing files in the restore directory. Those links then create back-references to the root path. Thus we have a situation where the user running the MR job requires write access to the hbase root path. Was this already discussed in the original ticket (HBASE-8369)? We mention the requirement of read permissions (and bypassing security) in the release note, but I didn't note any comments for write. Requiring write permission effectively means you can only MR as the hbase user, which is pretty much a non-starter for any interesting integration of feature. Thoughts? Thanks, Nick --20cf3079bcc0d1326104fee0e8b3--