Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 86C731064E for ; Sat, 19 Oct 2013 19:29:13 +0000 (UTC) Received: (qmail 60595 invoked by uid 500); 19 Oct 2013 19:28:09 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 59925 invoked by uid 500); 19 Oct 2013 19:27:58 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 59851 invoked by uid 99); 19 Oct 2013 19:27:57 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 19 Oct 2013 19:27:57 +0000 Date: Sat, 19 Oct 2013 19:27:57 +0000 (UTC) From: "stack (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HBASE-8495) Change ownership of the directory to bulk load MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-8495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-8495: ------------------------- Fix Version/s: (was: 0.96.0) 0.96.1 > Change ownership of the directory to bulk load > ---------------------------------------------- > > Key: HBASE-8495 > URL: https://issues.apache.org/jira/browse/HBASE-8495 > Project: HBase > Issue Type: Improvement > Components: mapreduce > Affects Versions: 0.94.7, 0.95.0 > Reporter: Matteo Bertozzi > Priority: Trivial > Fix For: 0.96.1 > > > To bulk load something you need to change the ownership of the data directory to allow the hbase user to read and move the files, also in the split case you must use the hbase user to run the LoadIncrementalHFiles tool, since internally some directories "_tmp" are created to add the split reference files. > In a secure cluster, the SecureBulkLoadEndPoint will take care of this problem by doing a chmod 777 on the directory to bulk load. > NOTE that a chown is not possible since you must be a super user to change the ownership, a change group may be possible but the user must be in the hbase group... and anyway it will require a chmod to allow the group to perform the move. > {code} > Caused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=hbase, access=WRITE, inode="/test/cf":th30z:supergroup:drwxr-xr-x > at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:205) > Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(java.io.IOException): java.io.IOException: Exception in rename > at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.rename(HRegionFileSystem.java:928) > at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.commitStoreFile(HRegionFileSystem.java:340) > at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.bulkLoadStoreFile(HRegionFileSystem.java:414) > {code} -- This message was sent by Atlassian JIRA (v6.1#6144)