hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-8495) Change ownership of the directory to bulk load
Date Tue, 10 Jun 2014 02:02:03 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026034#comment-14026034

Hudson commented on HBASE-8495:

SUCCESS: Integrated in HBase-0.98 #329 (See [https://builds.apache.org/job/HBase-0.98/329/])
HBASE-8495 Change ownership of the directory to bulk load (matteo.bertozzi: rev 4980a67e672d767b9c6a15fda8aa08dd37c757c4)
* hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/LoadIncrementalHFiles.java

> Change ownership of the directory to bulk load
> ----------------------------------------------
>                 Key: HBASE-8495
>                 URL: https://issues.apache.org/jira/browse/HBASE-8495
>             Project: HBase
>          Issue Type: Improvement
>          Components: mapreduce
>    Affects Versions: 0.94.7, 0.95.0
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Trivial
>             Fix For: 0.99.0, 0.94.20, 0.98.4
>         Attachments: HBASE-8495-0.94-v0.patch
> To bulk load something you need to change the ownership of the data directory to allow
the hbase user to read and move the files, also in the split case you must use the hbase user
to run the LoadIncrementalHFiles tool, since internally some directories "_tmp" are created
to add the split reference files.
> In a secure cluster, the SecureBulkLoadEndPoint will take care of this problem by doing
a chmod 777 on the directory to bulk load.
> NOTE that a chown is not possible since you must be a super user to change the ownership,
a change group may be possible but the user must be in the hbase group... and anyway it will
require a chmod to allow the group to perform the move.
> {code}
> Caused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=hbase,
access=WRITE, inode="/test/cf":th30z:supergroup:drwxr-xr-x
> 	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:205)
> Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(java.io.IOException):
java.io.IOException: Exception in rename
> 	at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.rename(HRegionFileSystem.java:928)
> 	at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.commitStoreFile(HRegionFileSystem.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.bulkLoadStoreFile(HRegionFileSystem.java:414)
> {code}

This message was sent by Atlassian JIRA

View raw message