hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-17861) Regionserver down when checking the permission of staging dir if hbase.rootdir is on S3
Date Tue, 04 Apr 2017 17:43:41 GMT

    [ https://issues.apache.org/jira/browse/HBASE-17861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955492#comment-15955492

Hudson commented on HBASE-17861:

FAILURE: Integrated in Jenkins build HBase-1.4 #687 (See [https://builds.apache.org/job/HBase-1.4/687/])
HBASE-17861: Regionserver down when checking the permission of staging (tedyu: rev 4057a6c89c74c9f595cb51ac3bdc288396a0b257)
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/security/access/SecureBulkLoadEndpoint.java

> Regionserver down when checking the permission of staging dir if hbase.rootdir is on
> ---------------------------------------------------------------------------------------
>                 Key: HBASE-17861
>                 URL: https://issues.apache.org/jira/browse/HBASE-17861
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 1.4.0
>            Reporter: Yi Liang
>            Assignee: Yi Liang
>              Labels: filesystem, s3, wal
>             Fix For: 1.4.0
>         Attachments: HBASE-17861.branch-1.V1.patch, HBASE-17861.branch-1.V2.patch, HBASE-17861.branch-1.V3.patch,
HBASE-17861.branch-1.V4.patch, HBASE-17861-V1.patch
> Found some issue, when set up HBASE-17437: Support specifying a WAL directory outside
of the root directory.
> The region server are  showdown when I add following config into hbase-site.xml 
> hbase.rootdir =  s3a://xx//xx
> hbase.wal.dir = hdfs://xx/xx
> hbase.coprocessor.region.classes = org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint
> Error is below
> {noformat}
> org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint threw java.lang.IllegalStateException:
Directory already exists but permissions aren't set to '-rwx--x--x'
> {noformat}
> The reason is that, when hbase enable securebulkload, hbase will create a folder in s3,
it can not set above permission, because in s3, all files are listed as having full read/write
permissions and all directories appear to have full rwx permissions. See Object stores have
differerent authorization models in https://hadoop.apache.org/docs/current3/hadoop-aws/tools/hadoop-aws/index.html

This message was sent by Atlassian JIRA

View raw message