hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zach York (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-17861) Regionserver down when checking the permission of staging dir if hbase.rootdir is on S3
Date Fri, 31 Mar 2017 22:52:42 GMT

    [ https://issues.apache.org/jira/browse/HBASE-17861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15951750#comment-15951750

Zach York commented on HBASE-17861:

I'm not saying that you need to check every conceivable filesystem. I'm just saying perhaps
the patch should exclude if the scheme contains s3 (which would cover s3, s3a, s3n, etc) rather
than removing it for everything but hdfs (since there are likely other FS implementations
other than hdfs that DO support rwx style permissions).

> Regionserver down when checking the permission of staging dir if hbase.rootdir is on
> ---------------------------------------------------------------------------------------
>                 Key: HBASE-17861
>                 URL: https://issues.apache.org/jira/browse/HBASE-17861
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 1.4.0
>            Reporter: Yi Liang
>            Assignee: Yi Liang
>              Labels: filesystem, s3, wal
>             Fix For: 1.4.0
>         Attachments: HBASE-17861.branch-1.V1.patch, HBASE-17861-V1.patch
> Found some issue, when set up HBASE-17437: Support specifying a WAL directory outside
of the root directory.
> The region server are  showdown when I add following config into hbase-site.xml 
> hbase.rootdir = hdfs://xx/xx
> hbase.wal.dir = s3a://xx//xx
> hbase.coprocessor.region.classes = org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint
> Error is below
> {noformat}
> org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint threw java.lang.IllegalStateException:
Directory already exists but permissions aren't set to '-rwx--x--x'
> {noformat}
> The reason is that, when hbase enable securebulkload, hbase will create a folder in s3,
it can not set above permission, because in s3, all files are listed as having full read/write
permissions and all directories appear to have full rwx permissions. See Object stores have
differerent authorization models in https://hadoop.apache.org/docs/current3/hadoop-aws/tools/hadoop-aws/index.html

This message was sent by Atlassian JIRA

View raw message