hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jerry He (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-13701) Consolidate SecureBulkLoadEndpoint into HBase core as default for bulk load
Date Wed, 06 Jul 2016 20:29:11 GMT

    [ https://issues.apache.org/jira/browse/HBASE-13701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15365025#comment-15365025
] 

Jerry He commented on HBASE-13701:
----------------------------------

There is another point I want to raise here.

The hbase.bulkload.staging.dir defaults to hbase.fs.tmp.dir which then defaults to
{code}
public static final String DEFAULT_TEMPORARY_HDFS_DIRECTORY = "/user/"
      + System.getProperty("user.name") + "/hbase-staging";
{code}

This default would have problem on local file system standalone case.

I am thinking about bringing hbase.bulkload.staging.dir to be under hbase.rootdir.  We are
bringing secure bulkload to the core. It makes sense to bring the staging dir under core control
as well, instead of an optional property.

Any concern?


> Consolidate SecureBulkLoadEndpoint into HBase core as default for bulk load
> ---------------------------------------------------------------------------
>
>                 Key: HBASE-13701
>                 URL: https://issues.apache.org/jira/browse/HBASE-13701
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Jerry He
>            Assignee: Jerry He
>             Fix For: 2.0.0
>
>         Attachments: HBASE-13701-v1.patch, HBASE-13701-v2.patch, HBASE-13701-v3.patch,
HBASE-13701-v4.patch
>
>
> HBASE-12052 makes SecureBulkLoadEndpoint work in a non-secure env to solve HDFS permission
issues.
> We have encountered some of the permission issues and have to use this SecureBulkLoadEndpoint
to workaround issues.
> We should  probably consolidate SecureBulkLoadEndpoint into HBase core as default for
bulk load since it is able to handle both secure Kerberos and non-secure cases.
> Maintaining two versions of bulk load implementation is also a cause of confusion, and
having to explicitly set it is also inconvenient.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message