hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-17123) Add postBulkLoadHFile variant that notifies the final paths for the hfiles
Date Fri, 18 Nov 2016 02:42:58 GMT

    [ https://issues.apache.org/jira/browse/HBASE-17123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15675527#comment-15675527
] 

Ted Yu commented on HBASE-17123:
--------------------------------

SecureBulkLoadManager calls bulkLoadHFiles() of Region:
{code}
            return region.bulkLoadHFiles(familyPaths, true,
                new SecureBulkLoadListener(fs, bulkToken, conf), request.getCopyFile());
{code}
I plan to change the return value of bulkLoadHFiles() to List<Pair<byte[], String>>,
corresponding to paths of the final hfiles.
[~enis]:
What do you think ?

> Add postBulkLoadHFile variant that notifies the final paths for the hfiles
> --------------------------------------------------------------------------
>
>                 Key: HBASE-17123
>                 URL: https://issues.apache.org/jira/browse/HBASE-17123
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Ted Yu
>
> Currently the postBulkLoadHFile() hook passes the same familyPaths parameter which it
receives as method parameter.
> See code in SecureBulkLoadManager :
> {code}
>        loaded = region.getCoprocessorHost().postBulkLoadHFile(familyPaths, loaded);
> {code}
> Meaning, the paths are not final, moved paths of the loaded hfiles.
> This issue is to add a variant which notifies the final paths of the loaded hfiles.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message