hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-9537) completebulkload does 'copy' StoreFiles instead of 'cut'
Date Mon, 16 Sep 2013 06:16:52 GMT

    [ https://issues.apache.org/jira/browse/HBASE-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13768096#comment-13768096

Lars Hofhansl commented on HBASE-9537:

Yep, looks like those identify the same issue.
> completebulkload does 'copy' StoreFiles instead of 'cut'
> --------------------------------------------------------
>                 Key: HBASE-9537
>                 URL: https://issues.apache.org/jira/browse/HBASE-9537
>             Project: HBase
>          Issue Type: Bug
>          Components: mapreduce
>    Affects Versions: 0.94.11
>            Reporter: M. BagherEsmaeily
>         Attachments: LoadIncrementalHFiles.log, region.log
> I was using HBase complete bulk load to transfer the output of ImportTsv to a table in
HBase, and I noticed that it copies the output instead of cutting. This takes long time for
my gigabytes of data.
> In HBase documentation (http://hbase.apache.org/book/ops_mgt.html#completebulkload) I
read that the files would be moved not copied. Can anyone help me with this?
> I use Hbase 0.94.11 and Hadoop 1.2.1. The file system of bulkload output directory and
hbase cluster are the same, too.
> I've also coded a MapReduce job using HFileOutputFormat. When I use LoadIncrementalHFiles
to move the output of my job to HBase table, it still copies instead of cut.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message