hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "M. BagherEsmaeily (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-9537) completebulkload does 'copy' StoreFiles instead of 'cut'
Date Mon, 16 Sep 2013 17:42:03 GMT

    [ https://issues.apache.org/jira/browse/HBASE-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13768537#comment-13768537

M. BagherEsmaeily commented on HBASE-9537:

Actually, I was not much familiar with this system and I was in doubt about it.
Thanks for your help, Lars.
> completebulkload does 'copy' StoreFiles instead of 'cut'
> --------------------------------------------------------
>                 Key: HBASE-9537
>                 URL: https://issues.apache.org/jira/browse/HBASE-9537
>             Project: HBase
>          Issue Type: Bug
>          Components: HFile, mapreduce, regionserver
>    Affects Versions: 0.94.11
>            Reporter: M. BagherEsmaeily
>         Attachments: LoadIncrementalHFiles.log, region.log
> I was using HBase complete bulk load to transfer the output of ImportTsv to a table in
HBase, and I noticed that it copies the output instead of cutting. This takes long time for
my gigabytes of data.
> In HBase documentation (http://hbase.apache.org/book/ops_mgt.html#completebulkload) I
read that the files would be moved not copied. Can anyone help me with this?
> I use Hbase 0.94.11 and Hadoop 1.2.1. The file system of bulkload output directory and
hbase cluster are the same, too.
> I've also coded a MapReduce job using HFileOutputFormat. When I use LoadIncrementalHFiles
to move the output of my job to HBase table, it still copies instead of cut.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message