hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "M. BagherEsmaeily (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-9537) completebulkload does 'copy' StoreFiles instead of 'cut'
Date Mon, 16 Sep 2013 06:26:53 GMT

    [ https://issues.apache.org/jira/browse/HBASE-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13768100#comment-13768100

M. BagherEsmaeily commented on HBASE-9537:

When i use "hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles hdfs://master.mydomain:8020/user/cluster/mbe/output
MBE" instead of "hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles mbe/output
MBE", the issue is resolved.

My problem was solved using absolute addressing with port number instead of relative addressing.
I think that the difference between providing address with or without port number is an issue
and has to be resolved on next releases.
> completebulkload does 'copy' StoreFiles instead of 'cut'
> --------------------------------------------------------
>                 Key: HBASE-9537
>                 URL: https://issues.apache.org/jira/browse/HBASE-9537
>             Project: HBase
>          Issue Type: Bug
>          Components: mapreduce
>    Affects Versions: 0.94.11
>            Reporter: M. BagherEsmaeily
>         Attachments: LoadIncrementalHFiles.log, region.log
> I was using HBase complete bulk load to transfer the output of ImportTsv to a table in
HBase, and I noticed that it copies the output instead of cutting. This takes long time for
my gigabytes of data.
> In HBase documentation (http://hbase.apache.org/book/ops_mgt.html#completebulkload) I
read that the files would be moved not copied. Can anyone help me with this?
> I use Hbase 0.94.11 and Hadoop 1.2.1. The file system of bulkload output directory and
hbase cluster are the same, too.
> I've also coded a MapReduce job using HFileOutputFormat. When I use LoadIncrementalHFiles
to move the output of my job to HBase table, it still copies instead of cut.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message