hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "M. BagherEsmaeily (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-9537) completebulkload does 'copy' StoreFiles instead of 'cut'
Date Mon, 16 Sep 2013 06:26:53 GMT

    [ https://issues.apache.org/jira/browse/HBASE-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13768100#comment-13768100
] 

M. BagherEsmaeily commented on HBASE-9537:
------------------------------------------

When i use "hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles hdfs://master.mydomain:8020/user/cluster/mbe/output
MBE" instead of "hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles mbe/output
MBE", the issue is resolved.

My problem was solved using absolute addressing with port number instead of relative addressing.
I think that the difference between providing address with or without port number is an issue
and has to be resolved on next releases.
                
> completebulkload does 'copy' StoreFiles instead of 'cut'
> --------------------------------------------------------
>
>                 Key: HBASE-9537
>                 URL: https://issues.apache.org/jira/browse/HBASE-9537
>             Project: HBase
>          Issue Type: Bug
>          Components: mapreduce
>    Affects Versions: 0.94.11
>            Reporter: M. BagherEsmaeily
>         Attachments: LoadIncrementalHFiles.log, region.log
>
>
> I was using HBase complete bulk load to transfer the output of ImportTsv to a table in
HBase, and I noticed that it copies the output instead of cutting. This takes long time for
my gigabytes of data.
> In HBase documentation (http://hbase.apache.org/book/ops_mgt.html#completebulkload) I
read that the files would be moved not copied. Can anyone help me with this?
> I use Hbase 0.94.11 and Hadoop 1.2.1. The file system of bulkload output directory and
hbase cluster are the same, too.
> I've also coded a MapReduce job using HFileOutputFormat. When I use LoadIncrementalHFiles
to move the output of my job to HBase table, it still copies instead of cut.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message