hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "M. BagherEsmaeily (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-9538) completebulkload does 'copy' StoreFiles instead of 'cut'
Date Sun, 15 Sep 2013 08:04:51 GMT
M. BagherEsmaeily created HBASE-9538:
----------------------------------------

             Summary: completebulkload does 'copy' StoreFiles instead of 'cut'
                 Key: HBASE-9538
                 URL: https://issues.apache.org/jira/browse/HBASE-9538
             Project: HBase
          Issue Type: Bug
          Components: mapreduce
    Affects Versions: 0.94.11
            Reporter: M. BagherEsmaeily


I was using HBase complete bulk load to transfer the output of ImportTsv to a table in HBase,
and I noticed that it copies the output instead of cutting. This takes long time for my gigabytes
of data.

In HBase documentation (http://hbase.apache.org/book/ops_mgt.html#completebulkload) I read
that the files would be moved not copied. Can anyone help me with this?

I use Hbase 0.94.11 and Hadoop 1.2.1. The file system of bulkload output directory and hbase
cluster are the same, too.

I've also coded a MapReduce job using HFileOutputFormat. When I use LoadIncrementalHFiles
to move the output of my job to HBase table, it still copies instead of cut.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message