hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "M. BagherEsmaeily (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-9538) completebulkload does 'copy' StoreFiles instead of 'cut'
Date Sun, 15 Sep 2013 08:04:52 GMT
M. BagherEsmaeily created HBASE-9538:

             Summary: completebulkload does 'copy' StoreFiles instead of 'cut'
                 Key: HBASE-9538
                 URL: https://issues.apache.org/jira/browse/HBASE-9538
             Project: HBase
          Issue Type: Bug
          Components: mapreduce
    Affects Versions: 0.94.11
            Reporter: M. BagherEsmaeily

I was using HBase complete bulk load to transfer the output of ImportTsv to a table in HBase,
and I noticed that it copies the output instead of cutting. This takes long time for my gigabytes
of data.

In HBase documentation (http://hbase.apache.org/book/ops_mgt.html#completebulkload) I read
that the files would be moved not copied. Can anyone help me with this?

I use Hbase 0.94.11 and Hadoop 1.2.1. The file system of bulkload output directory and hbase
cluster are the same, too.

I've also coded a MapReduce job using HFileOutputFormat. When I use LoadIncrementalHFiles
to move the output of my job to HBase table, it still copies instead of cut.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message