Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8A69810027 for ; Mon, 16 Sep 2013 06:27:01 +0000 (UTC) Received: (qmail 5092 invoked by uid 500); 16 Sep 2013 06:26:58 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 4981 invoked by uid 500); 16 Sep 2013 06:26:55 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 4947 invoked by uid 99); 16 Sep 2013 06:26:53 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 16 Sep 2013 06:26:53 +0000 Date: Mon, 16 Sep 2013 06:26:53 +0000 (UTC) From: "M. BagherEsmaeily (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-9537) completebulkload does 'copy' StoreFiles instead of 'cut' MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13768100#comment-13768100 ] M. BagherEsmaeily commented on HBASE-9537: ------------------------------------------ When i use "hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles hdfs://master.mydomain:8020/user/cluster/mbe/output MBE" instead of "hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles mbe/output MBE", the issue is resolved. My problem was solved using absolute addressing with port number instead of relative addressing. I think that the difference between providing address with or without port number is an issue and has to be resolved on next releases. > completebulkload does 'copy' StoreFiles instead of 'cut' > -------------------------------------------------------- > > Key: HBASE-9537 > URL: https://issues.apache.org/jira/browse/HBASE-9537 > Project: HBase > Issue Type: Bug > Components: mapreduce > Affects Versions: 0.94.11 > Reporter: M. BagherEsmaeily > Attachments: LoadIncrementalHFiles.log, region.log > > > I was using HBase complete bulk load to transfer the output of ImportTsv to a table in HBase, and I noticed that it copies the output instead of cutting. This takes long time for my gigabytes of data. > In HBase documentation (http://hbase.apache.org/book/ops_mgt.html#completebulkload) I read that the files would be moved not copied. Can anyone help me with this? > I use Hbase 0.94.11 and Hadoop 1.2.1. The file system of bulkload output directory and hbase cluster are the same, too. > I've also coded a MapReduce job using HFileOutputFormat. When I use LoadIncrementalHFiles to move the output of my job to HBase table, it still copies instead of cut. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira