Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3954B323D for ; Thu, 28 Apr 2011 18:00:27 +0000 (UTC) Received: (qmail 18971 invoked by uid 500); 28 Apr 2011 18:00:25 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 18945 invoked by uid 500); 28 Apr 2011 18:00:25 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 18937 invoked by uid 99); 28 Apr 2011 18:00:25 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 28 Apr 2011 18:00:25 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of amp@opendns.com designates 67.215.68.163 as permitted sender) Received: from [67.215.68.163] (HELO mail.opendns.com) (67.215.68.163) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 28 Apr 2011 18:00:18 +0000 Received: from Adams-Desktop.local ([67.215.69.42]) (authenticated bits=0) by mail.opendns.com (8.14.3/8.14.3/Debian-5) with ESMTP id p3SHxpJ2025237 (version=TLSv1/SSLv3 cipher=AES256-SHA bits=256 verify=NO); Thu, 28 Apr 2011 17:59:51 GMT Message-ID: <4DB9AB17.30408@opendns.com> Date: Thu, 28 Apr 2011 10:59:51 -0700 From: Adam Phelps User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.15) Gecko/20110303 Thunderbird/3.1.9 MIME-Version: 1.0 To: CDH Users , user@hbase.apache.org Subject: LoadIncrementalHFiles now deleting the hfiles? Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit We were using a backup scheme for our system where we have map-reduce jobs generating HFiles, which we then loaded using LoadIncrementalHFiles before making a remote copy of them using distcp. However we just upgraded hbase (we're using cloudera's package, so we went from CDH3B4 to CDH3U0, both of which are versions of 0.90.1), and discovered that the HFiles now get deleted by the load operation. Is this a recent change? Is there a configuration variable to revert this behavior? We can work around it by doing the copy before the load, but that is less than optimal in our scenario as we'd prefer to have quicker access to the data in HBase. - Adam