Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 62001D193 for ; Mon, 9 Jul 2012 19:45:44 +0000 (UTC) Received: (qmail 66635 invoked by uid 500); 9 Jul 2012 19:45:42 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 66598 invoked by uid 500); 9 Jul 2012 19:45:42 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 66588 invoked by uid 99); 9 Jul 2012 19:45:42 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 Jul 2012 19:45:42 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jon@cloudera.com designates 74.125.82.51 as permitted sender) Received: from [74.125.82.51] (HELO mail-wg0-f51.google.com) (74.125.82.51) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 Jul 2012 19:45:38 +0000 Received: by wgbed3 with SMTP id ed3so8868448wgb.20 for ; Mon, 09 Jul 2012 12:45:16 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:x-gm-message-state; bh=rp44q+60kLbjqyOOVjdHAW9TqZozXcQ9FpPcviTbarQ=; b=W//io3ykU8YdgjWZgZy1IAr2pEv38t7F4H/VNgOyn8yMaDrMwFLwYTsXvM6NeMUdMx MDjeCzcq+H8HnEWasvXRgTwtyukavxotAknnPdtGEqEy3LIBJB0d3bcv1dMSCpiMm8lC TpTdQxkwvcpbL9UWlNkuKDmqJbrciv88guTY9Imvv91Xn1NB970v3VMQOc1KGtkhSez7 feHiDq0QU6Pb+yvUVNKi8AmBDY/AB5izfrzqD8quMZyivovo2gWw7SVLAaLgEbE64RNq KIDyBTvRkx5aaCi8gdCqMNUHWqhfoemnlNRf3xXhHajVso7nERvuGiM8r4czPTtIV7TU fANw== Received: by 10.180.107.70 with SMTP id ha6mr31958744wib.16.1341863116645; Mon, 09 Jul 2012 12:45:16 -0700 (PDT) MIME-Version: 1.0 Received: by 10.223.155.201 with HTTP; Mon, 9 Jul 2012 12:44:56 -0700 (PDT) In-Reply-To: References: <4E10FDCD9A0148C8B537398ED86CBD2E@gmail.com> From: Jonathan Hsieh Date: Mon, 9 Jul 2012 12:44:56 -0700 Message-ID: Subject: Re: Can manually remove HFiles (similar to bulk import, but bulk remove)? To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=e89a8f234d0967a4d404c46ada37 X-Gm-Message-State: ALoCoQmhtxZzII5e7hIiWwMkq5v6TFHyjyfZIPcV964b7wxoBM3LTvP7CpXKXa6GPOyUFeYPtTAV X-Virus-Checked: Checked by ClamAV on apache.org --e89a8f234d0967a4d404c46ada37 Content-Type: text/plain; charset=ISO-8859-1 You could set your ttls and trigger a major compaction ... Or, (this is pretty advanced) you can probably do it without taking down RS's by: 1) closing the region in the hbase shell 2) deleting the file in the shell 3) reopening the region in the hbase shell Jon. On Mon, Jul 9, 2012 at 12:41 PM, Alex Baranau wrote: > Heh, this is what I want to avoid actually: restarting RSs. > > Alex Baranau > ------ > Sematext :: http://blog.sematext.com/ :: Solr - Lucene - Hadoop - HBase > > On Mon, Jul 9, 2012 at 3:38 PM, Amandeep Khurana wrote: > > > I _think_ you should be able to do it and be just fine but you'll need to > > shut down the region servers before you remove and start them back up > after > > you are done. Someone else closer to the internals can confirm/deny this. > > > > > > On Monday, July 9, 2012 at 12:36 PM, Alex Baranau wrote: > > > > > Hello, > > > > > > I wonder, for purging old data, if I'm OK with "remove all StoreFiles > > which > > > are older than ..." way, can I do that? To me it seems like this can > be a > > > very effective way to remove old data, similar to fast bulk import > > > functionality, but for deletion. > > > > > > Thank you, > > > > > > Alex Baranau > > > ------ > > > Sematext :: http://blog.sematext.com/ :: Solr - Lucene - Hadoop - > HBase > > > > > > > > > > > > > -- // Jonathan Hsieh (shay) // Software Engineer, Cloudera // jon@cloudera.com --e89a8f234d0967a4d404c46ada37--