Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 35044F856 for ; Thu, 4 Apr 2013 03:52:52 +0000 (UTC) Received: (qmail 13369 invoked by uid 500); 4 Apr 2013 03:52:51 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 13145 invoked by uid 500); 4 Apr 2013 03:52:51 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 13127 invoked by uid 99); 4 Apr 2013 03:52:50 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Apr 2013 03:52:50 +0000 X-ASF-Spam-Status: No, hits=2.5 required=5.0 tests=FREEMAIL_REPLY,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of yuzhihong@gmail.com designates 209.85.217.177 as permitted sender) Received: from [209.85.217.177] (HELO mail-lb0-f177.google.com) (209.85.217.177) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Apr 2013 03:52:44 +0000 Received: by mail-lb0-f177.google.com with SMTP id r10so2248023lbi.22 for ; Wed, 03 Apr 2013 20:52:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=2RkbKabX3T25oF6WHW7HC2VwLlHjXlkuS9QpvOXdQNU=; b=jiTCauNlHREQZVnAZ0Km3x1qubCGhIFGbNHrmPNV8MhUyK7Vs8neOLnTszqyffiiOm 0aoyh01TY3x+3S5hLIbDyGMhk2w6OdyqnNCCCi0DTvXZ9kJkkPSXUE3JMvl9r8LVJH/U QosRqmpNcQ/xI6s08Bti8azxQuYqX1ht2LeB8VUUxeV/8Y63NsxMr/JfM5tpHhyDEhIH 0GbNLVVpPRTozhLDjz/oeXUGtJ0H2b6s0uQ/iR6q1aZdHMD1hGeM9xVMKXWCFPaX2h4N 02oYEvuOYHuuhKdUREDEc4ecZ5vYnqnqTLeduFxtWDM06dX6ZdwpyXA2CZY86yQwcWs6 3mhQ== MIME-Version: 1.0 X-Received: by 10.112.137.135 with SMTP id qi7mr2348616lbb.117.1365047543969; Wed, 03 Apr 2013 20:52:23 -0700 (PDT) Received: by 10.112.84.133 with HTTP; Wed, 3 Apr 2013 20:52:23 -0700 (PDT) In-Reply-To: <1365044851.91652.YahooMailNeo@web140605.mail.bf1.yahoo.com> References: <1365044851.91652.YahooMailNeo@web140605.mail.bf1.yahoo.com> Date: Wed, 3 Apr 2013 20:52:23 -0700 Message-ID: Subject: Re: HBase Column Family TTL and cell deletions From: Ted Yu To: "dev@hbase.apache.org" , lars hofhansl Content-Type: multipart/alternative; boundary=089e012292faf5bd5e04d980e588 X-Virus-Checked: Checked by ClamAV on apache.org --089e012292faf5bd5e04d980e588 Content-Type: text/plain; charset=ISO-8859-1 I used http://www.ruddwire.com/handy-code/date-to-millisecond-calculators/and got same result. I think the initial confusion was due to TTL being in seconds and timestamp being in milliseconds. On Wed, Apr 3, 2013 at 8:07 PM, lars hofhansl wrote: > 1364928886015 is Tue Apr 02 11:54:46 PDT 2013, no? > So it's less than a day old. > > (Sorry if I am missing something) > > > -- Lars > > > > ________________________________ > From: Ashish Nigam > To: user@hbase.apache.org; dev@hbase.apache.org > Sent: Wednesday, April 3, 2013 3:19 PM > Subject: Re: HBase Column Family TTL and cell deletions > > Any thoughts? > > Here's one cell that should have been deleted ( I am putting HBase get > repines in shell) > > hbase(main):001:0> get 'service_counters','3141',{COLUMN => > 'stats-hourly:2013032014-C-U-4092276'} > 13/04/03 21:57:17 WARN util.NativeCodeLoader: Unable to load native-hadoop > library for your platform... using builtin-java classes where applicable > COLUMN CELL > > > > > stats-hourly:2013032014-C-U-4092276 > timestamp=1364928886015, value=\x00\x00\x00\x00\x00\x00\x00\x06 > > > > 1 row(s) in 0.1040 seconds > > > On Wed, Apr 3, 2013 at 12:03 PM, Ashish Nigam >wrote: > > > minVersion is set to 0 > > Here's detailed info on this CF - > > > > {NAME => 'stats-hourly', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => > > 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '3', COMPRESSION => 'LZO', > > MIN_VERSIONS => '0', TTL => '604800', KEEP_DELETED_CELLS => 'false', > > BLOCKSIZE => '65536', IN_MEMORY => 'false', ENCODE_ON_DISK => 'true', > > BLOCKCACHE => 'true'} > > > > HBase version is 0.94.2-cdh4.2.0, > > > > > > > > On Wed, Apr 3, 2013 at 11:48 AM, Ted Yu wrote: > > > >> Is it possible that minVersions was set for your column family ? > >> > >> What version of HBase are you using ? > >> > >> Thanks > >> > >> > >> On Wed, Apr 3, 2013 at 11:34 AM, Ashish Nigam >> >wrote: > >> > >> > Hi, > >> > I have a table "service_counters" that has service id as row id. > >> > There is a column family "stats-hourly" that stores counters related > to > >> > that service per hour. > >> > I have set TTL to be 7 days for the column family. > >> > > >> > {NAME => 'service_counters', FAMILIES => [{NAME => 'stats-hourly', > >> > COMPRESSION => 'LZO', TTL => '604800'}]} > >> > > >> > Now the problem is that I still see columns that are more than 7 days > >> old. > >> > I have also run major compactions but I still see old rows. > >> > Any pointers as to why these columns are not being deleted? > >> > > >> > Thanks > >> > Ashish > >> > > >> > > > > > --089e012292faf5bd5e04d980e588--