Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E5D9C11CB3 for ; Tue, 2 Sep 2014 19:14:09 +0000 (UTC) Received: (qmail 59289 invoked by uid 500); 2 Sep 2014 19:14:07 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 59221 invoked by uid 500); 2 Sep 2014 19:14:07 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 59209 invoked by uid 99); 2 Sep 2014 19:14:06 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Sep 2014 19:14:06 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of serega.sheypak@gmail.com designates 209.85.215.54 as permitted sender) Received: from [209.85.215.54] (HELO mail-la0-f54.google.com) (209.85.215.54) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Sep 2014 19:13:39 +0000 Received: by mail-la0-f54.google.com with SMTP id b17so8263094lan.41 for ; Tue, 02 Sep 2014 12:13:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=cVVB7iYg6FVKALI7ujJvbVjeKfbJX4UNZUxE8q0M1yk=; b=GqworjFmN1Ws69actrZjLtGURYFiile2af/cs+j0JeQHacqjWaRZ6ciYZLfTaPA99h wSU14JqYxEWJnKe2CajpntLykpF97l6N5il5cMqUQArIxhFAvEdndj+09oqwOmchvd1b OvsYxdNhvfVx+0uWSjE0qNK9lbGmsoewKxVTJp6PrBBHIZhtzW9AcCVzMnmQFr2zC7j3 zIIb2EBkHhJVM8WcCn7qCO/RN+YuAW/DP9iVI+BkdvI/bGFEvi0D2U1XvVo138cxEUOH r48WEoXOUPF9LDaj3Xg2qlj1O9NtSI++eqmIFpdXLj8ci85UYx3Qu69urF3STN2+Fhp4 vOPg== X-Received: by 10.112.119.142 with SMTP id ku14mr34505124lbb.34.1409685218924; Tue, 02 Sep 2014 12:13:38 -0700 (PDT) MIME-Version: 1.0 Received: by 10.112.146.134 with HTTP; Tue, 2 Sep 2014 12:13:18 -0700 (PDT) In-Reply-To: <1409684588.53370.YahooMailNeo@web140601.mail.bf1.yahoo.com> References: <1409684588.53370.YahooMailNeo@web140601.mail.bf1.yahoo.com> From: Serega Sheypak Date: Tue, 2 Sep 2014 23:13:18 +0400 Message-ID: Subject: Re: ttl problem, cells are not deleted To: user , lars hofhansl Content-Type: multipart/alternative; boundary=047d7bb04446b81f2a050219ea6a X-Virus-Checked: Checked by ClamAV on apache.org --047d7bb04446b81f2a050219ea6a Content-Type: text/plain; charset=UTF-8 Thanks :) So if I set MIN_VERSIONS>1, then TTL feature would completely remove experied row? My Idea is to automatically remove experied data. It's ok to see sometimes expired data but not more than for +-2 days (TTL-1 second + 1 day waiting for next major compation). 2014-09-02 23:03 GMT+04:00 lars hofhansl : > Are these the last versions of a cell? You have MIN_VERSIONS set to 1, > meaning HBase will keep at least one version around regardless of whether > it is expired by TTL or not. > > -- Lars > > > > ________________________________ > From: Serega Sheypak > To: user > Sent: Tuesday, September 2, 2014 11:40 AM > Subject: ttl problem, cells are not deleted > > > Hi, I'm trying to use HBase TTL feature > here is table DDL: > > hbase(main):004:0> describe 'item_to_item_similar_rec' > DESCRIPTION > ENABLED > > {NAME => 'my_table', FAMILIES => [{NAME => 'd', DATA_BLOCK_ENCODING => > 'NONE', BLOOMFILTER => 'ROWCOL', REPLI true > > CATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS > => '1', TTL => '172800', KEEP_DELETED_CELLS => 'fal > > se', BLOCKSIZE => '65536', IN_MEMORY => 'true', ENCODE_ON_DISK => 'true', > BLOCKCACHE => 'true'}]} > > 1 row(s) in 0.1730 seconds > > It has ttl set to 172800 seconds = 2 days. > I see a cells that are much older than two days: > > column=d:099, timestamp=1409049061509, value=\x01\ > current ts = 1409679511000 > > 1409679511000 - 1409049061509 = 630449491 > --047d7bb04446b81f2a050219ea6a--