Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 509628DF4 for ; Fri, 9 Sep 2011 14:59:17 +0000 (UTC) Received: (qmail 44330 invoked by uid 500); 9 Sep 2011 14:59:15 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 43961 invoked by uid 500); 9 Sep 2011 14:59:14 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 43952 invoked by uid 99); 9 Sep 2011 14:59:13 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 09 Sep 2011 14:59:13 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [206.125.168.128] (HELO bilbo.syminet.com) (206.125.168.128) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 09 Sep 2011 14:59:04 +0000 Received: from [59.96.33.87] (helo=aa) by bilbo.syminet.com with esmtpa (Exim 4.72) (envelope-from ) id 1R22XO-0007nx-Va for user@hbase.apache.org; Fri, 09 Sep 2011 07:58:39 -0700 Date: Fri, 9 Sep 2011 20:28:36 +0530 From: Arvind Jayaprakash To: user@hbase.apache.org Subject: Re: Counter columns in hbase Message-ID: <20110909145836.GA3873@aa> References: <20110904071720.GA3022@aa> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.20 (2009-06-14) X-Antiabuse: This header was added to track abuse, please include it with any abuse report X-Antiabuse: Primary Hostname - bilbo.syminet.com X-Antiabuse: Original Domain - hbase.apache.org X-Antiabuse: Originator/Caller UID/GID - [102 102] / [102 102] X-Antiabuse: Sender Address Domain - anomalizer.net X-Virus-Checked: Checked by ClamAV on apache.org On Sep 06, sagar naik wrote: >I can dedup based on timestamp of the event. >Can I increment the counter value and assign the version as the timestamp of >this event ? Is it because you have an infinitesimally fine grained timestamp, you assume two events wont happen at the "same time" (as defined by granularity of your clock) or just because the events are far and few? Also, are the events arriving in monotonically increasing order of time? I assume that is not the case given that you talk of duplicates (it would be a real crazy system if duplicates always arrive exactly one after the other without any interleaving). If the answer is no to either of the above solutions, then you need to rethink a bit.