Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9A19BD16C for ; Wed, 29 Aug 2012 00:34:06 +0000 (UTC) Received: (qmail 1900 invoked by uid 500); 29 Aug 2012 00:34:04 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 1828 invoked by uid 500); 29 Aug 2012 00:34:04 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 1818 invoked by uid 99); 29 Aug 2012 00:34:04 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Aug 2012 00:34:04 +0000 X-ASF-Spam-Status: No, hits=0.0 required=5.0 tests=FSL_RCVD_USER,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of mlortiz@uci.cu designates 200.55.140.180 as permitted sender) Received: from [200.55.140.180] (HELO mx3.uci.cu) (200.55.140.180) by apache.org (qpsmtpd/0.29) with SMTP; Wed, 29 Aug 2012 00:33:59 +0000 Received: (qmail 5888 invoked by uid 507); 29 Aug 2012 00:33:33 -0000 Received: from 10.0.0.184 by ns3.uci.cu (envelope-from , uid 501) with qmail-scanner-2.01st (avp: 5.0.2.0. spamassassin: 3.0.6. perlscan: 2.01st. Clear:RC:1(10.0.0.184):. Processed in 1.181766 secs); 29 Aug 2012 00:33:33 -0000 Received: from unknown (HELO ucimail3.uci.cu) (10.0.0.184) by 0 with SMTP; 29 Aug 2012 00:33:31 -0000 Received: from localhost (localhost.localdomain [127.0.0.1]) by ucimail3.uci.cu (Postfix) with ESMTP id 50F5D1E8C004 for ; Tue, 28 Aug 2012 20:33:31 -0400 (CDT) X-Virus-Scanned: amavisd-new at uci.cu Received: from ucimail3.uci.cu ([127.0.0.1]) by localhost (ucimail3.uci.cu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id X1Q7cheYNubM; Tue, 28 Aug 2012 20:33:28 -0400 (CDT) Received: by ucimail3.uci.cu (Postfix, from userid 101) id 8180B1E8C00E; Tue, 28 Aug 2012 20:33:28 -0400 (CDT) Received: from [10.8.46.125] (unknown [10.8.46.125]) (Authenticated sender: mlortiz@uci.cu) by ucimail3.uci.cu (Postfix) with ESMTPSA id 73F401E8C008; Tue, 28 Aug 2012 20:33:28 -0400 (CDT) Message-ID: <503D6362.8060201@uci.cu> Date: Tue, 28 Aug 2012 20:33:38 -0400 From: Marcos Ortiz User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:13.0) Gecko/20120614 Thunderbird/13.0.1 MIME-Version: 1.0 To: user@hbase.apache.org CC: Mohit Anchlia , tsuna@stumbleupon.com Subject: Re: Timeseries data References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Study the OpenTSDB at StumbleUpon described by Benoit "tsuna" Sigoure (tsuna@stumbleupon.com) in the HBaseCon talk called "Lessons Learned from OpenTSDB". His team have done a great job working with Time-series data, and he gave a lot of great advices to work with this kind of data with HBase: - Wider rows to seek faster - Use asynchbase + Netty or Finagle(great tool created by Twitter engineers to work with HBase) = performance ++ - Make writes idempotent and independent before: start rows at arbitrary points in time after: align rows on 10m (then 1h) boundaries - Store more data per Key/Value - Compact your data - Use short family names Best wishes El 28/08/2012 20:21, Mohit Anchlia escribi�: > In timeseries type data how do people deal with scenarios where one might > get multiple events in a millisecond? Using nano second approach seems > tricky. Other option is to take advantage of versions or counters. > > > 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS... > CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION > > http://www.uci.cu > http://www.facebook.com/universidad.uci > http://www.flickr.com/photos/universidad_uci 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS... CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION http://www.uci.cu http://www.facebook.com/universidad.uci http://www.flickr.com/photos/universidad_uci