Return-Path: Delivered-To: apmail-incubator-hama-dev-archive@locus.apache.org Received: (qmail 78502 invoked from network); 14 Aug 2008 07:15:54 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 14 Aug 2008 07:15:54 -0000 Received: (qmail 90295 invoked by uid 500); 14 Aug 2008 07:15:53 -0000 Delivered-To: apmail-incubator-hama-dev-archive@incubator.apache.org Received: (qmail 90277 invoked by uid 500); 14 Aug 2008 07:15:53 -0000 Mailing-List: contact hama-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hama-dev@incubator.apache.org Delivered-To: mailing list hama-dev@incubator.apache.org Received: (qmail 90266 invoked by uid 99); 14 Aug 2008 07:15:53 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 14 Aug 2008 00:15:53 -0700 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [209.85.142.190] (HELO ti-out-0910.google.com) (209.85.142.190) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 14 Aug 2008 07:14:54 +0000 Received: by ti-out-0910.google.com with SMTP id w7so212787tib.6 for ; Thu, 14 Aug 2008 00:15:20 -0700 (PDT) Received: by 10.110.57.6 with SMTP id f6mr767079tia.35.1218698120212; Thu, 14 Aug 2008 00:15:20 -0700 (PDT) Received: by 10.110.47.7 with HTTP; Thu, 14 Aug 2008 00:15:20 -0700 (PDT) Message-ID: Date: Thu, 14 Aug 2008 16:15:20 +0900 From: "Edward J. Yoon" Sender: edward@udanax.org To: hama-dev@incubator.apache.org Subject: Fwd: Why "Integer Counters" function is emphasized in BigTable ? In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <2080cc950808132107kc980702pe0b90b7a3e77cf99@mail.gmail.com> <2080cc950808132242w40ae54d9n3a79646a94fb3c72@mail.gmail.com> X-Google-Sender-Auth: 8841f6e13d9c6420 X-Virus-Checked: Checked by ClamAV on apache.org Hello all? Did you subscribe the hadoop/hbase mailing list? If not, please subscribe these lists. core-dev-subscribe@hadoop.apache.org hbase-dev-subscribe@hadoop.apache.org ---------- Forwarded message ---------- From: Edward J. Yoon Date: Thu, Aug 14, 2008 at 3:28 PM Subject: Re: Why "Integer Counters" function is emphasized in BigTable ? To: hbase-dev@hadoop.apache.org As i mentioned, I don't know well. But, I think There is no reason to store the time series count data somewhere because each time we've gotten a different count. We just need the AbstractTable as a crushed flat as row by column 2d matrix. V^T is a historical vector of person. I just guess it is related with BigTable and others. If you want to see that formula, see http://blog.udanax.org/2008/08/googles-personalized-page-ranking.html -Edward On Thu, Aug 14, 2008 at 2:42 PM, Dai Tan wrote: > Not yet. Can you give me something about the algorithm? > > You mean the counting requirements in Google applications is huge so > "Integer Counter" function is necessary for BigTable? And "V^T on the google > personalization web page rank algorithm" is a good example? > > I know the "Integer Counter" function is convenient as the add or decrease > operation would be atomic. I wonder is there any other benefit of it? > > On Thu, Aug 14, 2008 at 1:25 PM, Edward J. Yoon wrote: > >> Have you seen the V^T on the google personalization web page rank >> algorithm? >> >> -Edward >> >> On Thu, Aug 14, 2008 at 2:16 PM, Edward J. Yoon >> wrote: >> >> I find Hbase will implement "Integer Counter" in future release version. >> So >> >> could anyone tell me the importance of "Integer Counter" and its common >> >> usages? I would really appreciate that. >> > >> > I don't know well about Hbase roadmap and 'Integer Counters'. But, I >> > guess It will be useful for counting the number of times something >> > happened. And, It means that the data used for numeric processing. >> > >> > -Edward >> > >> > On Thu, Aug 14, 2008 at 1:07 PM, Dai Tan wrote: >> >> Dear all: >> >> >> >> Hi, I am very interested in BigTable's theories and design. I was >> confused >> >> by the "Integer Counter" function mentioned in BigTable paper when I >> read >> >> it. I think this function is not hard to implement and may be useful for >> >> many application. But I believe there would be other significant usages >> for >> >> "Integer Counters" because it is emphasized as one of the three basic >> >> functions of BigTable. >> >> >> >> I find Hbase will implement "Integer Counter" in future release version. >> So >> >> could anyone tell me the importance of "Integer Counter" and its common >> >> usages? I would really appreciate that. >> >> >> >> I attach the segment of "Integer Counter" in BigTable paper as below: >> >> >> >> "Bigtable supports several other features that allow the >> >> user to manipulate data in more complex ways. First, >> >> Bigtable supports single-row transactions, which can be >> >> used to perform atomic read-modify-write sequences on >> >> data stored under a single row key. Bigtable does not currently >> >> support general transactions across row keys, although >> >> it provides an interface for batching writes across >> >> row keys at the clients. *Second, Bigtable allows cells >> >> to be used as integer counters*. Finally, Bigtable supports >> >> the execution of client-supplied scripts in the address >> >> spaces of the servers. The scripts are written in a >> >> language developed at Google for processing data called >> >> Sawzall" >> >> >> >> -- >> >> Best Regards. >> >> ----------- >> >> Dai Tan >> >> School of Computer Science and Technology >> >> Huazhong University of Science and Technology (HUST) >> >> Wuhan, 430074, China >> >> Email: dyerac@gmail.com >> >> >> > >> > >> > >> > -- >> > Best regards, Edward J. Yoon >> > edwardyoon@apache.org >> > http://blog.udanax.org >> > >> >> >> >> -- >> Best regards, Edward J. Yoon >> edwardyoon@apache.org >> http://blog.udanax.org >> > > > > -- > Best Regards. > ----------- > Dai Tan > School of Computer Science and Technology > Huazhong University of Science and Technology (HUST) > Wuhan, 430074, China > Email: dyerac@gmail.com > -- Best regards, Edward J. Yoon edwardyoon@apache.org http://blog.udanax.org -- Best regards, Edward J. Yoon edwardyoon@apache.org http://blog.udanax.org