Return-Path: Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: (qmail 94844 invoked from network); 31 Mar 2011 04:36:48 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 31 Mar 2011 04:36:48 -0000 Received: (qmail 216 invoked by uid 500); 31 Mar 2011 04:36:48 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 182 invoked by uid 500); 31 Mar 2011 04:36:47 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 169 invoked by uid 99); 31 Mar 2011 04:36:46 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 31 Mar 2011 04:36:46 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 31 Mar 2011 04:36:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id BA4F28B965 for ; Thu, 31 Mar 2011 04:36:05 +0000 (UTC) Date: Thu, 31 Mar 2011 04:36:05 +0000 (UTC) From: "Himanshu Vashishtha (JIRA)" To: issues@hbase.apache.org Message-ID: <446491401.23370.1301546165759.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HBASE-1512) Coprocessors: Support aggregate functions MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13013826#comment-13013826 ] Himanshu Vashishtha commented on HBASE-1512: -------------------------------------------- Thanks for reviewing it Ted. I will add the constructor. yes, I was thinking about this dependency of having a long variable for all these methods. But flexibility of using any data type (by converting it to byte array) for even a specific column family: column qualifier makes it a bit tricky to go for a data type argument. I can have varying number of data types even for one CF:CQ combination. Rather I was considering the option to have one additional check for int type (4 bytes). But that is just me, will be great what others say on it. For adding the type parameter to the AggregateCpProtocol methods, there will be dependency with AggregationClient. Did you try adding it there too (apart from its impl). > Coprocessors: Support aggregate functions > ----------------------------------------- > > Key: HBASE-1512 > URL: https://issues.apache.org/jira/browse/HBASE-1512 > Project: HBase > Issue Type: Sub-task > Components: coprocessors > Reporter: stack > Attachments: 1512.zip, patch-1512-2.txt, patch-1512.txt > > > Chatting with jgray and holstad at the kitchen table about counts, sums, and other aggregating facility, facility generally where you want to calculate some meta info on your table, it seems like it wouldn't be too hard making a filter type that could run a function server-side and return the result ONLY of the aggregation or whatever. > For example, say you just want to count rows, currently you scan, server returns all data to client and count is done by client counting up row keys. A bunch of time and resources have been wasted returning data that we're not interested in. With this new filter type, the counting would be done server-side and then it would make up a new result that was the count only (kinda like mysql when you ask it to count, it returns a 'table' with a count column whose value is count of rows). We could have it so the count was just done per region and return that. Or we could maybe make a small change in scanner too so that it aggregated the per-region counts. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira