hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vijay <vijay2...@gmail.com>
Subject Re: Hbase Analytical function
Date Tue, 28 Apr 2009 21:21:51 GMT
What is MR? I am trying to read the logs which is collected from the chukwa
and parse and store all the logs into the Hbase table.... and when the user
is trying to see the data i will just do a agreegation function which will
be using the map/reduce framework.... i was thinking of putting back
the aggregated data into the memcached so the later queries doesnt need to
go to hbase even.....

But the question is that..... do we have any framework where i can create my
own agreegation function which will run on the map reduce job when it is
fetching the data.... as u know it will be more faster ?

If i dont have alternative then i was thinking of using the hbase to return
me the result later i will use a map reduce kick another processing.....

Any advice will be helpfull.... i am new to hbase and still trying to learn


On Mon, Apr 27, 2009 at 9:12 PM, stack <stack@duboce.net> wrote:

> Try MR.  Read and write to HBase.  Results will be persisted to HDFS.
> Tell us more.  Hooking up Chukwa and HBase sounds interesting.
> St.Ack
> On Mon, Apr 27, 2009 at 1:17 PM, Vijay <vijay2win@gmail.com> wrote:
> > Hi,
> > I wanted to find do some calculation on a huge table which will have
> > millions of rows in it.... Whats the optimal way to do it? should i just
> > pass this to a map reduce job and it will take care of it? will the
> results
> > be stored in the memcached too? how abt the rows which i am intially
> > querying (usually the query for all the data from the date range). I am
> > trying to use chukwa with hbase as a database.
> >
> > Regards,
> > </VJ>
> >

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message