flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Patrick Wendell <pwend...@gmail.com>
Subject Re: Real time reads
Date Sat, 04 Aug 2012 22:28:44 GMT

This sounds like something where you would want your web tier to
directly access HBase through its existing client API.

Do you need functionality not offered there?

- Patrick

On Sat, Aug 4, 2012 at 2:49 PM, Hari Shreedharan
<hshreedharan@cloudera.com> wrote:
> Mohit,
> Flume NG does not really have an HBase source. More importantly our sources
> do not actually pull data. It waits for data to be pushed to it, at least
> that is what all the current sources do. I don't know if it is a good idea
> to have a source proactively pull stuff from a source. But Flume is designed
> to make practically everything pluggable, so you can write your own source
> that does this.
> Hari
> --
> Hari Shreedharan
> On Saturday, August 4, 2012 at 2:34 PM, Mohit Anchlia wrote:
> I am prototyping flume ng for real time sink to hbase and hdfs for
> clickstream. I was wondering if Flume provides something that can read from
> HBase too. That is API request comes to our web server and after we receive
> the request we use flume to retrieve the result from HBase. Is flume ng
> meant for this type of scenario?

View raw message