chukwa-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From highpointe <highpoint...@gmail.com>
Subject Re: Multiple agents and multiple clusters
Date Fri, 15 Jul 2011 03:38:14 GMT
Yes. Exactly that. Tailing the same file. Just each sending to unique destinations. 

Sent from my iPhone

On Jul 14, 2011, at 4:47 PM, Bill Graham <billgraham@gmail.com> wrote:

> What's the stream source? In some cases , like file tailing, you can just launch two
adaptors both tailing the same file.
> 
> On Thu, Jul 14, 2011 at 10:54 AM, Ariel Rabkin <asrabkin@gmail.com> wrote:
> Just to be clear -- you want the same data to end up in each cluster?
> 
> You'll have to do some hacking. I think it won't be so very monstrous.
> In the Agent, there's a notion of pluggable Connectors and Senders. I
> think you want a new Connector with two senders.
> 
> One caveat -- you'll need to think through what happens if just one
> cluster is down, and perhaps other partial failure scenarios too.
> 
> --Ari
> 
> On Thu, Jul 14, 2011 at 10:44 AM, high pointe <highpointe3i@gmail.com> wrote:
> > I have a situation where I need to take the one data stream, send it through
> > two agents and have the end point residing in separate clusters.
> > Rough explanation....
> > Streaming Data Box ---> Chukwa Box
> > Agent one on Chukwa Box sends feed to cluster one.
> > Agent two on Chukwa box sends feed to cluster two.
> > Does anyone know of a way to do this without hacking this baby to shreds?
> >
> > Thanks!
> 
> 
> 
> --
> Ari Rabkin asrabkin@gmail.com
> UC Berkeley Computer Science Department
> 

Mime
View raw message