storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Susheel Kumar Gadalay <>
Subject Re: Best practices for host-bound source and sink?
Date Thu, 09 Jan 2014 17:10:54 GMT
Use custom scheduler to run the spout and bolt on the designated m/c.

See this :

On 1/9/14, Harald Kirsch <> wrote:
> Hi all,
> suppose you need to process input available on and the
> results should finally end up on A storm topology shall do
> the processing.
> It is easy to write a sprout that fetches the data and emits it into the
> topology. Similarly a sink-bolt can write the result somewhere.
> But now suppose that the data is available only locally on
> in the file system. Is it possible and natural to make a
> machine in the Storm cluster but somehow make sure that *only* the
> sprout is executed on Similarly, would it be possible to
> bind a sink bolt to one specific machine, the
> If this is not a possible or not a preferred way to do it, are there any
> specific techniques used to provide input to a sprout beyond whatever
> remote access methods happen to be available (smb, nfs, ssh, http)?
> Thanks for any hints,
> Harald.

View raw message