storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rahul R <rahul8...@gmail.com>
Subject Re: [Newbie Question] How to build non linear DRPC based topology with multiple spouts
Date Thu, 11 Feb 2016 01:05:57 GMT
I just realized, Its a non linear drpc topology. I would love to know, how
to get started building one.

Thanks,
./Rahul



On Tue, Feb 9, 2016 at 12:21 AM, Rahul R <rahul8590@gmail.com> wrote:

> I have a topology which is similar to LinearDRPC topolgy mentioned in here
> <http://storm.apache.org/documentation/Distributed-RPC.html> . The major
> difference being,  my bolts have multiple spouts. I am attaching a svg for
> my topology as a visual aid.
>
> Initially I had coded using localDRPC and things are pretty good.  The
> following is my code
>
> -----------
> TopologyBuilder builder = new TopologyBuilder();
> LocalDRPC drpc = new LocalDRPC();
> DRPCSpout spout = new DRPCSpout("update_cache", drpc);
> builder.setSpout("drpc", spout);
> builder.setSpout("KakfaGeneratorSpout", new KafkaGeneratorSpout(), 1);
>
>
> builder.setBolt("TransformBolt", new TransformationBolt(), 2)
>                 .shuffleGrouping("KakfaGeneratorSpout")
>                 .allGrouping("drpc");
>
> builder.setBolt("return", new ReturnResults(),
> 1).noneGrouping("TransformBolt","drpc_stream");
>
> builder.setBolt("NotificationBolt", new NotificationBolt() , 2)
>                     .shuffleGrouping("TransformBolt");
> ----------------------
>
> I am not sure, how to port this remote storm nodes.  As a first step, I
> tried building using LinearDRPCTopolgy Builder.  It seems to break most of
> the things in existing code.  Any suggestions on how to go about building
> this toplogy ?
>
> Thanks,
> ./Rahul
>
> PS:  I am running drpc server only on the nimbus host and not supervisors
> hosts.
>
>

Mime
View raw message