incubator-s4-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sky Zhao <sky.z...@ericsson.com>
Subject RE: zeroMQ
Date Tue, 07 May 2013 09:28:49 GMT
Thanks Matthieu,

If do the blocking, event arriving rate must be lower than processing rate, or loss event,
so need to config the parameters in default.s4.comm.properties file(s4.remoteSender.maxRate,s4.sender.maxRate?).
This is the way of  limiting the throughput, but if the data throughput is very large, is
there any other way to do the blocking events?

/Sky



________________________________
From: Matthieu Morel [mailto:mmorel@apache.org]
Sent: Tuesday, May 07, 2013 4:46 PM
To: s4-user@incubator.apache.org
Subject: Re: zeroMQ


On May 7, 2013, at 03:35 , Sky Zhao wrote:

Thanks Matthieu,

how implemet the blocking senders and receivers? can you give me examples or links?

Have a look here: http://incubator.apache.org/s4/doc/0.6.0/event_dispatch/

Regards,

Matthieu


________________________________
From: Matthieu Morel [mailto:mmorel@apache.org]
Sent: Monday, May 06, 2013 6:06 PM
To: s4-user@incubator.apache.org<mailto:s4-user@incubator.apache.org>
Subject: Re: zeroMQ

It is already possible to prevent losing events in normal operation in S4 by using blocking
senders and receivers. See the 0.6 documentation.

Even though zeromq has some interesting features such as automatic reconnection, providing
"no loss" guarantee in the case of node failures would require application level acknowledgement.
In other words, transport layer implementation does not really matter, in my opinion. We have
envisaged some designs but there is no plan for implementing application-level ack at the
moment.

Hope this helps,

Matthieu

On May 6, 2013, at 04:44 , Sky Zhao wrote:

Can s4 plan to use zeroMQ to handle events to improve current event loss issue in future?


/Sky



Mime
View raw message