zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Patrick Hunt <ph...@apache.org>
Subject Re: Using zookeeper to track started and complete tasks
Date Fri, 05 Feb 2016 23:15:42 GMT
See this item in the FAQ: "How should I handle the CONNECTION_LOSS
error?". If I understand you correctly it answers your question.


On Fri, Feb 5, 2016 at 4:56 AM, Matthew Harrigan
<harrigan.matthew@gmail.com> wrote:
> Hello,
> I posted a question
> <http://stackoverflow.com/questions/35205591/using-zookeeper-to-manage-tasks-which-are-in-process-or-have-been-processed>
> to stack overflow.  Perhaps sending it to the zookeeper mailing list would
> have been better.  Any help/comments would be greatly appreciated.
> After reading more about zookeeper, I suspect that one edge case which
> could cause problems is if a worker loses connection after creating an
> ephemeral node under started but before the client receives
> acknowledgement.  That worker would not know whether it was actually
> created or not, and in the meantime some other worker could create the same
> node.  That would violate exactly once processing.  Perhaps uuid's could
> help.  Maybe i could just restart the worker entirely if it loses
> connection.  Anyways that is a pretty nasty edge case and I really don't
> need anything bulletproof.
> Thank you

View raw message