incubator-flume-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Hsieh (Commented) (JIRA)" <>
Subject [jira] [Commented] (FLUME-640) Send acks without getting masters involved
Date Wed, 05 Oct 2011 15:55:34 GMT


Jonathan Hsieh commented on FLUME-640:

Yongkun, I'm excited to see this code finally come out and am very impressed by the design
doc!  I've been behind in reviews but will try to spend some time on this later on this week.
 This is a big feature and could use some help testing this!  Ideally, we could get a version
of this on trunk. 
> Send acks without getting masters involved
> ------------------------------------------
>                 Key: FLUME-640
>                 URL:
>             Project: Flume
>          Issue Type: Improvement
>    Affects Versions: v0.9.3
>            Reporter: Disabled imported user
>              Labels: acknowledgement
>         Attachments: flume-0.9.3-cdh3u0-masterless-ack.patch, flume-0.9.3-cdh3u0-masterless-ack.patch.README,
> Currently the acks (acknowledgement) from the collector are sent back via the master(s).
In case the master is down, the acks will be lost. It seems that the even the multi masters
cannot handle this single-point-failure issue.
> A re-design of sending the acks back without getting the master involved will be very
beneficial. The single-point-failure can be removed to some extent, and the efficiency of
the acks will also be improved since the master is not a bottleneck any more.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


View raw message