flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason J. W. Williams" <jasonjwwilli...@gmail.com>
Subject Re: Flume 1.7.0 Release Schedule
Date Sat, 11 Jun 2016 02:33:32 GMT
Yeah.

Flume (relay)----WAN (Avro SSL)---->Flume (concentrator)--->Kafka.

The remote Flume is talking to a "concentrator" flume in the Kafka
datacenter, so that the data is transferred via SSL over the WAN, since the
Kafka sink doesn't support SSL in 1.6.0. Otherwise, we could push from the
remote Flume directly into Kafka over the WAN.

-J


On Fri, Jun 10, 2016 at 8:29 PM, Joe Lawson <
jlawson@opensourceconnections.com> wrote:

> Do you mean that you are replicating topics over WAN using Flume as a
> shipping agent? Sorry if I misunderstood the scenario.
> On Jun 10, 2016 9:58 PM, "Jason J. W. Williams" <jasonjwwilliams@gmail.com>
> wrote:
>
>> Thanks Joe that helps. What do you see folks using instead of Flume?
>> We're using largely a WAN relay for Kafka for remote sites that don't
>> warrant a local cluster.
>>
>> -J
>>
>> On Fri, Jun 10, 2016 at 6:17 PM, Joe Lawson <
>> jlawson@opensourceconnections.com> wrote:
>>
>>> Flume seems to have lost some stream. It's improving but it feels like
>>> the priorities have become somewhat introspective so I'd say build from
>>> master is you want the latest.
>>>
>>> Don't hold your breath for 1.7. just an opinion. No bearing on reality.
>>>
>>> -Joe
>>> On Jun 10, 2016 12:45 PM, "Jason J. W. Williams" <
>>> jasonjwwilliams@gmail.com> wrote:
>>>
>>>> Is there an estimated release date for Flume 1.7.0? Having TLS support
>>>> in the Kafka sink would allow us to simplify our topology a lot.=20
>>>>
>>>> -J
>>>
>>>
>>

Mime
View raw message