flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hari Shreedharan" <hshreedha...@cloudera.com>
Subject Re: Downstream port-less flume agent
Date Tue, 02 Dec 2014 06:13:01 GMT
Not sure how that would be possible. You could use a Spool Dir Source if you want to write
the data to files and then read it from there.


On Tue, Nov 25, 2014 at 11:00 AM, Majid Alfifi <majid.alfifi@gmail.com>

> I have a typical flume pipeline that collects logs from online servers and
> aggregate them and push them down to HDFS. The typical configuration is to
> open a port on the local cluster so the online flume agent can send Avro
> events to.
> Is it possible to have a flume agent on the local cluster basically
> "pulling" events from the online agent without the need to open a local
> port?
> Best Regards,
> Majid
View raw message