flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yogi Nerella <ynerella...@gmail.com>
Subject How to control synchronization on spooldir
Date Mon, 04 Feb 2013 22:59:33 GMT
Hi,

I have a rolling file appender which writes log files to a spooldirectory,
and an agent which polls this directory and copies the data to a log server.

1.  How do I control read/write?
2.  How do I use the the generated events of fileHeader and fileHeaderKey?

My source is a "spooldir" and "sink" is avro sink?

On the target side.

source is "avro" and target is "file".

I am trying to do is poll a source directory and copy them onto the target
directory, I would like to keep the filenames.

Can anyone provide some sample configuration files, how this "fileheader"
and "fileheaderkey" can be used, that would be great.

Thanks,
yogi

Mime
View raw message