flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jagadish Bihani <jagadish.bih...@pubmatic.com>
Subject flume-ng failure recovery
Date Wed, 18 Jul 2012 05:53:38 GMT

We want to deploy flume-ng in the production environment in our 
Here is the following scenario for which I am not able to find the answer:

1. We receive logs using 'tail -f' source.
2. Now  the agent process gets killed.
3. We restart it.
4. How would the restarted agent will know the correct state of the file.
Because in the meantime log file would have been modified and agent has
no way of knowing from where to resume?

Could you please help me in identifying how to tackle this scenario?

P.S. Instead of tail -f any other command can be used which doesnt 
modify the log file.


View raw message