hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Christian Schneider <cschneiderpub...@gmail.com>
Subject How to Archive the Task Logs (Stdout, Stderr, Syslogs)
Date Tue, 19 Mar 2013 10:03:57 GMT
Hi,
I found out that these logs are stored directly at the TaskNodes.

We need to have them stored over a long time (some months or better a
year). What is a good way of doing that?

With my current knowledge I would write a cron job that picks up all the
files every few minutes.
But I guess thats not the best approach...

Best Regards,
Christian.

Mime
View raw message