hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hemanth Yamijala <yhema...@thoughtworks.com>
Subject Log aggregation in Yarn
Date Mon, 10 Sep 2012 10:49:04 GMT
Hi,

I enabled log aggregation in Yarn and can see that files are getting
created under the configured directory on HDFS. I can access the files via
FS shell. However, when I try to retrieve the logs via the history server,
they fail with a message:

Logs not available for attempt_1347261424213_0001_r_000000_0. Aggregation
may not be complete, Check back later or try the nodemanager.

This is with trunk.  From code, it looks like this happens because the
service is unable to access the file on HDFS. However, this is a single
node setup, all processes running as the same user. Security is off in
HDFS. Anything else wrong ? Do I need to configure something more ?

Thanks
Hemanth

Mime
View raw message