hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arun C Murthy <...@hortonworks.com>
Subject Re: YARN task default output
Date Thu, 06 Jun 2013 20:07:35 GMT
You can enable log-aggregation where-by your application logs will be uploaded to HDFS.

Overview here:

Configurations from http://hadoop.apache.org/docs/r2.0.4-alpha/hadoop-project-dist/hadoop-common/ClusterSetup.html
which are relevant are:
yarn.log-aggregation-enable -> true
yarn.nodemanager.remote-app-log-dir -> /logs (directory on hdfs which will need to be created
before you start your cluster)


On Jun 6, 2013, at 11:10 AM, John Lilley wrote:

> Do tasks that spawn from a YARN AM have a default working directory?  Does stdout/stderr
get captured anywhere by default?
> I ask because I am setting up tests with the “distributed shell” AM and want to know
if basic commands (e.g. ls) will send stdout/stderr somewhere I can see at the end.
> Thanks
> John

Arun C. Murthy
Hortonworks Inc.

View raw message