hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From xeonmailinglist-gmail <xeonmailingl...@gmail.com>
Subject Can't see logs of a finished job.
Date Thu, 28 May 2015 13:14:51 GMT

I have configured the proxy server and the historyserver in Yarn 
Mapreduce, and they are running properly [1]. But, I can’t see the logs 
of an executed job [2]. I even have set history params in 
|yarn-site.xml| [3]. Am I missing some configuration to see the logs of 
a finished job?

[1] Processes running

|~/Programs/hadoop$ jps
15520 SecondaryNameNode
18800 WebAppProxyServer
17985 NodeManager
19154 Jps
15251 DataNode
15047 NameNode
16157 JobHistoryServer
17583 ResourceManager

[2] The error:

Failed redirect for container_1432817967879_0001_01_000001

Failed while trying to construct the redirect url to the log server. Log Server url may not
be configured

java.lang.Exception: Unknown container. Container either has not started or has already completed
or doesn't belong to this node at all.

[3] Part of |yarn-site.xml| configuration

|  <!-- job history -->
  <property> <name>yarn.log-aggregation-enable</name> <value>true</value>
  <property> <name>yarn.nodemanager.log.retain-seconds</name> <value>900000</value>
  <property> <name>yarn.nodemanager.remote-app-log-dir</name> <value>/app-logs</value>



View raw message