hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From xeonmailinglist-gmail <xeonmailingl...@gmail.com>
Subject Re: Can't see logs of a finished job.
Date Thu, 28 May 2015 13:24:50 GMT
In the |mapred-site.xml| I have also this configuration [4]:

[4]

|<property><name>mapreduce.jobhistory.address </name> <value>hadoop-coc-1:10020</value>
</property>
      <property><name>mapreduce.jobhistory.webapp.address</name> <value>hadoop-coc-1:19888</value>
</property>
  <property> <name>mapreduce.jobhistory.done-dir</name> <value>/home/xubuntu/Programs/hadoop/logs/history/done</value>
</property>
      <property> <name>mapreduce.jobhistory.intermediate-done-dir</name>
<value>/home/xubuntu/Programs/hadoop/logs/history/intermediate-done-dir</value>
</property>
|

On 05/28/2015 02:14 PM, xeonmailinglist-gmail wrote:

> Hi,
>
> I have configured the proxy server and the historyserver in Yarn 
> Mapreduce, and they are running properly [1]. But, I can’t see the 
> logs of an executed job [2]. I even have set history params in 
> |yarn-site.xml| [3]. Am I missing some configuration to see the logs 
> of a finished job?
>
> [1] Processes running
>
> |~/Programs/hadoop$ jps
> 15520 SecondaryNameNode
> 18800 WebAppProxyServer
> 17985 NodeManager
> 19154 Jps
> 15251 DataNode
> 15047 NameNode
> 16157 JobHistoryServer
> 17583 ResourceManager
> |
>
> [2] The error:
>
> |
> Failed redirect for container_1432817967879_0001_01_000001
>
> Failed while trying to construct the redirect url to the log server. Log Server url may
not be configured
>
> java.lang.Exception: Unknown container. Container either has not started or has already
completed or doesn't belong to this node at all.
> |
>
> [3] Part of |yarn-site.xml| configuration
>
> |  <!-- job history -->
>   <property> <name>yarn.log-aggregation-enable</name> <value>true</value>
</property>
>   <property> <name>yarn.nodemanager.log.retain-seconds</name> <value>900000</value>
</property>
>   <property> <name>yarn.nodemanager.remote-app-log-dir</name> <value>/app-logs</value>
</property>
> |
> ​
> -- 
> --

​

​

​

​

-- 
--


Mime
View raw message