gearpump-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karol Brejna (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GEARPUMP-161) Application logs are not created on Yarn
Date Mon, 27 Jun 2016 10:10:52 GMT

    [ https://issues.apache.org/jira/browse/GEARPUMP-161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350741#comment-15350741
] 

Karol Brejna commented on GEARPUMP-161:
---------------------------------------

In our env we work with gearpump 0.8.0 so I backported the change:
https://github.com/huafengw/incubator-gearpump/commit/d85abcabcb9ed0da98394dce761fe9c00c56e752#diff-3c8947b850a44da1006ef39c0fe92fa5R365


Now it seems that application logs dir is the same as woker log dir: 

app: complexdag
homedir: /data1/hadoop/yarn/nm/usercache/cf/appcache/application_1466978548991_0016/container_e06_1466978548991_0016_01_000003
logdir:  /var/log/hadoop-yarn/container/application_1466978548991_0016/container_e06_1466978548991_0016_01_000003

worker
homedir: /data1/hadoop/yarn/nm/usercache/cf/appcache/application_1466978548991_0016/container_e06_1466978548991_0016_01_000003
logdir:  /var/log/hadoop-yarn/container/application_1466978548991_0016/container_e06_1466978548991_0016_01_000003

No folder for application logs is created. No dedicated worker log file.

> Application logs are not created on Yarn 
> -----------------------------------------
>
>                 Key: GEARPUMP-161
>                 URL: https://issues.apache.org/jira/browse/GEARPUMP-161
>             Project: Apache Gearpump
>          Issue Type: Bug
>          Components: yarn
>    Affects Versions: 0.8.0
>         Environment: yarn deployment: 1 master, 1 worker;
>            Reporter: Karol Brejna
>            Assignee: Karol Brejna
>
> I have a simple cluster (1 master, 1 worker) running on YARN.
> I deploy an app. The app lands on a worker (cdh-worker-2 machine in this case).
> I inspect the worker and the app settings in the dashborad.
> Worker dir is shown as: /var/log/hadoop-yarn/container/application_1466296175601_0020/container_e05_1466296175601_0020_01_000003
> App log dir: /data1/hadoop/yarn/nm/usercache/cf/appcache/application_1466296175601_0020/container_e05_1466296175601_0020_01_000003/logs
> The logs are written to worker log dir under stderr.
> But there is no such a folder for app logs. 'logs' doesn exists under indicated location.
> I tried to do a wrokarounds (as I thought it may be a simple permissions issue):
> 1.
> chmod 777 on parent dir (/data1/hadoop/yarn/nm/usercache/cf/appcache/application_1466296175601_0020/container_e05_1466296175601_0020_01_000003)
> restarted app 
> No results here. logs dir not created.
> 2. 
> created logs dir by hand and changed permissions:
> mkdir logs
> chmod 777 logs
> No results here. logs dir not populated.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message