gearpump-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karol Brejna (JIRA)" <>
Subject [jira] [Commented] (GEARPUMP-161) Application logs are not created on Yarn
Date Mon, 27 Jun 2016 10:10:52 GMT


Karol Brejna commented on GEARPUMP-161:

In our env we work with gearpump 0.8.0 so I backported the change:

Now it seems that application logs dir is the same as woker log dir: 

app: complexdag
homedir: /data1/hadoop/yarn/nm/usercache/cf/appcache/application_1466978548991_0016/container_e06_1466978548991_0016_01_000003
logdir:  /var/log/hadoop-yarn/container/application_1466978548991_0016/container_e06_1466978548991_0016_01_000003

homedir: /data1/hadoop/yarn/nm/usercache/cf/appcache/application_1466978548991_0016/container_e06_1466978548991_0016_01_000003
logdir:  /var/log/hadoop-yarn/container/application_1466978548991_0016/container_e06_1466978548991_0016_01_000003

No folder for application logs is created. No dedicated worker log file.

> Application logs are not created on Yarn 
> -----------------------------------------
>                 Key: GEARPUMP-161
>                 URL:
>             Project: Apache Gearpump
>          Issue Type: Bug
>          Components: yarn
>    Affects Versions: 0.8.0
>         Environment: yarn deployment: 1 master, 1 worker;
>            Reporter: Karol Brejna
>            Assignee: Karol Brejna
> I have a simple cluster (1 master, 1 worker) running on YARN.
> I deploy an app. The app lands on a worker (cdh-worker-2 machine in this case).
> I inspect the worker and the app settings in the dashborad.
> Worker dir is shown as: /var/log/hadoop-yarn/container/application_1466296175601_0020/container_e05_1466296175601_0020_01_000003
> App log dir: /data1/hadoop/yarn/nm/usercache/cf/appcache/application_1466296175601_0020/container_e05_1466296175601_0020_01_000003/logs
> The logs are written to worker log dir under stderr.
> But there is no such a folder for app logs. 'logs' doesn exists under indicated location.
> I tried to do a wrokarounds (as I thought it may be a simple permissions issue):
> 1.
> chmod 777 on parent dir (/data1/hadoop/yarn/nm/usercache/cf/appcache/application_1466296175601_0020/container_e05_1466296175601_0020_01_000003)
> restarted app 
> No results here. logs dir not created.
> 2. 
> created logs dir by hand and changed permissions:
> mkdir logs
> chmod 777 logs
> No results here. logs dir not populated.

This message was sent by Atlassian JIRA

View raw message