airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "bhavin patel (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-2413) log dir name mismatch with UI on /log
Date Thu, 03 May 2018 18:00:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

bhavin patel updated AIRFLOW-2413:
----------------------------------
    Description: 
every time i tried to look for logs in UI , it gave me error message.

 

here is the url that makes the call 
{code:java}
http://localhost:8080/admin/airflow/log?dag_id=Struct-Pipeline-Runner&task_id=struct-event-model.02-sem-fill-mapping&execution_date=2018-05-03T14%3A54%3A22
{code}
{code:java}
*** Log file isn't local.

*** Fetching here: http://1.0.0.127.in-addr.arpa:8793/log/Struct-Pipeline-Runner/struct-event-model.02-sem-fill-mapping/2018-05-03T14:54:22/1.log

*** Failed to fetch log file from worker. 404 Client Error: NOT FOUND for url: http://1.0.0.127.in-addr.arpa:8793/log/Struct-Pipeline-Runner/struct-event-model.02-sem-fill-mapping/2018-05-03T14:54:22/1.log
{code}
 

 

upon investigating I have found that the dir name generated by snowplow logger  is not consistent
with the name generated by UI

 

 
{code:java}
~ $ ls -la .../airflow/logs/Struct-Pipeline-Runner/struct-event-model.02-sem-fill-mapping/2018-0
2018-04-23T00:00:00/ 2018-04-25T00:00:00/ 2018-04-30T20:05:43+00:00/ 2018-05-02T16:29:38+00:00/
2018-05-02T20:11:39+00:00/ 2018-05-03T14:54:22+00:00/
{code}

  was:
every time i tried to look for logs in UI , it gave me error message.
{code:java}
*** Log file isn't local.

*** Fetching here: http://1.0.0.127.in-addr.arpa:8793/log/Struct-Pipeline-Runner/struct-event-model.02-sem-fill-mapping/2018-05-03T14:54:22/1.log

*** Failed to fetch log file from worker. 404 Client Error: NOT FOUND for url: http://1.0.0.127.in-addr.arpa:8793/log/Struct-Pipeline-Runner/struct-event-model.02-sem-fill-mapping/2018-05-03T14:54:22/1.log
{code}
 

 

upon investigating I have found that the dir name generated by snowplow logger  is not consistent
with the name generated by UI

 
{code:java}

~ $ ls -la .../airflow/logs/Struct-Pipeline-Runner/struct-event-model.02-sem-fill-mapping/2018-0
2018-04-23T00:00:00/ 2018-04-25T00:00:00/ 2018-04-30T20:05:43+00:00/ 2018-05-02T16:29:38+00:00/
2018-05-02T20:11:39+00:00/ 2018-05-03T14:54:22+00:00/
{code}


> log dir name mismatch with UI on /log
> -------------------------------------
>
>                 Key: AIRFLOW-2413
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2413
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: logging
>    Affects Versions: Airflow 2.0
>            Reporter: bhavin patel
>            Priority: Minor
>
> every time i tried to look for logs in UI , it gave me error message.
>  
> here is the url that makes the call 
> {code:java}
> http://localhost:8080/admin/airflow/log?dag_id=Struct-Pipeline-Runner&task_id=struct-event-model.02-sem-fill-mapping&execution_date=2018-05-03T14%3A54%3A22
> {code}
> {code:java}
> *** Log file isn't local.
> *** Fetching here: http://1.0.0.127.in-addr.arpa:8793/log/Struct-Pipeline-Runner/struct-event-model.02-sem-fill-mapping/2018-05-03T14:54:22/1.log
> *** Failed to fetch log file from worker. 404 Client Error: NOT FOUND for url: http://1.0.0.127.in-addr.arpa:8793/log/Struct-Pipeline-Runner/struct-event-model.02-sem-fill-mapping/2018-05-03T14:54:22/1.log
> {code}
>  
>  
> upon investigating I have found that the dir name generated by snowplow logger  is not
consistent with the name generated by UI
>  
>  
> {code:java}
> ~ $ ls -la .../airflow/logs/Struct-Pipeline-Runner/struct-event-model.02-sem-fill-mapping/2018-0
> 2018-04-23T00:00:00/ 2018-04-25T00:00:00/ 2018-04-30T20:05:43+00:00/ 2018-05-02T16:29:38+00:00/
2018-05-02T20:11:39+00:00/ 2018-05-03T14:54:22+00:00/
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message