airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paul Velthuis (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-3279) Documentation for Google Logging unclear
Date Wed, 31 Oct 2018 15:27:01 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-3279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Paul Velthuis updated AIRFLOW-3279:
-----------------------------------
    Description: 
The documentation of how to install logging to a Google Cloud bucket is unclear.

I am now following the tutorial on the airflow page:

[https://airflow.apache.org/howto/write-logs.html]

Here I find it unclear what part of the 'logger' I have to adjust in the `{{airflow/config_templates/airflow_local_settings.py}}`.

 

The adjustment states:

 

# Update the airflow.task and airflow.tas_runner blocks to be 'gcs.task' instead of 'file.task'.
'loggers': { 'airflow.task': { 'handlers': ['gcs.task'], ... }, 'airflow.task_runner': { 'handlers':
['gcs.task'], ... }, 'airflow': { 'handlers': ['console'], ... }, }

 

However what I find in the template is:
|'loggers': {|

|'airflow.processor': {|

|'handlers': ['processor'],|

|'level': LOG_LEVEL,|

|'propagate': False,|

|},|

|'airflow.task': {|

|'handlers': ['task'],|

|'level': LOG_LEVEL,|

|'propagate': False,|

|},|

|'flask_appbuilder': {|

|'handler': ['console'],|

|'level': FAB_LOG_LEVEL,|

|'propagate': True,|

|}|

},

 

Since for me it is very important to do it right at the first time I hope some clarity can
be provided in what has to be adjusted in the logger. Is it only the 'airflow.task' or more?

Another question I have is regarding step 6. The Google web hook. What kind of information
do you have to give at 'remote_log_conn_id =' Is this a self imagined name you can give, or
what is behind it?

 

  was:
The documentation of how to install logging to a Google Cloud bucket is unclear.

I am now following the tutorial on the airflow page:

[https://airflow.apache.org/howto/write-logs.html]

Here I find it unclear what part of the 'logger' I have to adjust in the `{{airflow/config_templates/airflow_local_settings.py}}`.

 

The adjustment states:

 

# Update the airflow.task and airflow.tas_runner blocks to be 'gcs.task' instead of 'file.task'.
'loggers': { 'airflow.task': { 'handlers': ['gcs.task'], ... }, 'airflow.task_runner': { 'handlers':
['gcs.task'], ... }, 'airflow': { 'handlers': ['console'], ... }, }

 

However what I find in the template is:
|'loggers': {|

|'airflow.processor': {|

|'handlers': ['processor'],|

|'level': LOG_LEVEL,|

|'propagate': False,|

|},|

|'airflow.task': {|

|'handlers': ['task'],|

|'level': LOG_LEVEL,|

|'propagate': False,|

|},|

|'flask_appbuilder': {|

|'handler': ['console'],|

|'level': FAB_LOG_LEVEL,|

|'propagate': True,|

|}|

},

 

Since for me it is very important to do it right at the first time I hope some clarity can
be provided in what has to be adjusted in the logger. Is it only the 'airflow.task' or more?

 


> Documentation for Google Logging unclear
> ----------------------------------------
>
>                 Key: AIRFLOW-3279
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3279
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: configuration, Documentation, logging
>            Reporter: Paul Velthuis
>            Assignee: Fokko Driesprong
>            Priority: Major
>
> The documentation of how to install logging to a Google Cloud bucket is unclear.
> I am now following the tutorial on the airflow page:
> [https://airflow.apache.org/howto/write-logs.html]
> Here I find it unclear what part of the 'logger' I have to adjust in the `{{airflow/config_templates/airflow_local_settings.py}}`.
>  
> The adjustment states:
>  
> # Update the airflow.task and airflow.tas_runner blocks to be 'gcs.task' instead of 'file.task'.
'loggers': { 'airflow.task': { 'handlers': ['gcs.task'], ... }, 'airflow.task_runner': { 'handlers':
['gcs.task'], ... }, 'airflow': { 'handlers': ['console'], ... }, }
>  
> However what I find in the template is:
> |'loggers': {|
> |'airflow.processor': {|
> |'handlers': ['processor'],|
> |'level': LOG_LEVEL,|
> |'propagate': False,|
> |},|
> |'airflow.task': {|
> |'handlers': ['task'],|
> |'level': LOG_LEVEL,|
> |'propagate': False,|
> |},|
> |'flask_appbuilder': {|
> |'handler': ['console'],|
> |'level': FAB_LOG_LEVEL,|
> |'propagate': True,|
> |}|
> },
>  
> Since for me it is very important to do it right at the first time I hope some clarity
can be provided in what has to be adjusted in the logger. Is it only the 'airflow.task' or
more?
> Another question I have is regarding step 6. The Google web hook. What kind of information
do you have to give at 'remote_log_conn_id =' Is this a self imagined name you can give, or
what is behind it?
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message