airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dan Davydov (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-1780) Long Unicode Characters Cause Logging
Date Fri, 03 Nov 2017 01:00:09 GMT
Dan Davydov created AIRFLOW-1780:
------------------------------------

             Summary: Long Unicode Characters Cause Logging
                 Key: AIRFLOW-1780
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1780
             Project: Apache Airflow
          Issue Type: Bug
            Reporter: Dan Davydov
            Assignee: Dan Davydov
            Priority: Major


Conditions to replicate:
Create a DAG with a single BashOperator that logs ~10 long lines of text with at least one
unicode character (e.g. cat a file with these contents)
Use BashTaskRunner
Log to a file
Run a worker that picks up the task or an airflow run --local command

Behavior:
The BashOperator/cat command hangs

Most likely this is due to a pipe issue, where the unicode characters are filling up the pipe
and .format() is not able to process partial unicode characters. Interestingly removing one
of the conditions above (e.g. logging to stdout instead of a file or having short lines doesn't
cause the issue).



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message