airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abhishek Sinha <abhis...@infoworks.io>
Subject Error for unicode characters in Bash script output
Date Fri, 09 Nov 2018 14:39:30 GMT
Hi,

I get the following error if a script inside bash operator gives out
unicode characters:

Traceback (most recent call last):
  File "/home/ec2-user/resources/python27/lib/python2.7/threading.py", line
810, in __bootstrap_inner
    self.run()
  File "/home/ec2-user/resources/python27/lib/python2.7/threading.py", line
763, in run
    self.__target(*self.__args, **self.__kwargs)
  File
"/home/ec2-user/resources/python27/lib/python2.7/site-packages/airflow/task_runner/base_task_runner.py",
line 95, in _read_task_logs
    self.logger.info('Subtask: {}'.format(line.rstrip('\n')))
UnicodeEncodeError: 'ascii' codec can't encode character u'\xe9' in
position 572: ordinal not in range(128)


I saw in the BashOperator code that there is a way to override
output_encoding (default: UTF-8). However, in the base_task_runner.py code,
I see that the encoding is hardcoded to UTF-8. Am I missing something?

Airflow version: 1.8.2





Regards,

Abhishek

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message