airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "juhwi lee (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-2792) Druid ingestion fails because of unicode.
Date Tue, 24 Jul 2018 08:58:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

juhwi lee updated AIRFLOW-2792:
-------------------------------
    Description: 
Druid Ingestion in druid_hook.py is going to fail because index spec includes unicode.
 Python uses unicode automatically.

My index spec values had unicode. So ingestion to druid failed.
 'intervals': [u'2017-01-01T00:00:00.000Z/2017-01-02T00:00:00.000Z'],

Payload data dosen't have any unicode if we use not data parameter but json parameter in post
requests. Then ingestion succeed
 "intervals": ["2017-01-01T00:00:00.000Z/2017-01-02T00:00:00.000Z"]

 

I referenced document of python-requests.
 [http://docs.python-requests.org/en/master/user/quickstart/#more-complicated-post-requests]

 

  was:
Druid Ingestion is going to fail because index spec includes unicode.
Python uses unicode automatically.

My index spec values had unicode. So ingestion to druid failed.
'intervals': [u'2017-01-01T00:00:00.000Z/2017-01-02T00:00:00.000Z'],

Payload data dosen't have any unicode if we use not data parameter but json parameter in post
requests. Then ingestion succeed
"intervals": ["2017-01-01T00:00:00.000Z/2017-01-02T00:00:00.000Z"]

 

I referenced document of python-requests.
[http://docs.python-requests.org/en/master/user/quickstart/#more-complicated-post-requests]

 


> Druid ingestion fails because of unicode.
> -----------------------------------------
>
>                 Key: AIRFLOW-2792
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2792
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: hooks
>    Affects Versions: 1.10
>            Reporter: juhwi lee
>            Priority: Major
>
> Druid Ingestion in druid_hook.py is going to fail because index spec includes unicode.
>  Python uses unicode automatically.
> My index spec values had unicode. So ingestion to druid failed.
>  'intervals': [u'2017-01-01T00:00:00.000Z/2017-01-02T00:00:00.000Z'],
> Payload data dosen't have any unicode if we use not data parameter but json parameter
in post requests. Then ingestion succeed
>  "intervals": ["2017-01-01T00:00:00.000Z/2017-01-02T00:00:00.000Z"]
>  
> I referenced document of python-requests.
>  [http://docs.python-requests.org/en/master/user/quickstart/#more-complicated-post-requests]
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message