airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "juhwi lee (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-2754) Invalid hive hdfs uri in case HDP
Date Mon, 16 Jul 2018 06:37:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-2754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

juhwi lee updated AIRFLOW-2754:
-------------------------------
    Description: 
HDFS URI in hive to druid operator is invalid in case of using HDP.

Default hive hdfs path starts with "/apps/hive/warehouse/~" in HDP and "/user/hive/warehouse/~"
in CDH.

To make both happy, we should remove the line finding '/user' path.
 m.get_table(hive_table).sd.location is enough to find right path of specific hive table.

 

 

  was:
HDFS URI is invalid in case of using HDP.

Default hive hdfs path starts with "/apps/hive/warehouse/~" in HDP and "/user/hive/warehouse/~"
in CDH.

To make both happy, we should remove the line finding '/user' path.
m.get_table(hive_table).sd.location is enough to find right path of specific hive table.

 

 


> Invalid hive hdfs uri in case HDP
> ---------------------------------
>
>                 Key: AIRFLOW-2754
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2754
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: operators
>    Affects Versions: 1.10
>            Reporter: juhwi lee
>            Priority: Major
>
> HDFS URI in hive to druid operator is invalid in case of using HDP.
> Default hive hdfs path starts with "/apps/hive/warehouse/~" in HDP and "/user/hive/warehouse/~"
in CDH.
> To make both happy, we should remove the line finding '/user' path.
>  m.get_table(hive_table).sd.location is enough to find right path of specific hive table.
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message