airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ace Haidrey (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-1153) params in HiveOperator constructor can't be passed into Hive execution context
Date Thu, 08 Mar 2018 22:06:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391975#comment-16391975
] 

Ace Haidrey commented on AIRFLOW-1153:
--------------------------------------

[~mikemole@gmail.com] agreed that would be nice and probably how it should be.. I think you
can add it to the params? But I haven't tried this myself and I agree it's not very straightforward
on how to accomplish this. Do you have suggestions

> params in HiveOperator constructor can't be passed into Hive execution context
> ------------------------------------------------------------------------------
>
>                 Key: AIRFLOW-1153
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1153
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: hive_hooks, operators
>    Affects Versions: Airflow 2.0, Airflow 1.8
>            Reporter: Xianping lin
>            Priority: Critical
>              Labels: easyfix, newbie
>
> params parameter in HiveOperator can't be imported into Hive executation context.
>     so the following centence won't work, because 'mynumber' doesn't work for sql sentence.
>     test_hiveoperator = HiveOperator(
>         task_id='hive_test',
>         hiveconf_jinja_translate=True,
>         hql = ''' use myDB;
>             INSERT OVERWRITE TABLE t2
>             select * from t1 where t1.x > ' ${hiveconf:mynumber}'
>         ''',
>         params={'mynumber': 2},
>         dag=dag
>     )
>     this modification pass the 'params' in HiveOperator construction to Hive sql execution
context.
>     The the variable definition can pass to hive sql



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message