airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sumit Maheshwari (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-119) "Template Not Found" error from QuboleOperator
Date Tue, 17 May 2016 16:14:12 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15286922#comment-15286922
] 

Sumit Maheshwari commented on AIRFLOW-119:
------------------------------------------

Hi Chris,

Thanks for taking a look. Actually I only added these operator/hook and it works :).

TBH I didn't have much clarity when added template_ext thing in operator. But it appears that
generally we don't need to have that support. All our scripts are in s3 only, so we've to
rename them otherwise. Added .txt support, so if needed we can leverage file templating.

I like the idea of skipping templating of remote files, but that change will go in {{resolve_template_files}}
only, and might impact other operators. 

Regards,
Sumit



> "Template Not Found" error from QuboleOperator
> ----------------------------------------------
>
>                 Key: AIRFLOW-119
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-119
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: operators
>    Affects Versions: Airflow 1.7.0
>            Reporter: Sumit Maheshwari
>              Labels: qds
>
> From the given example set, when I am using qbol operator for a hive workload, whose
script resides in s3 and ends with ".qbl", I am getting "Template Not Found" error. 
> Also it would be nice, if airflow always tags commands going from airflow to qds. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message