airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-1647) Fix Spark-sql hook
Date Wed, 27 Sep 2017 17:18:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-1647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182932#comment-16182932
] 

ASF subversion and git services commented on AIRFLOW-1647:
----------------------------------------------------------

Commit 6a9dc8ad183b906aa92f4a7197e078632c6e0ba6 in incubator-airflow's branch refs/heads/master
from [~Fokko]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=6a9dc8a ]

[AIRFLOW-1647] Fix Spark-sql hook

The logging in the spark-sql hook was not working
and causing an
exception because the _process_log is not
available. Write to
the log handler directly because the spark-sql
hook cant run in
yarn-cluster mode. Write tests which verify the
popen call of the
hook.

Closes #2637 from Fokko/AIRFLOW-1647-Fix-spark-
sql-hook


> Fix Spark-sql hook
> ------------------
>
>                 Key: AIRFLOW-1647
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1647
>             Project: Apache Airflow
>          Issue Type: Bug
>            Reporter: Fokko Driesprong
>
> The logging of the Spark-sql hook is not working properly. Will fix this and write a
proper test which invokes the command itself.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message