airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <>
Subject [jira] [Commented] (AIRFLOW-1647) Fix Spark-sql hook
Date Wed, 27 Sep 2017 17:18:00 GMT


ASF subversion and git services commented on AIRFLOW-1647:

Commit 6a9dc8ad183b906aa92f4a7197e078632c6e0ba6 in incubator-airflow's branch refs/heads/master
from [~Fokko]
[;h=6a9dc8a ]

[AIRFLOW-1647] Fix Spark-sql hook

The logging in the spark-sql hook was not working
and causing an
exception because the _process_log is not
available. Write to
the log handler directly because the spark-sql
hook cant run in
yarn-cluster mode. Write tests which verify the
popen call of the

Closes #2637 from Fokko/AIRFLOW-1647-Fix-spark-

> Fix Spark-sql hook
> ------------------
>                 Key: AIRFLOW-1647
>                 URL:
>             Project: Apache Airflow
>          Issue Type: Bug
>            Reporter: Fokko Driesprong
> The logging of the Spark-sql hook is not working properly. Will fix this and write a
proper test which invokes the command itself.

This message was sent by Atlassian JIRA

View raw message