spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Sebastian (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-18120) QueryExecutionListener method doesnt' get executed for DataFrameWriter methods
Date Thu, 19 Jan 2017 17:37:26 GMT

    [ https://issues.apache.org/jira/browse/SPARK-18120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830307#comment-15830307
] 

Thomas Sebastian commented on SPARK-18120:
------------------------------------------

Hi [~salilsurendran]
Are you working on this, please let us know ?
I can submit a PR.



> QueryExecutionListener method doesnt' get executed for DataFrameWriter methods
> ------------------------------------------------------------------------------
>
>                 Key: SPARK-18120
>                 URL: https://issues.apache.org/jira/browse/SPARK-18120
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 2.0.1
>            Reporter: Salil Surendran
>
> QueryExecutionListener is a class that has methods named onSuccess() and onFailure()
that gets called when a query is executed. Each of those methods takes a QueryExecution object
as a parameter which can be used for metrics analysis. It gets called for several of the DataSet
methods like take, head, first, collect etc. but doesn't get called for any of the DataFrameWriter
methods like saveAsTable, save etc. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message