spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Reynold Xin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-2636) no where to get job identifier while submit spark job through spark API
Date Tue, 05 Aug 2014 17:18:14 GMT

    [ https://issues.apache.org/jira/browse/SPARK-2636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086501#comment-14086501
] 

Reynold Xin commented on SPARK-2636:
------------------------------------

Yes - I meant job id.

> no where to get job identifier while submit spark job through spark API
> -----------------------------------------------------------------------
>
>                 Key: SPARK-2636
>                 URL: https://issues.apache.org/jira/browse/SPARK-2636
>             Project: Spark
>          Issue Type: New Feature
>            Reporter: Chengxiang Li
>
> In Hive on Spark, we want to track spark job status through Spark API, the basic idea
is as following:
> # create an hive-specified spark listener and register it to spark listener bus.
> # hive-specified spark listener generate job status by spark listener events.
> # hive driver track job status through hive-specified spark listener. 
> the current problem is that hive driver need job identifier to track specified job status
through spark listener, but there is no spark API to get job identifier(like job id) while
submit spark job.
> I think other project whoever try to track job status with spark API would suffer from
this as well.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message