hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-7439) Spark job monitoring and error reporting [Spark Branch]
Date Fri, 10 Oct 2014 16:21:34 GMT

    [ https://issues.apache.org/jira/browse/HIVE-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14167062#comment-14167062
] 

Xuefu Zhang commented on HIVE-7439:
-----------------------------------

Hi [~chengxiang li], This looks very nice. Just wondering if we can also show the total number
of stages in the progressor? Otherwise, user sees 29/29 thinking that the job is done and
then finds there are 5 more stages to go. :)

> Spark job monitoring and error reporting [Spark Branch]
> -------------------------------------------------------
>
>                 Key: HIVE-7439
>                 URL: https://issues.apache.org/jira/browse/HIVE-7439
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Xuefu Zhang
>            Assignee: Chengxiang Li
>              Labels: Spark-M3
>         Attachments: HIVE-7439.1-spark.patch, hive on spark job status.PNG
>
>
> After Hive submits a job to Spark cluster, we need to report to user the job progress,
such as the percentage done, to the user. This is especially important for long running queries.
Moreover, if there is an error during job submission or execution, it's also crucial for hive
to fetch the error log and/or stacktrace and feedback it to the user.
> Please refer design doc on wiki for more information.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message