hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <>
Subject [jira] [Commented] (HIVE-7439) Spark job monitoring and error reporting [Spark Branch]
Date Tue, 14 Oct 2014 03:38:34 GMT


Xuefu Zhang commented on HIVE-7439:

Hi [~leftylev], this is not required to get started, but it's useful for user to get an idea
of the job progress. Hopefully, the information presented to the user is self-evident. Thus,
I think we are okay for now.

> Spark job monitoring and error reporting [Spark Branch]
> -------------------------------------------------------
>                 Key: HIVE-7439
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Xuefu Zhang
>            Assignee: Chengxiang Li
>              Labels: Spark-M3
>             Fix For: spark-branch
>         Attachments: HIVE-7439.1-spark.patch, HIVE-7439.2-spark.patch, HIVE-7439.2-spark.patch,
HIVE-7439.3-spark.patch, HIVE-7439.3-spark.patch, hive on spark job status.PNG
> After Hive submits a job to Spark cluster, we need to report to user the job progress,
such as the percentage done, to the user. This is especially important for long running queries.
Moreover, if there is an error during job submission or execution, it's also crucial for hive
to fetch the error log and/or stacktrace and feedback it to the user.
> Please refer design doc on wiki for more information.

This message was sent by Atlassian JIRA

View raw message