hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "chengxiang li" <chengxiang...@intel.com>
Subject Re: Review Request 26545: HIVE-7439, Spark job monitoring and error reporting[Spark Branch]
Date Sat, 11 Oct 2014 05:41:48 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26545/
-----------------------------------------------------------

(Updated 十月 11, 2014, 5:41 a.m.)


Review request for hive and Xuefu Zhang.


Changes
-------

add support to print job stage info at first.


Bugs: HIVE-7439
    https://issues.apache.org/jira/browse/HIVE-7439


Repository: hive-git


Description
-------

After Hive submits a job to Spark cluster, we need to report to user the job progress, such
as the percentage done, to the user. This is especially important for long running queries.
Moreover, if there is an error during job submission or execution, it's also crucial for hive
to fetch the error log and/or stacktrace and feedback it to the user.


Diffs (updated)
-----

  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkClient.java 89fa854 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkPlan.java ecb311b 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/SparkJobMonitor.java PRE-CREATION

  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/SparkJobState.java PRE-CREATION

  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/SparkJobStatus.java PRE-CREATION

  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/SparkProgress.java PRE-CREATION

  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/impl/JobStateListener.java PRE-CREATION

  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/impl/SimpleSparkJobStatus.java PRE-CREATION


Diff: https://reviews.apache.org/r/26545/diff/


Testing
-------


Thanks,

chengxiang li


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message