hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "chengxiang li" <chengxiang...@intel.com>
Subject Review Request 26545: HIVE-7439, Spark job monitoring and error reporting[Spark Branch]
Date Fri, 10 Oct 2014 09:48:02 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26545/
-----------------------------------------------------------

Review request for hive and Xuefu Zhang.


Bugs: HIVE-7439
    https://issues.apache.org/jira/browse/HIVE-7439


Repository: hive-git


Description
-------

After Hive submits a job to Spark cluster, we need to report to user the job progress, such
as the percentage done, to the user. This is especially important for long running queries.
Moreover, if there is an error during job submission or execution, it's also crucial for hive
to fetch the error log and/or stacktrace and feedback it to the user.


Diffs
-----

  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkClient.java 89fa854 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkPlan.java ecb311b 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/SparkJobMonitor.java PRE-CREATION

  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/SparkJobState.java PRE-CREATION

  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/SparkJobStatus.java PRE-CREATION

  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/SparkProgress.java PRE-CREATION

  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/impl/JobStateListener.java PRE-CREATION

  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/impl/SimpleSparkJobStatus.java PRE-CREATION


Diff: https://reviews.apache.org/r/26545/diff/


Testing
-------


Thanks,

chengxiang li


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message