hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang" <xzh...@cloudera.com>
Subject Re: Review Request 30024: HIVE-9395 Make WAIT_SUBMISSION_TIMEOUT configuable and check timeout in SparkJobMonitor level.[Spark Branch]
Date Mon, 19 Jan 2015 14:29:21 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/30024/#review68602
-----------------------------------------------------------



ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkTask.java
<https://reviews.apache.org/r/30024/#comment112920>

    When job submission times out, is it still meaningful to get statisics?



ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/SparkJobMonitor.java
<https://reviews.apache.org/r/30024/#comment112922>

    Can we store the value of the property so that we don't get it in every loop?


- Xuefu Zhang


On Jan. 19, 2015, 8:17 a.m., chengxiang li wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/30024/
> -----------------------------------------------------------
> 
> (Updated Jan. 19, 2015, 8:17 a.m.)
> 
> 
> Review request for hive, Rui Li and Xuefu Zhang.
> 
> 
> Bugs: HIVE-9395
>     https://issues.apache.org/jira/browse/HIVE-9395
> 
> 
> Repository: hive-git
> 
> 
> Description
> -------
> 
> make job submission timeout value configurable and check job submission timeout at SparkJobMonitor
level.
> 
> 
> Diffs
> -----
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 068c962 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/spark/LocalHiveSparkClient.java bc409a5

>   ql/src/java/org/apache/hadoop/hive/ql/exec/spark/RemoteHiveSparkClient.java 85439e3

>   ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkTask.java 7c59cf1 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/SparkJobMonitor.java a8bda6c

>   ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/SparkJobRef.java cb84556 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/SparkJobStatus.java cdbc59c

>   ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/impl/LocalSparkJobRef.java
PRE-CREATION 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/impl/RemoteSparkJobRef.java
PRE-CREATION 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/impl/RemoteSparkJobStatus.java
85c1ac0 
> 
> Diff: https://reviews.apache.org/r/30024/diff/
> 
> 
> Testing
> -------
> 
> 
> Thanks,
> 
> chengxiang li
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message