hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From cheng xu <cheng.a...@intel.com>
Subject Re: Review Request 48839: HIVE-14029: Update Spark version to 2.0.0
Date Wed, 21 Sep 2016 05:27:49 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/48839/
-----------------------------------------------------------

(Updated Sept. 21, 2016, 1:27 p.m.)


Review request for hive, Rui Li, Sergio Pena, Szehon Ho, and Xuefu Zhang.


Bugs: HIVE-14029
    https://issues.apache.org/jira/browse/HIVE-14029


Repository: hive-git


Description
-------

There are quite some new optimizations in Spark 2.0.0. We need to bump up Spark to 2.0.0 to
benefit those performance improvements.


Diffs (updated)
-----

  itests/pom.xml a452db3 
  pom.xml 2fb78cd 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HiveBaseFunctionResultList.java 5b65036

  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HiveMapFunction.java 53c5c0e 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HiveReduceFunction.java f6595f1 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SortByShuffler.java a6350d3 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/impl/JobMetricsListener.java 09c54c1

  ql/src/test/org/apache/hadoop/hive/ql/exec/spark/TestHiveKVResultCache.java ee9f9b7 
  spark-client/pom.xml 6cf3b17 
  spark-client/src/main/java/org/apache/hive/spark/client/MetricsCollection.java e77aa78 
  spark-client/src/main/java/org/apache/hive/spark/client/RemoteDriver.java e3b88d1 
  spark-client/src/main/java/org/apache/hive/spark/client/metrics/InputMetrics.java e46b67d

  spark-client/src/main/java/org/apache/hive/spark/client/metrics/Metrics.java a7305cf 
  spark-client/src/main/java/org/apache/hive/spark/client/metrics/ShuffleReadMetrics.java
be14c06 
  spark-client/src/main/java/org/apache/hive/spark/client/metrics/ShuffleWriteMetrics.java
4420e4d 
  spark-client/src/test/java/org/apache/hive/spark/client/TestMetricsCollection.java 5146e91


Diff: https://reviews.apache.org/r/48839/diff/


Testing
-------


Thanks,

cheng xu


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message