spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From r...@apache.org
Subject spark git commit: [SPARK-17991][SQL] Enable metastore partition pruning by default.
Date Thu, 20 Oct 2016 06:55:09 GMT
Repository: spark
Updated Branches:
  refs/heads/master 39755169f -> 4bd17c460


[SPARK-17991][SQL] Enable metastore partition pruning by default.

## What changes were proposed in this pull request?

This should apply to non-converted metastore relations. WIP to see if this causes any test
failures.

## How was this patch tested?

Existing tests.

Author: Eric Liang <ekl@databricks.com>

Closes #15475 from ericl/try-enabling-pruning.


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4bd17c46
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/4bd17c46
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/4bd17c46

Branch: refs/heads/master
Commit: 4bd17c4606764242bc29888b8eedc8e4b5a00f46
Parents: 3975516
Author: Eric Liang <ekl@databricks.com>
Authored: Wed Oct 19 23:55:05 2016 -0700
Committer: Reynold Xin <rxin@databricks.com>
Committed: Wed Oct 19 23:55:05 2016 -0700

----------------------------------------------------------------------
 .../src/main/scala/org/apache/spark/sql/internal/SQLConf.scala     | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/4bd17c46/sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
----------------------------------------------------------------------
diff --git a/sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala b/sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
index 9061b1b..ebf4fad 100644
--- a/sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
+++ b/sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
@@ -267,7 +267,7 @@ object SQLConf {
       .doc("When true, some predicates will be pushed down into the Hive metastore so that
" +
            "unmatching partitions can be eliminated earlier.")
       .booleanConf
-      .createWithDefault(false)
+      .createWithDefault(true)
 
   val HIVE_FILESOURCE_PARTITION_PRUNING =
     SQLConfigBuilder("spark.sql.hive.filesourcePartitionPruning")


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org


Mime
View raw message