spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From gatorsmile <...@git.apache.org>
Subject [GitHub] spark pull request #20610: [SPARK-23426][SQL] Use `hive` ORC implementation ...
Date Wed, 14 Feb 2018 18:29:45 GMT
Github user gatorsmile commented on a diff in the pull request:

    https://github.com/apache/spark/pull/20610#discussion_r168267722
  
    --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
    @@ -399,11 +399,11 @@ object SQLConf {
     
       val ORC_IMPLEMENTATION = buildConf("spark.sql.orc.impl")
         .doc("When native, use the native version of ORC support instead of the ORC library
in Hive " +
    -      "1.2.1. It is 'hive' by default prior to Spark 2.3.")
    +      "1.2.1. It is 'hive' by default.")
         .internal()
         .stringConf
         .checkValues(Set("hive", "native"))
    -    .createWithDefault("native")
    +    .createWithDefault("hive")
    --- End diff --
    
    We also need to disable the ORC pushdown, because the ORC reader of Hive 1.2.1 has a few
bugs. 


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message