spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From cloud-fan <...@git.apache.org>
Subject [GitHub] spark pull request #19760: [SPARK-22533][core] Handle deprecated names in Co...
Date Thu, 16 Nov 2017 20:12:28 GMT
Github user cloud-fan commented on a diff in the pull request:

    https://github.com/apache/spark/pull/19760#discussion_r151524853
  
    --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala ---
    @@ -663,8 +663,10 @@ private[spark] object SparkConf extends Logging {
           AlternateConfig("spark.yarn.jar", "2.0")),
         "spark.yarn.access.hadoopFileSystems" -> Seq(
           AlternateConfig("spark.yarn.access.namenodes", "2.2")),
    -    "spark.maxRemoteBlockSizeFetchToMem" -> Seq(
    -      AlternateConfig("spark.reducer.maxReqSizeShuffleToMem", "2.3"))
    +    MAX_REMOTE_BLOCK_SIZE_FETCH_TO_MEM.key -> Seq(
    +      AlternateConfig("spark.reducer.maxReqSizeShuffleToMem", "2.3")),
    +    LISTENER_BUS_EVENT_QUEUE_CAPACITY.key -> Seq(
    +      AlternateConfig("spark.scheduler.listenerbus.eventqueue.size", "2.3"))
    --- End diff --
    
    but you need to hardcode the config key here, if the config entry is defined in SQL module.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message