spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From maropu <...@git.apache.org>
Subject [GitHub] spark pull request #20831: [SPARK-23614][SQL] Fix incorrect reuse exchange w...
Date Fri, 16 Mar 2018 09:09:13 GMT
Github user maropu commented on a diff in the pull request:

    https://github.com/apache/spark/pull/20831#discussion_r175030682
  
    --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryRelation.scala
---
    @@ -68,6 +69,15 @@ case class InMemoryRelation(
     
       override protected def innerChildren: Seq[SparkPlan] = Seq(child)
     
    +  override def doCanonicalize(): logical.LogicalPlan =
    +    copy(output = output.map(QueryPlan.normalizeExprId(_, child.output)),
    +      storageLevel = StorageLevel.NONE,
    +      child = child.canonicalized,
    +      tableName = None)(
    +      _cachedColumnBuffers,
    +      sizeInBytesStats,
    +      statsOfPlanToCache)
    --- End diff --
    
    aha, ok. Thanks!


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message