spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From BryanCutler <...@git.apache.org>
Subject [GitHub] spark pull request #21427: [SPARK-24324][PYTHON] Pandas Grouped Map UDF shou...
Date Mon, 18 Jun 2018 22:18:28 GMT
Github user BryanCutler commented on a diff in the pull request:

    https://github.com/apache/spark/pull/21427#discussion_r196243235
  
    --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
    @@ -1161,6 +1161,16 @@ object SQLConf {
           .booleanConf
           .createWithDefault(true)
     
    +  val PANDAS_GROUPED_MAP_ASSIGN_COLUMNS_BY_POSITION =
    +    buildConf("spark.sql.execution.pandas.groupedMap.assignColumnsByPosition")
    +      .internal()
    +      .doc("When true, a grouped map Pandas UDF will assign columns from the returned
" +
    +        "Pandas DataFrame based on position, regardless of column label type. When false,
" +
    +        "columns will be looked up by name if labeled with a string and fallback to use"
+
    --- End diff --
    
    This can also be marked as deprecated right?


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message