spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From cutl...@apache.org
Subject spark git commit: [SPARK-24324][PYTHON][FOLLOWUP] Grouped Map positional conf should have deprecation note
Date Tue, 26 Jun 2018 00:08:29 GMT
Repository: spark
Updated Branches:
  refs/heads/master 6d16b9885 -> d48803bf6


[SPARK-24324][PYTHON][FOLLOWUP] Grouped Map positional conf should have deprecation note

## What changes were proposed in this pull request?

Followup to the discussion of the added conf in SPARK-24324 which allows assignment by column
position only.  This conf is to preserve old behavior and will be removed in future releases,
so it should have a note to indicate that.

## How was this patch tested?

NA

Author: Bryan Cutler <cutlerb@gmail.com>

Closes #21637 from BryanCutler/arrow-groupedMap-conf-deprecate-followup-SPARK-24324.


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d48803bf
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d48803bf
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d48803bf

Branch: refs/heads/master
Commit: d48803bf64dc0fccd6f560738b4682f0c05e767a
Parents: 6d16b98
Author: Bryan Cutler <cutlerb@gmail.com>
Authored: Mon Jun 25 17:08:23 2018 -0700
Committer: Bryan Cutler <cutlerb@gmail.com>
Committed: Mon Jun 25 17:08:23 2018 -0700

----------------------------------------------------------------------
 .../src/main/scala/org/apache/spark/sql/internal/SQLConf.scala     | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/d48803bf/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
----------------------------------------------------------------------
diff --git a/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala b/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
index d5fb524..e768416 100644
--- a/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
+++ b/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
@@ -1167,7 +1167,7 @@ object SQLConf {
       .doc("When true, a grouped map Pandas UDF will assign columns from the returned " +
         "Pandas DataFrame based on position, regardless of column label type. When false,
" +
         "columns will be looked up by name if labeled with a string and fallback to use "
+
-        "position if not.")
+        "position if not. This configuration will be deprecated in future releases.")
       .booleanConf
       .createWithDefault(false)
 


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org


Mime
View raw message