spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From gatorsmile <...@git.apache.org>
Subject [GitHub] spark pull request #20237: [SPARK-22980][PYTHON][SQL] Clarify the length of ...
Date Sat, 13 Jan 2018 13:22:10 GMT
Github user gatorsmile commented on a diff in the pull request:

    https://github.com/apache/spark/pull/20237#discussion_r161371988
  
    --- Diff: python/pyspark/sql/functions.py ---
    @@ -2184,6 +2184,11 @@ def pandas_udf(f=None, returnType=None, functionType=None):
            |         8|      JOHN DOE|          22|
            +----------+--------------+------------+
     
    +       .. note:: The length of `pandas.Series` within a scalar UDF is not that of the
whole input
    +           column, but is the length of an internal batch used for each call to the function.
    +           Therefore, this can be used, for example, to ensure the length of each returned
    --- End diff --
    
    `ensure`? Do you mean `measure`?


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message