spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From e-dorigatti <...@git.apache.org>
Subject [GitHub] spark pull request #21467: [SPARK-23754][Python] Fix UDF argspec hack
Date Thu, 31 May 2018 14:16:30 GMT
Github user e-dorigatti commented on a diff in the pull request:

    https://github.com/apache/spark/pull/21467#discussion_r192114498
  
    --- Diff: python/pyspark/worker.py ---
    @@ -69,6 +69,7 @@ def chain(f, g):
     
     
     def wrap_udf(f, return_type):
    +    f = fail_on_stopiteration(f)
    --- End diff --
    
    `wrap_grouped_map_pandas_udf` needs to call `argspec`, so we would need to check `evalType`
twice in `read_single_udf`. But it's possible, yea


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message