spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From HyukjinKwon <...@git.apache.org>
Subject [GitHub] spark pull request #21467: [SPARK-23754][PYTHON][FOLLOWUP] Move UDF stop ite...
Date Fri, 01 Jun 2018 17:00:50 GMT
Github user HyukjinKwon commented on a diff in the pull request:

    https://github.com/apache/spark/pull/21467#discussion_r192456717
  
    --- Diff: python/pyspark/worker.py ---
    @@ -140,15 +139,20 @@ def read_single_udf(pickleSer, infile, eval_type):
             else:
                 row_func = chain(row_func, f)
     
    +    # make sure StopIteration's raised in the user code are not
    +    # ignored, but re-raised as RuntimeError's
    +    func = fail_on_stopiteration(row_func)
    --- End diff --
    
    Ah, sure.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message