spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From cloud-fan <...@git.apache.org>
Subject [GitHub] spark pull request #20487: [SPARK-23319][TESTS] Explicitly specify Pandas an...
Date Wed, 07 Feb 2018 07:29:46 GMT
Github user cloud-fan commented on a diff in the pull request:

    https://github.com/apache/spark/pull/20487#discussion_r166536018
  
    --- Diff: python/pyspark/sql/session.py ---
    @@ -646,6 +646,9 @@ def createDataFrame(self, data, schema=None, samplingRatio=None, verifySchema=Tr
             except Exception:
                 has_pandas = False
             if has_pandas and isinstance(data, pandas.DataFrame):
    +            from pyspark.sql.utils import require_minimum_pandas_version
    +            require_minimum_pandas_version()
    --- End diff --
    
    just for curious, do you have a list of the places that we do this version check for pandas
and pyarrow?


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message