spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Laurent Legrand <llegr...@skapane.com>
Subject pyspark: sqlContext.read.text() does not work with a list of paths
Date Wed, 05 Oct 2016 12:12:08 GMT
Hello,

When I try to load multiple text files with the sqlContext, I get the
following error:

spark-2.0.0-bin-hadoop2.4/python/lib/pyspark.zip/pyspark/sql/readwriter.py",
line 282, in text
UnboundLocalError: local variable 'path' referenced before assignment

According to the code
(https://github.com/apache/spark/blob/master/python/pyspark/sql/readwriter.py#L291),
the variable 'path' is not set if the argument is not a string.

Could you confirm it is a bug?

Regards,
Laurent




--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/pyspark-sqlContext-read-text-does-not-work-with-a-list-of-paths-tp27838.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message