spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Blaž Šnuderl <snud...@gmail.com>
Subject Pyspark dataframe read
Date Tue, 06 Oct 2015 07:02:41 GMT
Hello everyone.

It seems pyspark dataframe read is broken for reading multiple files.

sql.read.json( "file1,file2") fails with java.io.IOException: No input
paths specified in job.

This used to work in spark 1.4 and also still work with sc.textFile

Blaž

Mime
View raw message