spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kan Zhang <kzh...@apache.org>
Subject Re: How to store JavaRDD as a sequence file using spark java API?
Date Fri, 20 Jun 2014 16:45:18 GMT
Yes, it can if you set the output format to SequenceFileOutputFormat. The
difference is saveAsSequenceFile does the conversion to Writable for you if
needed and then calls saveAsHadoopFile.


On Fri, Jun 20, 2014 at 12:43 AM, abhiguruvayya <sharath.abhishek@gmail.com>
wrote:

> Does JavaPairRDD.saveAsHadoopFile store data as a sequenceFile? Then what
> is
> the significance of RDD.saveAsSequenceFile?
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/How-to-store-JavaRDD-as-a-sequence-file-using-spark-java-API-tp7969p7983.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>

Mime
View raw message