Return-Path: X-Original-To: apmail-spark-user-archive@minotaur.apache.org Delivered-To: apmail-spark-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6F0FB11B73 for ; Fri, 20 Jun 2014 16:45:46 +0000 (UTC) Received: (qmail 53386 invoked by uid 500); 20 Jun 2014 16:45:45 -0000 Delivered-To: apmail-spark-user-archive@spark.apache.org Received: (qmail 53336 invoked by uid 500); 20 Jun 2014 16:45:45 -0000 Mailing-List: contact user-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@spark.apache.org Delivered-To: mailing list user@spark.apache.org Received: (qmail 53326 invoked by uid 99); 20 Jun 2014 16:45:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Jun 2014 16:45:45 +0000 X-ASF-Spam-Status: No, hits=2.8 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,URI_HEX X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of kanzhangemail@gmail.com designates 209.85.213.180 as permitted sender) Received: from [209.85.213.180] (HELO mail-ig0-f180.google.com) (209.85.213.180) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Jun 2014 16:45:42 +0000 Received: by mail-ig0-f180.google.com with SMTP id h18so719628igc.7 for ; Fri, 20 Jun 2014 09:45:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:reply-to:sender:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=y8dfnxmkjRcMmgcZy9hD35JpUGmaLltzOTQbXgzDfYE=; b=RALRY4P+XeoCtJzw/Ta7c++d6OOpTDKnra2PneBWUo4MOoKslT6GO8HlWwHrL6589V +6CSxbkxdgu/y3KIuW3OPEpN3u7pKGSmA7jaTVQ7skQSQbTdvJdHtJEd+PHVUWZfXea3 MZzq87zVNsltWwp0YZ8TmvbFUH/dLRvOHMGQf6iGk61QNy5nZkfsM2vYlopH2iqofjQO WogoJ3MuRk36hmLPp8ixx6teeY8UxqpNPNsa3Cna3Pch8nBvQlfXfy8xGxvOOeDfBj0u kwESf/C+e04Svv6UZBGc0Vu6Ft0H6SlNzJrO7jAy/WhffuSqzmbj0XEyX1A8SoBNT2ou NPhQ== MIME-Version: 1.0 X-Received: by 10.42.72.198 with SMTP id p6mr4950101icj.52.1403282718119; Fri, 20 Jun 2014 09:45:18 -0700 (PDT) Reply-To: kzhang@apache.org Sender: kanzhangemail@gmail.com Received: by 10.64.22.230 with HTTP; Fri, 20 Jun 2014 09:45:18 -0700 (PDT) In-Reply-To: <1403250239587-7983.post@n3.nabble.com> References: <1403225683431-7969.post@n3.nabble.com> <1403236140209-7973.post@n3.nabble.com> <1403245344296-7980.post@n3.nabble.com> <1403250239587-7983.post@n3.nabble.com> Date: Fri, 20 Jun 2014 09:45:18 -0700 X-Google-Sender-Auth: bkcnwD453jetOSU9LtwnN8nkt0s Message-ID: Subject: Re: How to store JavaRDD as a sequence file using spark java API? From: Kan Zhang To: user@spark.apache.org Content-Type: multipart/alternative; boundary=90e6ba613b9aeedd1b04fc47375f X-Virus-Checked: Checked by ClamAV on apache.org --90e6ba613b9aeedd1b04fc47375f Content-Type: text/plain; charset=UTF-8 Yes, it can if you set the output format to SequenceFileOutputFormat. The difference is saveAsSequenceFile does the conversion to Writable for you if needed and then calls saveAsHadoopFile. On Fri, Jun 20, 2014 at 12:43 AM, abhiguruvayya wrote: > Does JavaPairRDD.saveAsHadoopFile store data as a sequenceFile? Then what > is > the significance of RDD.saveAsSequenceFile? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/How-to-store-JavaRDD-as-a-sequence-file-using-spark-java-API-tp7969p7983.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > --90e6ba613b9aeedd1b04fc47375f Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Yes, it can if you set the output format to SequenceFileOu= tputFormat. The difference is saveAsSequenceFile does the conversion to Wri= table for you if needed and then calls saveAsHadoopFile.


On Fri, Jun 20, 2014 at 12:43 AM, abhigu= ruvayya <sharath.abhishek@gmail.com> wrote:
Does JavaPairRDD.saveAsHadoopFile store data as a sequenceFile? Then what i= s
the significance of RDD.saveAsSequenceFile?



--
View this message in context: http://apache-spark-user-list.10015= 60.n3.nabble.com/How-to-store-JavaRDD-as-a-sequence-file-using-spark-java-A= PI-tp7969p7983.html
Sent from the Apache Spark User Lis= t mailing list archive at Nabble.com.

--90e6ba613b9aeedd1b04fc47375f--