hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mahesh Balija <balijamahesh....@gmail.com>
Subject Re: SequenceFileOutputFormat - Custom Type Key & Value
Date Fri, 01 Feb 2013 16:05:44 GMT
You NO need to do anything specifically to emit Text, VectorWritable into
your SequenceFileOutputFormat.
Rather you need to just emit the Key as Text and value as VectorWritable in
your Reducer method.
And just set the setOutputKeyClass and setOutputValueClass with these on
your JobConf or Job instances based on how you are defining the MR job.

Best,
Mahesh Balija,
CalsoftLabs.


On Fri, Feb 1, 2013 at 6:37 PM, Anbarasan Murthy <anbarasan.m@hcl.com>wrote:

> By default SequenceFileOutputFormat  expects the ****
>
> Input – LongWritable****
>
> Output – Text****
>
> ** **
>
> I would like to know how to set custom data types for
> SequenceFileOutputFormat.****
>
> ** **
>
> How can I achieve the below configuration with SequenceFileOutputFormat***
> *
>
> My mapper/reducer output will be ****
>
> Key - Text****
>
> Value – VectorWritable****
>
> ** **
>
> ** **
>
> Thanks,****
>
> Anbu.****
>
> ** **
>
> ** **
>
>
>
> ::DISCLAIMER::
>
> ----------------------------------------------------------------------------------------------------------------------------------------------------
>
> The contents of this e-mail and any attachment(s) are confidential and
> intended for the named recipient(s) only.
> E-mail transmission is not guaranteed to be secure or error-free as
> information could be intercepted, corrupted,
> lost, destroyed, arrive late or incomplete, or may contain viruses in
> transmission. The e mail and its contents
> (with or without referred errors) shall therefore not attach any liability
> on the originator or HCL or its affiliates.
> Views or opinions, if any, presented in this email are solely those of the
> author and may not necessarily reflect the
> views or opinions of HCL or its affiliates. Any form of reproduction,
> dissemination, copying, disclosure, modification,
> distribution and / or publication of this message without the prior
> written consent of authorized representative of
> HCL is strictly prohibited. If you have received this email in error
> please delete it and notify the sender immediately.
> Before opening any email and/or attachments, please check them for viruses
> and other defects.
>
>
> ----------------------------------------------------------------------------------------------------------------------------------------------------
>

Mime
View raw message