hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From devdoer bird <devdo...@gmail.com>
Subject Re: How to remove ending tab separator in streaming output
Date Wed, 28 Dec 2011 16:59:20 GMT
Thanks.

  I wan to remove the sep character from the streaming output, even if the
input line contains no sep and hence the whole line is treated as  the key.
Is there any method?

2011/12/27 Mahadev Konar <mahadev@hortonworks.com>

> Bccing common-user and ccing mapred-user. Please use the correct
> mailing lists for your questions.
>
> You can use -Dstream.map.output.field.separator=
>  for specifying the seperator.
>
>   The link below should have more information.
>
>
> http://hadoop.apache.org/common/docs/r0.20.205.0/streaming.html#Customizing+How+Lines+are+Split+into+Key%2FValue+Pairs
>
> Hope that helps.
>
> thanks
> mahadev
>
>
> On Mon, Dec 26, 2011 at 2:42 AM, devdoer bird <devdoer2@gmail.com> wrote:
> >
> > HI:
> >
> > In streming MR program, I use /bin/cat as a mapper and set reducer=NONE,
> >  but the outputs all end with a tab separator. How do I configure the
> > streaming MR program to remove the ending separator?
> >
> > Thanks.
>

Mime
View raw message