hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Akira Kitada <akit...@gmail.com>
Subject Re: Changing key/value separator in hadoop streaming
Date Sat, 21 Mar 2009 13:41:14 GMT
I thought I foumd the way but I was wrong.
It seems Hadoop automatically converts my
separator that I told hadoop to use into the default separator, a tab...

Is there any way of changing this default
and output keyvalue with custom separator?

On 3/21/09, Akira Kitada <akitada@gmail.com> wrote:
> answering myself.
>
> stream.map.output.field.separator is not for
> how framework output data but how it will
> treat the data.
>
> All I have to do was to let mapper emit key value with my separator
> and tell that to hadoop.
>
> Thanks
> On 3/21/09, Akira Kitada <akitada@gmail.com> wrote:
>> Hi,
>> I am trying to find a way to change
>> key-value field separator of streaming.
>> Streaming documentation says it can be
>> configured with "stream.map.output.field.separator"
>> and I tried but it had no effect.
>>
>> Am I missing something?
>>
>> I use hadoop 0.18.3
>>
>> thanks in advance
>>
>

Mime
View raw message