hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pedro Costa <psdc1...@gmail.com>
Subject Re: Map output files contains headers?
Date Sun, 08 Aug 2010 14:30:15 GMT
I checked out those two files.

On the reduce side, this is the  file:
A   ??)

and on the map side,  this is the file:
A  ??%??d????

The hash should only be done the the letter A and now it's evident that the
hash is not being done to that. The file should only contain the letter A.

Maybe the reason is that I'm also reading trash, or simply I don't know what
this trash means. Any advice for this problem?


On Sun, Aug 8, 2010 at 2:50 PM, Pedro Costa <psdc1978@gmail.com> wrote:
> I'm testing the hashes using the wordcount example.
>
> On Sun, Aug 8, 2010 at 2:32 PM, welman Lu <welmanwenzi@gmail.com> wrote:
>> Are you sure the value type in <key, value> pair output by mapper,
>> is the same with the the value type in <key, value> pair that accepted by
>> reducer.
>>
>> I use the BytesWritable, and the sizes of the data are same.
>>
>
>
>
> --
> Pedro
>



-- 
Pedro

Mime
View raw message