hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ilyal levin <nipponil...@gmail.com>
Subject Re: How to Create an effective chained MapReduce program.
Date Wed, 07 Sep 2011 22:10:30 GMT
Can you be more specific on how to perform this. In general is there a way
to convert the binary files i have to text files?



On Tue, Sep 6, 2011 at 11:26 PM, David Rosenstrauch <darose@darose.net>wrote:

> On 09/06/2011 01:57 AM, Niels Basjes wrote:
>
>> Hi,
>>
>> In the past i've had the same situation where I needed the data for
>> debugging. Back then I chose to create a second job with simply
>> SequenceFileInputFormat, IdentityMapper, IdentityReducer and finally
>> TextOutputFormat.
>>
>> In my situation that worked great for my purpose.
>>
>
> I did similar at my last job, but rather than writing a 2nd map/reduce job
> for this, we just wrote a simple command line app that used the Hadoop Java
> API to dump the contents of the binary file as text (JSON) to the console.
>
> HTH,
>
> DR
>

Mime
View raw message