hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jason <urg...@gmail.com>
Subject Re: How to merge several SequenceFile into one?
Date Thu, 12 May 2011 05:21:08 GMT
M/R job with a single reducer would do the job. This way you can
utilize distributed sort and merge/combine/dedupe key/values as you
wish.

On 5/11/11, 丛林 <conglin02@gmail.com> wrote:
> Hi all,
>
> There is lots of SequenceFile in HDFS, how can I merge them into one
> SequenceFile?
>
> Thanks for you suggestion.
>
> -Lin
>

Mime
View raw message