hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Fengyun RAO <raofeng...@gmail.com>
Subject Re: Map-Reduce: How to make MR output one file an hour?
Date Sat, 01 Mar 2014 09:59:11 GMT
Thanks, but how to set reducer number to X? X is dependent on input
(run-time), which is unknown on job configuration (compile time).


2014-03-01 17:44 GMT+08:00 AnilKumar B <akumarb2010@gmail.com>:

> Hi,
>
> Write the custom partitioner on <timestamp> and as you mentioned set
> #reducers to X.
>
>
>

Mime
View raw message