hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abhinav M Kulkarni <abhinavkulka...@gmail.com>
Subject Re: Multiple mappers, different parameter values
Date Tue, 02 Apr 2013 19:40:17 GMT
Hi Mirko,

Thanks for the reply.

Yeah that's one solution.

--
Abhinav


On 04/02/2013 10:04 AM, Mirko Kämpf wrote:
> Hi,
>
> I would add an id to the parameter name: "num.iterations.ID 
> <http://num.iterations.ID>=something"
> If your mapper knows what ID it has it can just pick up this value 
> from the context. But the question is:
> How does the mapper know about it's ID? Is it related to the input? 
> Thank it can be calculated but this is
> a domain specific issue.
>
> Best wishes
> Mirko
>
>
> 2013/4/2 Abhinav M Kulkarni <abhinavkulkarni@gmail.com 
> <mailto:abhinavkulkarni@gmail.com>>
>
>     Hi,
>
>     I have a situation wherein I have multiple mappers. I am using
>     MultipleInputs class to add them.
>
>     Now, I need to pass different parameters to different mappers. For
>     e.g. lets say I have a parameter 'num.iterations' that is set
>     differently for different mappers. One way to pass parameters to
>     mappers is to set them in a Configuration object:
>
>     Configuration conf = new Configuration();
>     conf.set("num.iterations", "100");
>
>     However using this I can't set the value differently for different
>     mappers. How do I achieve this?
>
>     Thanks,
>     Abhinav
>
>


Mime
View raw message