hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mirko Kämpf <mirko.kae...@gmail.com>
Subject Re: Multiple mappers, different parameter values
Date Tue, 02 Apr 2013 17:04:21 GMT

I would add an id to the parameter name: "num.iterations.ID=something"
If your mapper knows what ID it has it can just pick up this value from the
context. But the question is:
How does the mapper know about it's ID? Is it related to the input? Thank
it can be calculated but this is
a domain specific issue.

Best wishes

2013/4/2 Abhinav M Kulkarni <abhinavkulkarni@gmail.com>

>  Hi,
> I have a situation wherein I have multiple mappers. I am using
> MultipleInputs class to add them.
> Now, I need to pass different parameters to different mappers. For e.g.
> lets say I have a parameter 'num.iterations' that is set differently for
> different mappers. One way to pass parameters to mappers is to set them in
> a Configuration object:
> Configuration conf = new Configuration();
> conf.set("num.iterations", "100");
> However using this I can't set the value differently for different
> mappers. How do I achieve this?
> Thanks,
> Abhinav

View raw message