hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Keith Wiley <kwi...@keithwiley.com>
Subject Re: Is perfect control over mapper num AND split distribution possible?
Date Tue, 21 Jan 2014 20:42:16 GMT
I'll look it up.  Thanks.

On Jan 21, 2014, at 11:43 , java8964 wrote:

> You cannot use hadoop "NLineInputFormat"?
> If you generate 100 lines of text file, by default, one line will trigger one mapper
> As long as you have 100 task slot available, you will get 100 mapper running concurrently.
> You want perfect control over mapper num? NLineInputFormat is designed for your purpose.
> Yong

Keith Wiley     kwiley@keithwiley.com     keithwiley.com    music.keithwiley.com

"What I primarily learned in grad school is how much I *don't* know.
Consequently, I left grad school with a higher ignorance to knowledge ratio than
when I entered."
                                           --  Keith Wiley

View raw message