Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of kwiley@keithwiley.com
 designates 69.93.106.23 as permitted sender)
Content-Type: text/plain; charset=us-ascii
Mime-Version: 1.0 (Apple Message framework v1085)
Subject: Re: Is perfect control over mapper num AND split distribution
 possible?
From: Keith Wiley <kwiley@keithwiley.com>
In-Reply-To: <SNT149-W2CAD3C8D34813C1611748D0A40@phx.gbl>
Date: Tue, 21 Jan 2014 12:42:16 -0800
Content-Transfer-Encoding: quoted-printable
Message-Id: <F724964E-D077-4F76-A716-809B05A6A223@keithwiley.com>
References: <B519BAB4-C321-4853-9247-E76113CF26DD@keithwiley.com>
 <SNT149-W2CAD3C8D34813C1611748D0A40@phx.gbl>
To: user@hadoop.apache.org

I'll look it up.  Thanks.

On Jan 21, 2014, at 11:43 , java8964 wrote:

> You cannot use hadoop "NLineInputFormat"?
>=20
> If you generate 100 lines of text file, by default, one line will =
trigger one mapper task.
>=20
> As long as you have 100 task slot available, you will get 100 mapper =
running concurrently.
>=20
> You want perfect control over mapper num? NLineInputFormat is designed =
for your purpose.
>=20
> Yong

=
__________________________________________________________________________=
______
Keith Wiley     kwiley@keithwiley.com     keithwiley.com    =
music.keithwiley.com

"What I primarily learned in grad school is how much I *don't* know.
Consequently, I left grad school with a higher ignorance to knowledge =
ratio than
when I entered."
                                           --  Keith Wiley
=
__________________________________________________________________________=
______