Mailing-List: contact hbase-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hbase-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of hbase.user.ninad@gmail.com
 designates 209.85.221.188 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=FXuru+Ng3Swapavht7SJ0ED0mTqWPfQ74mibDulSbtobg7/oRBZ0vlXq1+oAEmUW8E
         jOaGiuiZ1cY2KnvwQZZshBawClu4g2x+3Q9m6OsBeGipYAETVNd3UhB7hIYJETLncHIc
         dzVBq5s1283IjmNTDy2O0N8pPvccZegFY4N2w=
MIME-Version: 1.0
In-Reply-To: <24636315.post@talk.nabble.com>
References: <24636315.post@talk.nabble.com>
Date: Fri, 24 Jul 2009 16:00:34 +0530
Message-ID: <4d371b590907240330r39d4b1d3w946e18810204dcb3@mail.gmail.com>
Subject: Re: Why only few map tasks are running at a time inspite of plenty of
	scope for remaining?
From: Ninad Raut <hbase.user.ninad@gmail.com>
To: hbase-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=0016363b938035d8c3046f7118e0

--0016363b938035d8c3046f7118e0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

If your data is stored just on one regionserver you will have only one map
inspite of setting
 conf.set("mapred.tasktracker.map.tasks.maximum", "2");
there are two approaches:

On Fri, Jul 24, 2009 at 4:54 AM, akhil1988 <akhilanger@gmail.com> wrote:

>
> Hi all,
>
> I am using a HTable as input to my map jobs and my reducer outputs to
> another Htable. There are 10 regions of my input HTable. And I have set
>        conf.set("mapred.tasktracker.map.tasks.maximum", "2");
>        conf.set("mapred.tasktracker.map.tasks.maximum", "2");
>       c.setNumReduceTasks(26);
> My cluster contains 15 nodes(out of which 2 are maters). When I run my job,
> only 2 map tasks run at a time and the remaining 8 are shown as pending. 24
> reduce tasks(out of 26) also get started initially and remaing 2 are shown
> as pending. I am confused why only 2 tasks are running at a time, though
> there are a total of 26 slots for map tasks.
>
> However, this does not happen when I run jobs in which I take files as
> inputs(i.e. only simple MapReduce jobs and not involving HBase at all).
> Only
> when a Htable is taken as input very few map tasks run concurrently than
> expected.
>
> Can anyone suggest why this is happening?
>
> What I have observed in simple mapreduce jobs that first all map tasks are
> instantiated and then reduce tasks. But  this does not seem to be happening
> in HTable case??
>
> --
> View this message in context:
> http://www.nabble.com/Why-only-few-map-tasks-are-running-at-a-time-inspite-of-plenty-of-scope-for-remaining--tp24636315p24636315.html
> Sent from the HBase User mailing list archive at Nabble.com.
>
>

--0016363b938035d8c3046f7118e0--