Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: core-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of jason.hadoop@gmail.com
 designates 209.85.146.177 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=hQYjGPrHOaMYvTcA7vNnKnhdehoKOPQIm7q5iFX1SobL8Fuz2H0fp/+qscOYs38rub
         CYJkVMRHsXQMXAPVGP6UzlbMgFjsDhS9EIvkv/6HdFNl+3VGNjbBaE1AFzztSnRFwq9U
         ijeEsNTEOhYPndjCUOpFu/jcWpzDdKOKqNux4=
MIME-Version: 1.0
In-Reply-To: <1e7471d50906220923o7379f748k2e7bb4d4a5d9cbe3@mail.gmail.com>
References: <1e7471d50906220923o7379f748k2e7bb4d4a5d9cbe3@mail.gmail.com>
Date: Mon, 22 Jun 2009 19:55:57 -0700
Message-ID: <314098690906221955s3a5045f2t5ecc39b0ca4ac178@mail.gmail.com>
Subject: Re: When is configure and close run
From: jason hadoop <jason.hadoop@gmail.com>
To: core-user@hadoop.apache.org, saptarshi.guha@gmail.com
Content-Type: multipart/alternative; boundary=00163646d8f246efde046cfb211b

--00163646d8f246efde046cfb211b
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

configure and close are run for each task, mapper and reducer. The configure
and close are NOT run on the combiner class.

On Mon, Jun 22, 2009 at 9:23 AM, Saptarshi Guha <saptarshi.guha@gmail.com>wrote:

> Hello,
> In a mapreduce job, a given map JVM will run N map tasks. Are the
> configure and close methods executed for every one of these N tasks?
> Or is configure executed once when the JVM starts and the close method
> executed once when all N have been completed?
>
> I have the same question for the reduce task. Will it be run before
> for every reduce task? And close is run when all the values for a
> given key have been processed?
>
> We can assume there isn't a combiner.
>
> Regards
> Saptarshi
>


-- 
Pro Hadoop, a book to guide you from beginner to hadoop mastery,
http://www.amazon.com/dp/1430219424?tag=jewlerymall
www.prohadoopbook.com a community for Hadoop Professionals

--00163646d8f246efde046cfb211b--