Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of markq2011@gmail.com
 designates 74.125.83.176 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=Y7HRZkAT69sIkSjsuM5lslJqCKI1a1TaHY3fxATWjsLlR5DEz4kl9JvJUP0cjlfJnv
         kdG8xKzJybqeF2AM0BxskK/M+9WyQQAQljRl+3peZptKaZbMhp5ahyuBSLC/USUQk1GB
         VFtdOQXhqKaR0klckFJXgayWe/xG+QsEJLZck=
MIME-Version: 1.0
In-Reply-To: <BANLkTinAgqfcND9bZQY4SBUqq3obj0kZAg@mail.gmail.com>
References: <BANLkTikiFV2+YKUarvzF+hJefhPZGJfY+Q@mail.gmail.com>
	<BANLkTinAgqfcND9bZQY4SBUqq3obj0kZAg@mail.gmail.com>
Date: Fri, 20 May 2011 09:06:56 -0700
Message-ID: <BANLkTi=Y3zrGHsg7SnbBCfVgsXKBAN9gHQ@mail.gmail.com>
Subject: Re: outputCollector vs. Localfile
From: Mark question <markq2011@gmail.com>
To: common-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=000e0cd313509751f604a3b74f49

--000e0cd313509751f604a3b74f49
Content-Type: text/plain; charset=ISO-8859-1

I thought it was, because of FileBytesWritten counter. Thanks for the
clarification.
Mark

On Fri, May 20, 2011 at 4:23 AM, Harsh J <harsh@cloudera.com> wrote:

> Mark,
>
> On Fri, May 20, 2011 at 10:17 AM, Mark question <markq2011@gmail.com>
> wrote:
> > This is puzzling me ...
> >
> >  With a mapper producing output of size ~ 400 MB ... which one is
> supposed
> > to be faster?
> >
> >  1) output collector: which will write to local file then copy to HDFS
> since
> > I don't have reducers.
>
> A regular map-only job does not write to the local FS, it writes to
> the HDFS directly (i.e., a local DN if one is found).
>
> --
> Harsh J
>

--000e0cd313509751f604a3b74f49--