Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of ekohlwey@gmail.com designates
 209.85.221.188 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:user-agent:mime-version:to:subject:references
         :in-reply-to:content-type:content-transfer-encoding;
        b=cnwVgpDC7OfIiJ1CdYNTi7u5Srgiv0AtW2zyIvoISC0Ehrifasq3trFiPc275HuFkV
         F9PADSB6INTxIfbclGd1mPex4Q2bNTs/1qFE2XeTMXM0KwgfJAWMKoGxCLGjEExxHsFJ
         v22WPXGyieVnh303baWcprm8qZvzXF198zmT4=
Message-ID: <4AFDDA75.7050809@gmail.com>
Date: Fri, 13 Nov 2009 17:15:17 -0500
From: Edmund Kohlwey <ekohlwey@gmail.com>
User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US;
 rv:1.9.1.4pre) Gecko/20090915 Thunderbird/3.0b4
MIME-Version: 1.0
To: common-user@hadoop.apache.org
Subject: Re: what does it mean when a job fails at 100%?
References: <2d9b8f430911131402t2ee7e85cjc81999abd0280717@mail.gmail.com>
In-Reply-To: <2d9b8f430911131402t2ee7e85cjc81999abd0280717@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

Lots of things can happen. If you have a cleanup method, that can fail 
after map and reduce complete. Also, hadoop writes the output of a task 
to local disk, and only commits the results of the individual tasks to 
HDFS after they complete, so you might be failing on the copy to HDFS.

On 11/13/09 5:02 PM, Mike Kendall wrote:
> title says it all..  this isn't the first job i've written either.  very
> confused.
>
>