Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of maha@umail.ucsb.edu
 designates 128.111.151.62 as permitted sender)
From: maha <maha@umail.ucsb.edu>
Mime-Version: 1.0 (Apple Message framework v1084)
Content-Type: multipart/alternative; boundary=Apple-Mail-2--1064054858
Subject: Re: Map Tasks re-executing
Date: Wed, 30 Mar 2011 12:26:15 -0700
In-Reply-To: <126AA8A7-B541-4A92-BA5D-F5E9D2512646@umail.ucsb.edu>
To: common-user@hadoop.apache.org
References: <126AA8A7-B541-4A92-BA5D-F5E9D2512646@umail.ucsb.edu>
Message-Id: <BCC63542-2B96-4D75-8B79-CDE2DFC409B6@umail.ucsb.edu>

--Apple-Mail-2--1064054858
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=us-ascii

It's not the sorting, since the sorted files are produced in output, =
it's then mapper not existing well.  so can anyone tell me if it's wrong =
to write mapper.close() function like this ?

	@Override
	public void close() throws IOException{
		helper.CleanUp();
		writer.close();	=09
		// SORT PRODUCED OUTPUT
	    try{
	    	Sorter SeqSort =3D new Sorter (hdfs,
	    			DocDocWritable.class,
	    			IntWritable.class,
	    			new Configuration());=20

	    	SeqSort.sort(tempSeq, new =
Path("sorted/S"+TaskID.getName()));
	    }
	    catch(Exception e){e.printStackTrace();}
		return;
	}

 and by the way, when it's executed ... it's not part of the "cleanup" =
phase that is shown in the UI .. which I think is supposed to be ... =
right?

Thank you,
Maha


> Hello,
>=20
>   My  map tasks are freezing after 100% ..  I'm suspecting my =
mapper.close().=20
>=20
> output is the following:
> ....
> 11/03/30 08:13:54 INFO mapred.JobClient:  map 95% reduce 0%
> 11/03/30 08:14:09 INFO mapred.JobClient:  map 96% reduce 0%
> 11/03/30 08:14:27 INFO mapred.JobClient:  map 97% reduce 0%
> 11/03/30 08:14:42 INFO mapred.JobClient:  map 98% reduce 0%
> 11/03/30 08:15:06 INFO mapred.JobClient:  map 99% reduce 0%
> 11/03/30 08:15:45 INFO mapred.JobClient:  map 100% reduce 0%
> 11/03/30 08:25:41 INFO mapred.JobClient:  map 50% reduce 0%
> 11/03/30 08:25:49 INFO mapred.JobClient: Task Id : =
attempt_201103291035_0016_m_000001_0, Status : FAILED
> Task attempt_201103291035_0016_m_000001_0 failed to report status for =
600 seconds. Killing!
> 11/03/30 08:25:50 INFO mapred.JobClient:  map 0% reduce 0%
> 11/03/30 08:25:52 INFO mapred.JobClient: Task Id : =
attempt_201103291035_0016_m_000000_0, Status : FAILED
> Task attempt_201103291035_0016_m_000000_0 failed to report status for =
600 seconds. Killing!
> 11/03/30 08:26:29 INFO mapred.JobClient:  map 1% reduce 0%
> 11/03/30 08:26:53 INFO mapred.JobClient:  map 2% reduce 0%
> 11/03/30 08:27:05 INFO mapred.JobClient:  map 3% reduce 0%
> 11/03/30 08:27:29 INFO mapred.JobClient:  map 4% reduce 0%
> 11/03/30 08:27:41 INFO mapred.JobClient:  map 5% reduce 0%
> ...
>=20
> Thank you for any thought,
>=20
> Maha
>=20
>=20
>=20


--Apple-Mail-2--1064054858--