Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C8C41CF84 for ; Sun, 27 May 2012 09:32:32 +0000 (UTC) Received: (qmail 14646 invoked by uid 500); 27 May 2012 09:32:31 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 14476 invoked by uid 500); 27 May 2012 09:32:31 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 14349 invoked by uid 99); 27 May 2012 09:32:26 -0000 Received: from issues-vm.apache.org (HELO issues-vm) (140.211.11.160) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 27 May 2012 09:32:26 +0000 Received: from isssues-vm.apache.org (localhost [127.0.0.1]) by issues-vm (Postfix) with ESMTP id E0049142857 for ; Sun, 27 May 2012 09:32:25 +0000 (UTC) Date: Sun, 27 May 2012 09:32:25 +0000 (UTC) From: "xieguiming (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: <752656921.6810.1338111145919.JavaMail.jiratomcat@issues-vm> Subject: [jira] [Updated] (MAPREDUCE-5) Shuffle's getMapOutput() fails with EofException, followed by IllegalStateException MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xieguiming updated MAPREDUCE-5: ------------------------------- Attachment: temp.rar > Shuffle's getMapOutput() fails with EofException, followed by IllegalStateException > ----------------------------------------------------------------------------------- > > Key: MAPREDUCE-5 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5 > Project: Hadoop Map/Reduce > Issue Type: Bug > Affects Versions: 0.20.2 > Environment: Sun Java 1.6.0_13, OpenSolaris, running on a SunFire 4150 (x64) 10 node cluster > Reporter: George Porter > Attachments: temp.rar > > > During the shuffle phase, I'm seeing a large sequence of the following actions: > 1) WARN org.apache.hadoop.mapred.TaskTracker: getMapOutput(attempt_200905181452_0002_m_000010_0,0) failed : org.mortbay.jetty.EofException > 2) WARN org.mortbay.log: Committed before 410 getMapOutput(attempt_200905181452_0002_m_000010_0,0) failed : org.mortbay.jetty.EofException > 3) ERROR org.mortbay.log: /mapOutput java.lang.IllegalStateException: Committed > The map phase completes with 100%, and then the reduce phase crawls along with the above errors in each of the TaskTracker logs. None of the tasktrackers get lost. When I run non-data jobs like the 'pi' test from the example jar, everything works fine. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira