Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hadoop-dev@lucene.apache.org
Message-ID: <28654515.1166811622376.JavaMail.jira@brutus>
Date: Fri, 22 Dec 2006 10:20:22 -0800 (PST)
From: "Devaraj Das (JIRA)" <jira@apache.org>
To: hadoop-dev@lucene.apache.org
Subject: [jira] Updated: (HADOOP-846) Progress report is not sent during the
 intermediate sorts in the map phase
In-Reply-To: <6035354.1166806341047.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

     [ http://issues.apache.org/jira/browse/HADOOP-846?page=all ]

Devaraj Das updated HADOOP-846:
-------------------------------

    Attachment: 846.patch

Attached is the patch - this starts a single thread that does progress reporting for the entire map phase. Also made taskProgress as volatile since that is read/updated by multiple threads.

> Progress report is not sent during the intermediate sorts in the map phase
> --------------------------------------------------------------------------
>
>                 Key: HADOOP-846
>                 URL: http://issues.apache.org/jira/browse/HADOOP-846
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>            Reporter: Devaraj Das
>         Assigned To: Devaraj Das
>         Attachments: 846.patch
>
>
> Have seen tasks getting lost at the TaskTracker's end due to MapTask's progress not getting reported for a long time (the configured timeout). The progress report is currently not sent in the intermediate sort phases in the MapTask. But, if for some reason, the sort takes a long time, the TaskTracker might kill the task.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira