From hadoop-dev-return-67-apmail-lucene-hadoop-dev-archive=lucene.apache.org@lucene.apache.org Wed Feb 08 19:04:20 2006 Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 52459 invoked from network); 8 Feb 2006 19:04:20 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 8 Feb 2006 19:04:20 -0000 Received: (qmail 65029 invoked by uid 500); 8 Feb 2006 19:04:20 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 64987 invoked by uid 500); 8 Feb 2006 19:04:19 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 64978 invoked by uid 99); 8 Feb 2006 19:04:19 -0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received: from [192.87.106.226] (HELO ajax.apache.org) (192.87.106.226) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2006 11:04:19 -0800 Received: from ajax.apache.org (ajax.apache.org [127.0.0.1]) by ajax.apache.org (Postfix) with ESMTP id 83180C9 for ; Wed, 8 Feb 2006 20:03:58 +0100 (CET) Message-ID: <1131341961.1139425438365.JavaMail.jira@ajax.apache.org> Date: Wed, 8 Feb 2006 20:03:58 +0100 (CET) From: "Bryan Pendleton (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Commented: (HADOOP-27) MapRed tries to allocate tasks to nodes that have no available disk space In-Reply-To: <1424617142.1139335680270.JavaMail.jira@ajax.apache.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N [ http://issues.apache.org/jira/browse/HADOOP-27?page=comments#action_12365610 ] Bryan Pendleton commented on HADOOP-27: --------------------------------------- Just to add specifics: since a task processor might've already completed previous tasks - when it runs out of space, it shouldn't be allocated new jobs, but it should stay available for serving map output to reduce jobs that need the completed output. Likewise, once such tasks have been cleared, and more space is available, the task runner should return to available status automatically. > MapRed tries to allocate tasks to nodes that have no available disk space > ------------------------------------------------------------------------- > > Key: HADOOP-27 > URL: http://issues.apache.org/jira/browse/HADOOP-27 > Project: Hadoop > Type: Bug > Components: mapred > Reporter: Mike Cafarella > > What it says above. MapRed TaskTrackers should not offer task service if the local disk > space is too constrained. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira