Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 47553 invoked from network); 30 Jun 2006 20:24:10 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 30 Jun 2006 20:24:10 -0000 Received: (qmail 19131 invoked by uid 500); 30 Jun 2006 20:24:10 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 19083 invoked by uid 500); 30 Jun 2006 20:24:09 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 19069 invoked by uid 99); 30 Jun 2006 20:24:09 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Jun 2006 13:24:09 -0700 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received: from [209.237.227.198] (HELO brutus.apache.org) (209.237.227.198) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Jun 2006 13:24:09 -0700 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id CDA7B410348 for ; Fri, 30 Jun 2006 20:22:29 +0000 (GMT) Message-ID: <6076498.1151698949839.JavaMail.jira@brutus> Date: Fri, 30 Jun 2006 20:22:29 +0000 (GMT+00:00) From: "eric baldeschwieler (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Created: (HADOOP-336) The task tracker should track disk space used, and have a configurable cap MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N The task tracker should track disk space used, and have a configurable cap -------------------------------------------------------------------------- Key: HADOOP-336 URL: http://issues.apache.org/jira/browse/HADOOP-336 Project: Hadoop Type: Improvement Components: mapred Reporter: eric baldeschwieler We've been having problems where the task tracker is destabilizing HDFS by filling disks and then releasing them. Various tasks can also interfere with each other this way. We should have a configurable max working space for a task (and allow the setting of lower per task limits). The task tracker should track use against this limit and terminate a job if it overruns it. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira