Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 85884 invoked from network); 26 Jun 2006 22:00:09 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 26 Jun 2006 22:00:09 -0000 Received: (qmail 24464 invoked by uid 500); 26 Jun 2006 22:00:07 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 24387 invoked by uid 500); 26 Jun 2006 22:00:07 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 24354 invoked by uid 99); 26 Jun 2006 22:00:07 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 26 Jun 2006 15:00:06 -0700 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received: from [209.237.227.198] (HELO brutus.apache.org) (209.237.227.198) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 26 Jun 2006 15:00:05 -0700 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id E08C641000C for ; Mon, 26 Jun 2006 21:58:32 +0000 (GMT) Message-ID: <365521.1151359112916.JavaMail.jira@brutus> Date: Mon, 26 Jun 2006 21:58:32 +0000 (GMT+00:00) From: "Doug Cutting (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Resolved: (HADOOP-296) Do not assign blocks to a datanode with < x mb free In-Reply-To: <12462846.1150196369845.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N [ http://issues.apache.org/jira/browse/HADOOP-296?page=all ] Doug Cutting resolved HADOOP-296: --------------------------------- Fix Version: 0.4.0 Resolution: Fixed I just committed this. Thanks, Johan! > Do not assign blocks to a datanode with < x mb free > --------------------------------------------------- > > Key: HADOOP-296 > URL: http://issues.apache.org/jira/browse/HADOOP-296 > Project: Hadoop > Type: New Feature > Components: dfs > Versions: 0.3.2 > Reporter: Johan Oskarson > Fix For: 0.4.0 > Attachments: minspace.patch, minspacev2.patch, minspacev3.patch, minspacev3.patch, minspacev4.patch, minspacev5.patch > > We're running a smallish cluster with very different machines, some with only 60 gb harddrives > This creates a problem when inserting files into the dfs, these machines run out of space quickly and then they cannot run any map reduce operations > A solution would be to not assign any new blocks once the space is below a certain user configurable threshold > This free space could then be used by the map reduce operations instead (if that's on the same disk) -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira