Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 98638 invoked from network); 20 Aug 2008 06:11:41 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 20 Aug 2008 06:11:41 -0000 Received: (qmail 83606 invoked by uid 500); 20 Aug 2008 06:11:34 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 83571 invoked by uid 500); 20 Aug 2008 06:11:34 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 83560 invoked by uid 99); 20 Aug 2008 06:11:34 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Aug 2008 23:11:34 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 20 Aug 2008 06:10:45 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id C874E234C1C3 for ; Tue, 19 Aug 2008 23:10:44 -0700 (PDT) Message-ID: <930891372.1219212644819.JavaMail.jira@brutus> Date: Tue, 19 Aug 2008 23:10:44 -0700 (PDT) From: "Owen O'Malley (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Commented: (HADOOP-3759) Provide ability to run memory intensive jobs without affecting other running tasks on the nodes In-Reply-To: <1898755466.1216109611599.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-3759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623913#action_12623913 ] Owen O'Malley commented on HADOOP-3759: --------------------------------------- I agree with Eric that keeping the ulimit capability is a good thing. It is better to prevent the problem than react to the problem, given a choice... > Provide ability to run memory intensive jobs without affecting other running tasks on the nodes > ----------------------------------------------------------------------------------------------- > > Key: HADOOP-3759 > URL: https://issues.apache.org/jira/browse/HADOOP-3759 > Project: Hadoop Core > Issue Type: Improvement > Components: mapred > Reporter: Hemanth Yamijala > Assignee: Hemanth Yamijala > Fix For: 0.19.0 > > Attachments: HADOOP-3759.patch, HADOOP-3759.patch, HADOOP-3759.patch, HADOOP-3759.patch, HADOOP-3759.patch, HADOOP-3759.patch, HADOOP-3759.patch > > > In HADOOP-3581, we are discussing how to prevent memory intensive tasks from affecting Hadoop daemons and other tasks running on a node. A related requirement is that users be provided an ability to run jobs which are memory intensive. The system must provide enough knobs to allow such jobs to be run while still maintaining the requirements of HADOOP-3581. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.