Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 70625 invoked from network); 8 Sep 2008 13:39:14 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 8 Sep 2008 13:39:14 -0000 Received: (qmail 67247 invoked by uid 500); 8 Sep 2008 13:39:03 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 67227 invoked by uid 500); 8 Sep 2008 13:39:03 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 67212 invoked by uid 99); 8 Sep 2008 13:39:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Sep 2008 06:39:03 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Sep 2008 13:38:13 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id D3BAB234C1C5 for ; Mon, 8 Sep 2008 06:38:44 -0700 (PDT) Message-ID: <841310552.1220881124852.JavaMail.jira@brutus> Date: Mon, 8 Sep 2008 06:38:44 -0700 (PDT) From: "Vinod K V (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Updated: (HADOOP-3581) Prevent memory intensive user tasks from taking down nodes In-Reply-To: <1009886343.1213704226494.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-3581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod K V updated HADOOP-3581: ------------------------------ Attachment: HADOOP-3581.20080908.txt Addressing the above minor changes. > Prevent memory intensive user tasks from taking down nodes > ---------------------------------------------------------- > > Key: HADOOP-3581 > URL: https://issues.apache.org/jira/browse/HADOOP-3581 > Project: Hadoop Core > Issue Type: Improvement > Components: mapred > Reporter: Hemanth Yamijala > Assignee: Vinod K V > Attachments: HADOOP-3581-final.txt, HADOOP-3581.20080901.2.txt, HADOOP-3581.20080902.txt, HADOOP-3581.20080904.txt, HADOOP-3581.20080905.txt, HADOOP-3581.20080908.txt, HADOOP-3581.6.0.txt, patch_3581_0.1.txt, patch_3581_3.3.txt, patch_3581_4.3.txt, patch_3581_4.4.txt, patch_3581_5.0.txt, patch_3581_5.2.txt > > > Sometimes user Map/Reduce applications can get extremely memory intensive, maybe due to some inadvertent bugs in the user code, or the amount of data processed. When this happens, the user tasks start to interfere with the proper execution of other processes on the node, including other Hadoop daemons like the DataNode and TaskTracker. Thus, the node would become unusable for any Hadoop tasks. There should be a way to prevent such tasks from bringing down the node. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.