Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 47715 invoked from network); 24 Apr 2009 11:12:55 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 24 Apr 2009 11:12:55 -0000 Received: (qmail 39268 invoked by uid 500); 24 Apr 2009 11:12:54 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 39200 invoked by uid 500); 24 Apr 2009 11:12:53 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 39188 invoked by uid 99); 24 Apr 2009 11:12:53 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Apr 2009 11:12:53 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Apr 2009 11:12:52 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id D67CB234C003 for ; Fri, 24 Apr 2009 04:12:30 -0700 (PDT) Message-ID: <1613337293.1240571550863.JavaMail.jira@brutus> Date: Fri, 24 Apr 2009 04:12:30 -0700 (PDT) From: "Amar Kamat (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Commented: (HADOOP-5643) Ability to blacklist tasktracker In-Reply-To: <1226222670.1239216312962.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-5643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12702325#action_12702325 ] Amar Kamat commented on HADOOP-5643: ------------------------------------ One more thing i forgot to add is that the jobtracker already reads the hosts file and the exclude file but just once. There is no refresh facility to it. I think we can add that to MR too. So here is the sequence of things : # files to include can be specified via mapred.hosts and will be read by the jobtracker upon init # files to exclude can be specified via mapred.hosts.exclude and will also be read by the jobtracker upon init # Admins can change these files and invoke a _refresh_ from the command line (maybe from the webui too). These files will be loaded back. # If the hosts are added via command line or webui, it will be appended to the include/exclude files. So that upon next restart, the previously included/excluded host info is re-used. > Ability to blacklist tasktracker > -------------------------------- > > Key: HADOOP-5643 > URL: https://issues.apache.org/jira/browse/HADOOP-5643 > Project: Hadoop Core > Issue Type: New Feature > Affects Versions: 0.20.0 > Reporter: Rajiv Chittajallu > Assignee: Amar Kamat > > Its not always possible to shutdown the tasktracker to stop scheduling tasks on the node. (eg you can't login to the node but the TT is up). > This can be via > * mapred.exclude and should be refreshed with out restarting the tasktracker > * hadoop job -fail-tracker -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.