Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 83979 invoked from network); 24 Jun 2008 06:18:37 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 24 Jun 2008 06:18:37 -0000 Received: (qmail 74356 invoked by uid 500); 24 Jun 2008 06:18:37 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 74329 invoked by uid 500); 24 Jun 2008 06:18:37 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 74318 invoked by uid 99); 24 Jun 2008 06:18:37 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 23 Jun 2008 23:18:37 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 24 Jun 2008 06:17:56 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 32B81234C14D for ; Mon, 23 Jun 2008 23:17:45 -0700 (PDT) Message-ID: <196644150.1214288265206.JavaMail.jira@brutus> Date: Mon, 23 Jun 2008 23:17:45 -0700 (PDT) From: "Amar Kamat (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Commented: (HADOOP-3620) Namenode should synchronously resolve a datanode's network location when the datanode registers In-Reply-To: <342581703.1214245125137.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-3620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607486#action_12607486 ] Amar Kamat commented on HADOOP-3620: ------------------------------------ I think it also makes sense to do the same in the JobTracker. There too the resolution is async. With HADOOP-3590 getting fixed, the problem is that the tasks will be scheduled randomly until the node gets resolved. Some of the test cases assume that the all the TTs are resolved before the job gets submitted which might not be true always. Thoughts? > Namenode should synchronously resolve a datanode's network location when the datanode registers > ----------------------------------------------------------------------------------------------- > > Key: HADOOP-3620 > URL: https://issues.apache.org/jira/browse/HADOOP-3620 > Project: Hadoop Core > Issue Type: Improvement > Components: dfs > Affects Versions: 0.18.0 > Reporter: Hairong Kuang > Assignee: Hairong Kuang > Fix For: 0.19.0 > > Attachments: netResolution.patch > > > Release 0.18.0 removes the rpc timeout. So the namenode is ok to resolve a datanode's network location when the datanode registers. This could remove quite a lot of unnecessary code in both datanode and namenode to handle asynchronous network location resolution and avoid many potential bugs. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.