Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 63F6A1024D for ; Mon, 29 Jul 2013 14:41:15 +0000 (UTC) Received: (qmail 39582 invoked by uid 500); 29 Jul 2013 14:41:10 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 39256 invoked by uid 500); 29 Jul 2013 14:41:06 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 39241 invoked by uid 99); 29 Jul 2013 14:41:05 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 Jul 2013 14:41:05 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of greg@personal.com designates 67.192.241.141 as permitted sender) Received: from [67.192.241.141] (HELO smtp141.dfw.emailsrvr.com) (67.192.241.141) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 Jul 2013 14:41:00 +0000 Received: from localhost (localhost.localdomain [127.0.0.1]) by smtp24.relay.dfw1a.emailsrvr.com (SMTP Server) with ESMTP id 3B1DD180177 for ; Mon, 29 Jul 2013 10:40:39 -0400 (EDT) X-Virus-Scanned: OK Received: from smtp192.mex07a.mlsrvr.com (unknown [67.192.133.128]) by smtp24.relay.dfw1a.emailsrvr.com (SMTP Server) with ESMTPS id 2761B1800D2 for ; Mon, 29 Jul 2013 10:40:39 -0400 (EDT) Received: from 34093-MBX-C09.mex07a.mlsrvr.com ([192.168.1.94]) by DFW1HUB16.mex07a.mlsrvr.com ([fe80::222:19ff:fe50:ef7e%13]) with mapi; Mon, 29 Jul 2013 09:40:38 -0500 From: Greg Bledsoe To: "user@hadoop.apache.org" Date: Mon, 29 Jul 2013 09:40:31 -0500 Subject: Re: Why Hadoop force using DNS? Thread-Topic: Why Hadoop force using DNS? Thread-Index: Ac6MaZfShCMuremyRkGXS5cBY2YxBQ== Message-ID: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.12.0.110505 acceptlanguage: en-US Content-Type: multipart/alternative; boundary="_000_CE1BF6EC193A8gregpersonalcom_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_CE1BF6EC193A8gregpersonalcom_ Content-Type: text/plain; charset="gb2312" Content-Transfer-Encoding: base64 SSBjYW4gdGhpcmQgdGhpcyBjb25jZXJuLiAgV2hhdCBwdXJwb3NlIGRvZXMgdGhpcyBjb21wbGV4 aXR5IGluY3JlYXNpbmcgcmVxdWlyZW1lbnQgc2VydmU/ICBXaHkgbm90IHJlbW92ZSBpdD8NCg0K R3JlZyBCbGVkc29lDQoNCkZyb206IM7k1PPKpCA8d3V6ZXNoZW5nQHhpYW9taS5jb208bWFpbHRv Ond1emVzaGVuZ0B4aWFvbWkuY29tPj4NClJlcGx5LVRvOiAidXNlckBoYWRvb3AuYXBhY2hlLm9y ZzxtYWlsdG86dXNlckBoYWRvb3AuYXBhY2hlLm9yZz4iIDx1c2VyQGhhZG9vcC5hcGFjaGUub3Jn PG1haWx0bzp1c2VyQGhhZG9vcC5hcGFjaGUub3JnPj4NCkRhdGU6IE1vbiwgMjkgSnVsIDIwMTMg MDg6MjE6NTEgLTA1MDANClRvOiAidXNlckBoYWRvb3AuYXBhY2hlLm9yZzxtYWlsdG86dXNlckBo YWRvb3AuYXBhY2hlLm9yZz4iIDx1c2VyQGhhZG9vcC5hcGFjaGUub3JnPG1haWx0bzp1c2VyQGhh ZG9vcC5hcGFjaGUub3JnPj4NClN1YmplY3Q6IFJlOiBXaHkgSGFkb29wIGZvcmNlIHVzaW5nIERO Uz8NCg0KSSBoYXZlIHRoZSBzYW1lIGNvbmZ1c2lvbiwgYW55b25lIHdobyBjYW4gcmVwbHkgdG8g dGhpcyB3aWxsIGJlIHZlcnkgYXBwcmVjaWF0ZWQuDQoNCkZyb206IEVsYXphciBMZWlib3ZpY2gg PGVsYXphcmxAZ21haWwuY29tPG1haWx0bzplbGF6YXJsQGdtYWlsLmNvbT4+DQpSZXBseS1Ubzog InVzZXJAaGFkb29wLmFwYWNoZS5vcmc8bWFpbHRvOnVzZXJAaGFkb29wLmFwYWNoZS5vcmc+IiA8 dXNlckBoYWRvb3AuYXBhY2hlLm9yZzxtYWlsdG86dXNlckBoYWRvb3AuYXBhY2hlLm9yZz4+DQpE YXRlOiBUaHVyc2RheSwgSnVseSAyNSwgMjAxMyAzOjUxIEFNDQpUbzogdXNlciA8dXNlckBoYWRv b3AuYXBhY2hlLm9yZzxtYWlsdG86dXNlckBoYWRvb3AuYXBhY2hlLm9yZz4+DQpTdWJqZWN0OiBX aHkgSGFkb29wIGZvcmNlIHVzaW5nIEROUz8NCg0KTG9va2luZyBhdCBIYWRvb3Agc291cmNlIHlv dSBjYW4gc2VlIHRoYXQgSGFkb29wIHJlbGllcyBvbiB0aGUgZmFjdCBlYWNoIG5vZGUgaGFzIHJl c29sdmFibGUgbmFtZS4NCg0KRm9yIGV4YW1wbGUsIEhhZG9vcCAyIG5hbWVub2RlIHJldmVyc2Ug bG9vayB0aGUgdXAgb2YgZWFjaCBub2RlIHRoYXQgY29ubmVjdHMgdG8gaXQuIEFsc28sIHRoZXJl J3Mgbm8gd2F5IHdheSB0byB0ZWxsIGEgZGF0YWJhc2UgdG8gYWR2ZXJ0aXNlIGFuIFVQIGFzIGl0 J3MgYWRkcmVzcy4gU2V0dGluZyBkYXRhbm9kZS5uZXR3b3JrLmludGVyZmFjZSB0bywgc2F5LCBl dGgxLCB3b3VsZCBjYXVzZSBIYWRvb3AgdG8gcmV2ZXJzZSBsb29rdXAgVVBzIG9uIGV0aDEgYW5k IGFkdmVydGlzZSB0aGUgcmVzdWx0Lg0KDQpXaHkgaXMgdGhhdD8gVXNpbmcgcGxhaW4gSVBzIGlz IHNpbXBsZSB0byBzZXQgdXAsIGFuZCBJIGNhbid0IHNlZSBhIHJlYXNvbiBub3QgdG8gc3VwcG9y dCB0aGVtPw0K --_000_CE1BF6EC193A8gregpersonalcom_ Content-Type: text/html; charset="gb2312" Content-Transfer-Encoding: quoted-printable
I can third this concern= .  What purpose does this complexity increasing requirement serve? &nb= sp;Why not remove it?  

Greg Bledsoe

From: =CE=E4=D4= =F3=CA=A4 <wuzesheng@xiaomi.com<= /a>>
Reply-To: "
user@hadoop.apache.org" <user@hadoop.apache.org>
Date: Mon, 29 Jul 2013 08:21:51 -0500
To: "user@hadoop.apache.org" <user@hadoop.apache.org>
= Subject: Re: Why Hadoop force using DNS?

I have the same confusion, an= yone who can reply to this will be very appreciated.

From: Elazar Leibovich <elazarl@gmail.com>
Reply-To: "user@hadoop.apache.org" <user@hadoop.apache.org>
Date:= Thursday, July 25, 2013 3:51 AM
To: user <user@hadoop.= apache.org>
Subject: Why = Hadoop force using DNS?

= Looking at Hadoop source you can see that Hadoop relies on the fact each no= de has resolvable name.

For example, Hadoop 2 nameno= de reverse look the up of each node that connects to it. Also, there's no w= ay way to tell a database to advertise an UP as it's address. Setting datan= ode.network.interface to, say, eth1, would cause Hadoop to reverse lookup UPs on eth1 and advertise the result.

Why is = that? Using plain IPs is simple to set up, and I can't see a reason not to = support them?
<= /html> --_000_CE1BF6EC193A8gregpersonalcom_--