hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Collins (Assigned) (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (HADOOP-497) DataNodes and TaskTrackers should be able to report hostnames and ips relative to customizable network interfaces and nameservers
Date Fri, 16 Mar 2012 00:28:40 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Eli Collins reassigned HADOOP-497:

    Assignee: Lorenzo Thione
> DataNodes and TaskTrackers should be able to report hostnames and ips relative to customizable
network interfaces and nameservers
> ---------------------------------------------------------------------------------------------------------------------------------
>                 Key: HADOOP-497
>                 URL: https://issues.apache.org/jira/browse/HADOOP-497
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: util
>    Affects Versions: 0.6.0
>            Reporter: Lorenzo Thione
>            Assignee: Lorenzo Thione
>            Priority: Minor
>             Fix For: 0.6.0
>         Attachments: dnsjava-2.0.2.jar, net-dns.patch, net-dns.patch, nif-utils.patch
> This patch allows for network configuration parameters to be aded to the hadoop-site.xml
file. These parameters specify a network interface name and an optional nameserver hostname
which DataNodes and TaskTrackers consult to resolve  their hostnames from the IP bound to
the specified network interface.
> This is useful when machines that are part of different physical or logical network need
to participate in hadoop clusters as client nodes. The hostname and IP reported by InetAddress.getLocalHost()
are not necessarily the ones that will allow the JobTracker and NameNode to reach the clients,
as well as not necessarily the ones through which the DFS clients can reach the DataNodes.
> The configuration parameters are
>  - cluster.report.nif
>  - cluster.report.ns
> nif: takes the name of a network interface, like en0, en1 (on macs), eth0, etc...
> ns: the host name of a DNS server to use when resolving the IP bound to the specified
> These parameters are set by default to the value "default" which will replicate the current
behavior of reporting InetAddress.getLocalHost().getHostName() and getHostAddress()
> As part of the patch, a new library dnsjava was added along with its license information
(BSD license). The list of affected files is:
> src
>  org.apache.hadoop.dfs.DataNode 
>  org.apache.hadoop.mapred.taskTracker 
>  org.apache.hadoop.util.NetworkUtils
> conf
>  hadoop-default.xml
> lib
>  dnsjava-2.0.2.jar
>  dnsjava-2.0.2.LICENSE.txt

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message