Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hbase-dev@hadoop.apache.org
Message-ID: <881508068.1226515546744.JavaMail.jira@brutus>
Date: Wed, 12 Nov 2008 10:45:46 -0800 (PST)
From: "Jim Kellerman (JIRA)" <jira@apache.org>
To: hbase-dev@hadoop.apache.org
Subject: [jira] Commented: (HBASE-602) HBase Crash when network card has a
 IPv6 address
In-Reply-To: <1185519844.1209428995627.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HBASE-602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12646995#action_12646995 ] 

Jim Kellerman commented on HBASE-602:
-------------------------------------

There are two places where the hlog directory name is built:
- HRegionServer.setupHLog
- master.ProcessServerShutdown constructor

If the host address is an IPV6 address, the directory name built contains ':' which is not acceptable for a Hadoop file name, and produces an error like the following:

{code}
2008-11-12 12:48:29,759 FATAL org.apache.hadoop.hbase.regionserver.HRegionServer
: Unhandled exception. Aborting...
java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: log_0:0:0:0:0:0:0:1_1226512108481_58009
        at org.apache.hadoop.fs.Path.initialize(Path.java:140)
        at org.apache.hadoop.fs.Path.<init>(Path.java:126)
        at org.apache.hadoop.fs.Path.<init>(Path.java:50)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.setupHLog(HRegionServer.java:545)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.init(HRegionServer.java:518)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:290)
        at java.lang.Thread.run(Thread.java:619)
Caused by: java.net.URISyntaxException: Relative path in absolute URI: log_0:0:0:0:0:0:0:1_1226512108481_58009
        at java.net.URI.checkPath(URI.java:1787)
        at java.net.URI.<init>(URI.java:735)
        at org.apache.hadoop.fs.Path.initialize(Path.java:137)
        ... 6 more
{code}


> HBase Crash when network card has a IPv6 address
> ------------------------------------------------
>
>                 Key: HBASE-602
>                 URL: https://issues.apache.org/jira/browse/HBASE-602
>             Project: Hadoop HBase
>          Issue Type: Bug
>          Components: regionserver
>    Affects Versions: 0.1.1
>         Environment: Linux, java jdk 1.5
> Network Card Address:
> eth0      Link encap:Ethernet  HWaddr 00:1E:C9:6B:2F:71  
>           inet addr:192.168.10.98  Bcast:192.168.10.255  Mask:255.255.255.0
>           inet6 addr: fe80::21e:c9ff:fe6b:2f71/64 Scope:Link
>           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
>           RX packets:2061472 errors:0 dropped:0 overruns:0 frame:0
>           TX packets:1936088 errors:0 dropped:0 overruns:0 carrier:0
>           collisions:0 txqueuelen:100 
>           RX bytes:493367388 (470.5 MB)  TX bytes:160961988 (153.5 MB)
>           Base address:0xfe00 Memory:fdfc0000-fdfe0000
>            Reporter: Zhou Wei
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> I've met a problem startup HBase.
> I setup hbase with hdfs,
> My server's network card has a ipv4 address and also a ipv6 address.
> When I first startup hbase with default configuration file,
> I found that the region server can't 
> register to master. And I found lots of 127.0.0.1 in log.
> So I suppose interface "default" would not work and add following:
> <property>
>   <name>dfs.datanode.dns.interface</name>
>   <value>eth0</value>
>   <description>The name of the Network Interface from which a data node should 
>   report its IP address.
>   </description>
>  </property>
> However, when this is done. HBase master crashes;
> And I see ipv6 addresses in the log.
> So I dig into the source code,
> found that HBase fails to deal with IPv6 address.
> Details is in following:
> In class  org.apache.hadoop.hbase.HRegionServer
> the method getThisIP() invoke the method of class belongs to Hadoop-core package
> The class is: org.apache.hadoop.net.DNS
> the method is: getDefaultIP(String strInterface)
> This method invokes another method in the same class: getIPs(String strInterface)
> Method getIPs always returns the first ip address  no matter it is ipv4 or ipv6
> I have fixed it by modifying method of org.apache.hadoop.net.DNS.getIPs(String
> strInterface)
> Such that it always returns ipv4 address
> It is working now for me.
> But when hadoop upgrades, I have to modify again.
> In order to avoid the problem,
> I modify a method in class: org.apache.hadoop.net.DNS
> The following is the modified code of this method, it would not return IPv6
> address now.
> /**
>    * Returns all the IPs associated with the provided interface, if any, in
>    * textual form.
>    * 
>    * @param strInterface
>    *            The name of the network interface to query (e.g. eth0)
>    * @return A string vector of all the IPs associated with the provided
>    *         interface
>    * @throws UnknownHostException
>    *             If an UnknownHostException is encountered in querying the
>    *             default interface
>    * 
>    */
>   public static String[] getIPs(String strInterface)
>   throws UnknownHostException {
> 	    try {
> 	      NetworkInterface netIF = NetworkInterface.getByName(strInterface);
> 	      if (netIF == null)
> 	        return new String[] { InetAddress.getLocalHost()
> 	                              .getHostAddress() };
> 	      else {
> 	        Vector<String> ips = new Vector<String>();
> 	        Enumeration e = netIF.getInetAddresses();
> 	        while (e.hasMoreElements())
> 	          				{
> 	        	String addr=((InetAddress) e.nextElement()).getHostAddress();
> 	        	if(addr.length()<=15)//only when it is a IPv4 address
> 	        		ips.add(addr);
> 	        	//ips.add(((InetAddress) e.nextElement()).getHostAddress());
> 	          				}
> 	        return ips.toArray(new String[] {});
> 	      }
> 	    } catch (SocketException e) {
> 	      return new String[] { InetAddress.getLocalHost().getHostAddress() };
> 	    }
>   }

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.