hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stack <st...@duboce.net>
Subject Re: Later version of HBase Client has a problem with DNS
Date Sat, 18 May 2013 03:44:08 GMT
This has come up in the past:

http://search-hadoop.com/m/mDn0i2kjGA32/NumberFormatException+dns&subj=unable+to+resolve+the+DNS+name

Or check out this old thread:
http://mail.openjdk.java.net/pipermail/jdk7-dev/2010-October/001605.html

St.Ack




On Fri, May 17, 2013 at 11:17 AM, Heng Sok <ngweixing@gmail.com> wrote:

> Hi all,
>
> I have been trying to run MapReduce job that involves using Hbase as
> source and sink. I have Hbase 0.94.2 and Hadoop 2.0 installed using
> Cloudera repository and following their instructions.
>
> When I use HBase client package version 0.94.2 and above, it gave the
> following DNS related error. When I try to use HBase client package 0.92.1
> with the Hbase version I have installed(0.94.2), everything seems to work
> fine. But I want to use the newer HBase client package and hope someone can
> tell me what's wrong. Furthermore, I hope this is not a bug and that's why
> I want to raise this issue I am facing.
>
> I have disabled IPv6 and not using it at all. I am not sure why it can't
> parse the string for the DNSclient.
>
>
> 13/03/26 05:00:51 INFO zookeeper.ZooKeeper: Client
> environment:java.library.path=/usr/lib/hadoop/libexec/../lib/native/Linux-amd64-64
> 13/03/26 05:00:51 INFO zookeeper.ZooKeeper: Client
> environment:java.io.tmpdir=/tmp
> 13/03/26 05:00:51 INFO zookeeper.ZooKeeper: Client
> environment:java.compiler=<NA>
> 13/03/26 05:00:51 INFO zookeeper.ZooKeeper: Client environment:os.name
> =Linux
> 13/03/26 05:00:51 INFO zookeeper.ZooKeeper: Client
> environment:os.arch=amd64
> 13/03/26 05:00:51 INFO zookeeper.ZooKeeper: Client
> environment:os.version=2.6.32-279.22.1.el6.x86_64
> 13/03/26 05:00:51 INFO zookeeper.ZooKeeper: Client environment:user.name
> =hbase
> 13/03/26 05:00:51 INFO zookeeper.ZooKeeper: Client
> environment:user.home=/var/run/hbase
> 13/03/26 05:00:51 INFO zookeeper.ZooKeeper: Client
> environment:user.dir=/tmp
> 13/03/26 05:00:51 INFO zookeeper.ZooKeeper: Initiating client connection,
> connectString= <MY DOMAIN NAME>:2181 sessionTimeout=180000
> watcher=hconnection
> 13/03/26 05:00:51 INFO zookeeper.ClientCnxn: Opening socket connection to
> server /46.4.115.71:2181
> 13/03/26 05:00:51 INFO zookeeper.RecoverableZooKeeper: The identifier of
> this process is 6941@<MY DOMAIN NAME>
> 13/03/26 05:00:51 WARN client.ZooKeeperSaslClient: SecurityException:
> java.lang.SecurityException: Unable to locate a login configuration
> occurred when trying to find JAAS configuration.
> 13/03/26 05:00:51 INFO client.ZooKeeperSaslClient: Client will not
> SASL-authenticate because the default JAAS configuration section 'Client'
> could not be found. If you are not using SASL, you may ignore this. On the
> other hand, if you expected SASL to work, please fix your JAAS
> configuration.
> 13/03/26 05:00:51 INFO zookeeper.ClientCnxn: Socket connection established
> to <MY DOMAIN NAME>/46.4.115.71:2181, initiating session
> 13/03/26 05:00:51 INFO zookeeper.ClientCnxn: Session establishment
> complete on server <MY DOMAIN NAME>/46.4.115.71:2181, sessionid =
> 0x13da4a9a3ea0016, negotiated timeout = 40000
> 13/03/26 05:00:51 INFO mapreduce.TableOutputFormat: Created table instance
> for summary_user
> 13/03/26 05:00:51 INFO mapred.JobClient: Cleaning up the staging area
> hdfs://<MY DOMAIN NAME>:8020/user/hbase/.staging/job_201303260407_0003
>
> Exception in thread "main" java.lang.NumberFormatException: For input
> string: "4f8:0:a102::add:9999"
>         at
> java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
>         at java.lang.Integer.parseInt(Integer.java:458)
>         at java.lang.Integer.parseInt(Integer.java:499)
>         at com.sun.jndi.dns.DnsClient.<init>(DnsClient.java:103)
>         at com.sun.jndi.dns.Resolver.<init>(Resolver.java:44)
>         at com.sun.jndi.dns.DnsContext.getResolver(DnsContext.java:553)
>         at com.sun.jndi.dns.DnsContext.c_getAttributes(DnsContext.java:413)
>         at
> com.sun.jndi.toolkit.ctx.ComponentDirContext.p_getAttributes(ComponentDirContext.java:213)
>         at
> com.sun.jndi.toolkit.ctx.PartialCompositeDirContext.getAttributes(PartialCompositeDirContext.java:121)
>         at
> com.sun.jndi.toolkit.url.GenericURLDirContext.getAttributes(GenericURLDirContext.java:85)
>         at
> javax.naming.directory.InitialDirContext.getAttributes(InitialDirContext.java:123)
>         at org.apache.hadoop.net.DNS.reverseDns(DNS.java:85)
>         at
> org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.reverseDNS(TableInputFormatBase.java:219)
>         at
> org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:184)
>         at
> org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:1064)
>         at
> org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:1081)
>         at
> org.apache.hadoop.mapred.JobClient.access$600(JobClient.java:174)
>         at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:993)
>         at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:946)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
>         at
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:946)
>         at org.apache.hadoop.mapreduce.Job.submit(Job.java:566)
>         at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:596)
>         at hbase_mapred1.FreqCounter1.main(FreqCounter1.java:86)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.util.RunJar.main(RunJar.java:208)
>
>
> Thank you very much.
>
> Regards,
> Heng

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message