hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: Hitting HBASE-7693 with hbase-0.94.9
Date Fri, 02 Aug 2013 01:12:09 GMT
Looking at ./src/core/org/apache/hadoop/net/DNS.java in hadoop branch-1,
here is line 79 :

    String hostname = attribute.get("PTR").get().toString();

It is not clear which part was null.

Reading HBASE-7693 once more, it says:

PTR records contain a trailing period, which then shows up in the input
split location causing the JobTracker to incorrectly match map jobs to
data-local map slots.

So it seems that the problem you encountered was different.

Cheers

On Thu, Aug 1, 2013 at 5:18 PM, Mohammad Tariq <dontariq@gmail.com> wrote:

> Hello list,
>
> Although the issue <https://issues.apache.org/jira/browse/HBASE-7693> has
> been fixed, it looks like i'm hitting it.
>
> *Environment :*
> hadoop-1.1.2
> hbase-0.94.9
> OS X 10.8.4 (12E55)
>
> I'd really appreciate if somebody could throw some light.
>
> Here is the trace I see when I run my MR job against HBase :
>
> 2013-08-02 05:45:20.636 java[37884:1203] Unable to load realm mapping info
> from SCDynamicStore
>
> 13/08/02 05:45:21 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
>
> 13/08/02 05:45:21 WARN mapred.JobClient: Use GenericOptionsParser for
> parsing the arguments. Applications should implement Tool for the same.
>
> 13/08/02 05:45:22 WARN mapred.JobClient: No job jar file set.  User classes
> may not be found. See JobConf(Class) or JobConf#setJar(String).
>
> 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
> environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
>
> 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client environment:host.name
> =192.168.0.100
>
> 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
> environment:java.version=1.6.0_51
>
> 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
> environment:java.vendor=Apple Inc.
>
> 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
>
> environment:java.home=/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home
>
> 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
>
> environment:java.class.path=/workspace/hbasemr2/bin:/Users/miqbal1/hadoop-eco/hbase-0.94.9/lib/zookeeper-3.4.5.jar:/Users/miqbal1/hadoop-eco/hbase-0.94.9/lib/guava-11.0.2.jar:/Users/miqbal1/hadoop-eco/hbase-0.94.9/hbase-0.94.9.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/hadoop-core-1.1.2.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/asm-3.2.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/aspectjrt-1.6.11.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/aspectjtools-1.6.11.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-beanutils-1.7.0.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-beanutils-core-1.8.0.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-cli-1.2.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-codec-1.4.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-collections-3.2.1.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-configuration-1.6.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-daemon-1.0.1.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-digester-1.8.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-el-1.0.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-httpclient-3.0.1.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-io-2.1.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-lang-2.4.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-logging-1.1.1.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-logging-api-1.0.4.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-math-2.1.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-net-3.1.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/core-3.1.1.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/hadoop-capacity-scheduler-1.1.2.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/hadoop-fairscheduler-1.1.2.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/hadoop-thriftfs-1.1.2.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/hsqldb-1.8.0.10.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/jackson-core-asl-1.8.8.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/jackson-mapper-asl-1.8.8.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/jasper-compiler-5.5.12.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/jasper-runtime-5.5.12.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/jdeb-0.8.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/jersey-core-1.8.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/jersey-json-1.8.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/jersey-server-1.8.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/jets3t-0.6.1.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/jetty-6.1.26.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/jetty-util-6.1.26.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/jsch-0.1.42.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/junit-4.5.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/kfs-0.2.2.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/log4j-1.2.15.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/mockito-all-1.8.5.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/oro-2.0.8.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/servlet-api-2.5-20081211.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/slf4j-api-1.4.3.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/slf4j-log4j12-1.4.3.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/xmlenc-0.52.jar:/Users/miqbal1/ZIPS-N-JARS/protobuf-java-2.4.1.jar
>
> 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
>
> environment:java.library.path=.:/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java
>
> 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
>
> environment:java.io.tmpdir=/var/folders/n3/d0ghj1ln2zl0kpd8zkz4zf04mdm1y2/T/
>
> 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
> environment:java.compiler=<NA>
>
> 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client environment:os.name=Mac
> OS X
>
> 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
> environment:os.arch=x86_64
>
> 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
> environment:os.version=10.8.4
>
> 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client environment:user.name
> =miqbal1
>
> 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
> environment:user.home=/Users/miqbal1
>
> 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
> environment:user.dir=/workspace/hbasemr2
>
> 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Initiating client connection,
> connectString=localhost:2181 sessionTimeout=180000 watcher=hconnection
>
> 13/08/02 05:45:22 INFO zookeeper.RecoverableZooKeeper: The identifier of
> this process is 37884@BANL119158415.local
>
> 13/08/02 05:45:22 INFO zookeeper.ClientCnxn: Opening socket connection to
> server localhost/127.0.0.1:2181. Will not attempt to authenticate using
> SASL (Unable to locate a login configuration)
>
> 13/08/02 05:45:22 INFO zookeeper.ClientCnxn: Socket connection established
> to localhost/127.0.0.1:2181, initiating session
>
> 13/08/02 05:45:22 INFO zookeeper.ClientCnxn: Session establishment complete
> on server localhost/127.0.0.1:2181, sessionid = 0x1403c4afbfc0008,
> negotiated timeout = 180000
>
> 13/08/02 05:45:22 INFO mapreduce.TableOutputFormat: Created table instance
> for tabela
>
> 13/08/02 05:45:23 INFO mapred.JobClient: Cleaning up the staging area
>
> file:/tmp/hadoop-miqbal1/mapred/staging/miqbal1-1571617015/.staging/job_local_0001
>
> Exception in thread "main" java.lang.NullPointerException
>
> at org.apache.hadoop.net.DNS.reverseDns(DNS.java:79)
>
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.reverseDNS(
> TableInputFormatBase.java:219)
>
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(
> TableInputFormatBase.java:184)
>
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:1024)
>
> at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:1041)
>
> at org.apache.hadoop.mapred.JobClient.access$700(JobClient.java:179)
>
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:959)
>
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:912)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:396)
>
> at org.apache.hadoop.security.UserGroupInformation.doAs(
> UserGroupInformation.java:1149)
>
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:912)
>
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:500)
>
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:530)
>
> at org.myorg.hbasemr2.HBaseQuery.main(HBaseQuery.java:92)
> Thank you so much for your precious time.
>
> Warm Regards,
> Tariq
> cloudfront.blogspot.com
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message