Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of dontariq@gmail.com designates
 209.85.128.180 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CALte62zuLKybo-XwLGvLTueYAh834GxQDHr19CAuERF5G6YxCA@mail.gmail.com>
References: 
 <CAMVC6ROX0e7+S5t2MpExetDcqJYedba=uG2ZYpMyEskzJGnXCg@mail.gmail.com>
 <CALte62zuLKybo-XwLGvLTueYAh834GxQDHr19CAuERF5G6YxCA@mail.gmail.com>
From: Mohammad Tariq <dontariq@gmail.com>
Date: Fri, 2 Aug 2013 06:48:02 +0530
Message-ID: 
 <CAMVC6RMCPktS6ccWNi6PkDqPy1HBNK+DNHC9zLMV+YXrZYzXTQ@mail.gmail.com>
Subject: Re: Hitting HBASE-7693 with hbase-0.94.9
To: "user@hbase.apache.org" <user@hbase.apache.org>
Content-Type: multipart/alternative; boundary=001a11c1bfaa40c65004e2ecbd8f

--001a11c1bfaa40c65004e2ecbd8f
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hello Ted,

Thank you so much for the quick response.

I need to dig a bit more in that case. Will get back here once I get
something.


Warm Regards,
Tariq
cloudfront.blogspot.com


On Fri, Aug 2, 2013 at 6:42 AM, Ted Yu <yuzhihong@gmail.com> wrote:

> Looking at ./src/core/org/apache/hadoop/net/DNS.java in hadoop branch-1,
> here is line 79 :
>
>     String hostname =3D attribute.get("PTR").get().toString();
>
> It is not clear which part was null.
>
> Reading HBASE-7693 once more, it says:
>
> PTR records contain a trailing period, which then shows up in the input
> split location causing the JobTracker to incorrectly match map jobs to
> data-local map slots.
>
> So it seems that the problem you encountered was different.
>
> Cheers
>
> On Thu, Aug 1, 2013 at 5:18 PM, Mohammad Tariq <dontariq@gmail.com> wrote=
:
>
> > Hello list,
> >
> > Although the issue <https://issues.apache.org/jira/browse/HBASE-7693>
> has
> > been fixed, it looks like i'm hitting it.
> >
> > *Environment :*
> > hadoop-1.1.2
> > hbase-0.94.9
> > OS X 10.8.4 (12E55)
> >
> > I'd really appreciate if somebody could throw some light.
> >
> > Here is the trace I see when I run my MR job against HBase :
> >
> > 2013-08-02 05:45:20.636 java[37884:1203] Unable to load realm mapping
> info
> > from SCDynamicStore
> >
> > 13/08/02 05:45:21 WARN util.NativeCodeLoader: Unable to load
> native-hadoop
> > library for your platform... using builtin-java classes where applicabl=
e
> >
> > 13/08/02 05:45:21 WARN mapred.JobClient: Use GenericOptionsParser for
> > parsing the arguments. Applications should implement Tool for the same.
> >
> > 13/08/02 05:45:22 WARN mapred.JobClient: No job jar file set.  User
> classes
> > may not be found. See JobConf(Class) or JobConf#setJar(String).
> >
> > 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
> > environment:zookeeper.version=3D3.4.5-1392090, built on 09/30/2012 17:5=
2
> GMT
> >
> > 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client environment:host.nam=
e
> > =3D192.168.0.100
> >
> > 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
> > environment:java.version=3D1.6.0_51
> >
> > 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
> > environment:java.vendor=3DApple Inc.
> >
> > 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
> >
> >
> environment:java.home=3D/System/Library/Java/JavaVirtualMachines/1.6.0.jd=
k/Contents/Home
> >
> > 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
> >
> >
> environment:java.class.path=3D/workspace/hbasemr2/bin:/Users/miqbal1/hado=
op-eco/hbase-0.94.9/lib/zookeeper-3.4.5.jar:/Users/miqbal1/hadoop-eco/hbase=
-0.94.9/lib/guava-11.0.2.jar:/Users/miqbal1/hadoop-eco/hbase-0.94.9/hbase-0=
.94.9.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/hadoop-core-1.1.2.jar:/Use=
rs/miqbal1/hadoop-eco/hadoop-1.1.2/lib/asm-3.2.jar:/Users/miqbal1/hadoop-ec=
o/hadoop-1.1.2/lib/aspectjrt-1.6.11.jar:/Users/miqbal1/hadoop-eco/hadoop-1.=
1.2/lib/aspectjtools-1.6.11.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/=
commons-beanutils-1.7.0.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/comm=
ons-beanutils-core-1.8.0.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/com=
mons-cli-1.2.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-codec-1=
.4.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-collections-3.2.1=
.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-configuration-1.6.j=
ar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-daemon-1.0.1.jar:/Use=
rs/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-digester-1.8.jar:/Users/miqb=
al1/hadoop-eco/hadoop-1.1.2/lib/commons-el-1.0.jar:/Users/miqbal1/hadoop-ec=
o/hadoop-1.1.2/lib/commons-httpclient-3.0.1.jar:/Users/miqbal1/hadoop-eco/h=
adoop-1.1.2/lib/commons-io-2.1.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/l=
ib/commons-lang-2.4.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-=
logging-1.1.1.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-loggin=
g-api-1.0.4.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-math-2.1=
.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/commons-net-3.1.jar:/Users/=
miqbal1/hadoop-eco/hadoop-1.1.2/lib/core-3.1.1.jar:/Users/miqbal1/hadoop-ec=
o/hadoop-1.1.2/lib/hadoop-capacity-scheduler-1.1.2.jar:/Users/miqbal1/hadoo=
p-eco/hadoop-1.1.2/lib/hadoop-fairscheduler-1.1.2.jar:/Users/miqbal1/hadoop=
-eco/hadoop-1.1.2/lib/hadoop-thriftfs-1.1.2.jar:/Users/miqbal1/hadoop-eco/h=
adoop-1.1.2/lib/hsqldb-1.8.0.10.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/=
lib/jackson-core-asl-1.8.8.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/j=
ackson-mapper-asl-1.8.8.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/jasp=
er-compiler-5.5.12.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/jasper-ru=
ntime-5.5.12.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/jdeb-0.8.jar:/U=
sers/miqbal1/hadoop-eco/hadoop-1.1.2/lib/jersey-core-1.8.jar:/Users/miqbal1=
/hadoop-eco/hadoop-1.1.2/lib/jersey-json-1.8.jar:/Users/miqbal1/hadoop-eco/=
hadoop-1.1.2/lib/jersey-server-1.8.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1=
.2/lib/jets3t-0.6.1.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/jetty-6.=
1.26.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/jetty-util-6.1.26.jar:/=
Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/jsch-0.1.42.jar:/Users/miqbal1/ha=
doop-eco/hadoop-1.1.2/lib/junit-4.5.jar:/Users/miqbal1/hadoop-eco/hadoop-1.=
1.2/lib/kfs-0.2.2.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/log4j-1.2.=
15.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/mockito-all-1.8.5.jar:/Us=
ers/miqbal1/hadoop-eco/hadoop-1.1.2/lib/oro-2.0.8.jar:/Users/miqbal1/hadoop=
-eco/hadoop-1.1.2/lib/servlet-api-2.5-20081211.jar:/Users/miqbal1/hadoop-ec=
o/hadoop-1.1.2/lib/slf4j-api-1.4.3.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1=
.2/lib/slf4j-log4j12-1.4.3.jar:/Users/miqbal1/hadoop-eco/hadoop-1.1.2/lib/x=
mlenc-0.52.jar:/Users/miqbal1/ZIPS-N-JARS/protobuf-java-2.4.1.jar
> >
> > 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
> >
> >
> environment:java.library.path=3D.:/Library/Java/Extensions:/System/Librar=
y/Java/Extensions:/usr/lib/java
> >
> > 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
> >
> >
> environment:java.io.tmpdir=3D/var/folders/n3/d0ghj1ln2zl0kpd8zkz4zf04mdm1=
y2/T/
> >
> > 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
> > environment:java.compiler=3D<NA>
> >
> > 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client environment:os.name
> =3DMac
> > OS X
> >
> > 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
> > environment:os.arch=3Dx86_64
> >
> > 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
> > environment:os.version=3D10.8.4
> >
> > 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client environment:user.nam=
e
> > =3Dmiqbal1
> >
> > 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
> > environment:user.home=3D/Users/miqbal1
> >
> > 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Client
> > environment:user.dir=3D/workspace/hbasemr2
> >
> > 13/08/02 05:45:22 INFO zookeeper.ZooKeeper: Initiating client connectio=
n,
> > connectString=3Dlocalhost:2181 sessionTimeout=3D180000 watcher=3Dhconne=
ction
> >
> > 13/08/02 05:45:22 INFO zookeeper.RecoverableZooKeeper: The identifier o=
f
> > this process is 37884@BANL119158415.local
> >
> > 13/08/02 05:45:22 INFO zookeeper.ClientCnxn: Opening socket connection =
to
> > server localhost/127.0.0.1:2181. Will not attempt to authenticate using
> > SASL (Unable to locate a login configuration)
> >
> > 13/08/02 05:45:22 INFO zookeeper.ClientCnxn: Socket connection
> established
> > to localhost/127.0.0.1:2181, initiating session
> >
> > 13/08/02 05:45:22 INFO zookeeper.ClientCnxn: Session establishment
> complete
> > on server localhost/127.0.0.1:2181, sessionid =3D 0x1403c4afbfc0008,
> > negotiated timeout =3D 180000
> >
> > 13/08/02 05:45:22 INFO mapreduce.TableOutputFormat: Created table
> instance
> > for tabela
> >
> > 13/08/02 05:45:23 INFO mapred.JobClient: Cleaning up the staging area
> >
> >
> file:/tmp/hadoop-miqbal1/mapred/staging/miqbal1-1571617015/.staging/job_l=
ocal_0001
> >
> > Exception in thread "main" java.lang.NullPointerException
> >
> > at org.apache.hadoop.net.DNS.reverseDns(DNS.java:79)
> >
> > at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.reverseDNS(
> > TableInputFormatBase.java:219)
> >
> > at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(
> > TableInputFormatBase.java:184)
> >
> > at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:102=
4)
> >
> > at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:1041)
> >
> > at org.apache.hadoop.mapred.JobClient.access$700(JobClient.java:179)
> >
> > at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:959)
> >
> > at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:912)
> >
> > at java.security.AccessController.doPrivileged(Native Method)
> >
> > at javax.security.auth.Subject.doAs(Subject.java:396)
> >
> > at org.apache.hadoop.security.UserGroupInformation.doAs(
> > UserGroupInformation.java:1149)
> >
> > at
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:912)
> >
> > at org.apache.hadoop.mapreduce.Job.submit(Job.java:500)
> >
> > at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:530)
> >
> > at org.myorg.hbasemr2.HBaseQuery.main(HBaseQuery.java:92)
> > Thank you so much for your precious time.
> >
> > Warm Regards,
> > Tariq
> > cloudfront.blogspot.com
> >
>

--001a11c1bfaa40c65004e2ecbd8f--