hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From yeshwanth kumar <yeshwant...@gmail.com>
Subject Re: Unable to get data of znode /hbase/table/mytable.
Date Sun, 27 Apr 2014 19:10:41 GMT
thanks ted


On Sun, Apr 27, 2014 at 11:06 PM, Ted Yu <yuzhihong@gmail.com> wrote:

> I am adding cdh users mailing list where you would get good response to the
> issue below.
>
> Cheers
>
>
> On Sun, Apr 27, 2014 at 10:30 AM, yeshwanth kumar <yeshwanth43@gmail.com
> >wrote:
>
> > hi ted,
> >
> > i replaced the hbase 0.94.7 with cdh 0.94.6 version.
> > i don't see any errors in regionservers  log but i am getting this
> > exception in my tomcat webapp.
> >
> > javax.servlet.ServletException: java.lang.NoClassDefFoundError:
> > org/apache/hadoop/net/SocketInputWrapper
> >
> >
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:420)
> >
> >
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:538)
> >
> >
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:716)
> >         javax.servlet.http.HttpServlet.service(HttpServlet.java:728)
> >
> > org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> >
> > *root cause*
> >
> > java.lang.NoClassDefFoundError: org/apache/hadoop/net/SocketInputWrapper
> >
> >
> org.apache.hadoop.hbase.ipc.HBaseClient.createConnection(HBaseClient.java:255)
> >
> >
> org.apache.hadoop.hbase.ipc.HBaseClient.getConnection(HBaseClient.java:1120)
> >
> org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:980)
> >
> >
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:86)
> >         com.sun.proxy.$Proxy66.getProtocolVersion(Unknown Source)
> >
> >
> org.apache.hadoop.hbase.ipc.WritableRpcEngine.getProxy(WritableRpcEngine.java:138)
> >
> > org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:208)
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:1358)
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:1317)
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:1304)
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:990)
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:885)
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:987)
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:889)
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:846)
> >
> org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:270)
> >         org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:210)
> >         org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
> >
> >
> com.serendio.penton.rest.server.CsvMgmtEndPoint.<init>(CsvMgmtEndPoint.java:76)
> >         sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> > Method)
> >
> >
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> >
> >
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> >         java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> >
> >
> com.sun.jersey.server.spi.component.ResourceComponentConstructor._construct(ResourceComponentConstructor.java:191)
> >
> >
> com.sun.jersey.server.spi.component.ResourceComponentConstructor.construct(ResourceComponentConstructor.java:179)
> >
> >
> com.sun.jersey.server.impl.resource.PerRequestFactory$PerRequest._getInstance(PerRequestFactory.java:182)
> >
> >
> com.sun.jersey.server.impl.resource.PerRequestFactory$AbstractPerRequest.getInstance(PerRequestFactory.java:144)
> >
> >
> com.sun.jersey.server.impl.application.WebApplicationContext.getResource(WebApplicationContext.java:238)
> >
> >
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:83)
> >
> >
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
> >
> >
> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
> >
> >
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1511)
> >
> >
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1442)
> >
> >
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1391)
> >
> >
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1381)
> >
> >
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
> >
> >
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:538)
> >
> >
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:716)
> >         javax.servlet.http.HttpServlet.service(HttpServlet.java:728)
> >
> > org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> >
> >
> > here's the pom i specified
> >
> >  <dependency>
> >             <groupId>org.apache.hbase</groupId>
> >             <artifactId>hbase</artifactId>
> >         <version>0.94.6-cdh4.5.0</version>
> >             <exclusions>
> >                 <exclusion>
> >                     <groupId> org.mortbay.jetty</groupId>
> >                     <artifactId>jetty</artifactId>
> >                 </exclusion>
> >                 <exclusion>
> >                     <groupId> org.mortbay.jetty</groupId>
> >                     <artifactId>jetty-util</artifactId>
> >                 </exclusion>
> >                 <exclusion>
> >                     <groupId> org.mortbay.jetty</groupId>
> >                     <artifactId>jsp-api-2.1</artifactId>
> >                 </exclusion>
> >                 <exclusion>
> >                     <groupId> org.mortbay.jetty</groupId>
> >                     <artifactId>jsp-2.1</artifactId>
> >                 </exclusion>
> >                 <exclusion>
> >                     <groupId> org.mortbay.jetty</groupId>
> >                     <artifactId>servlet-api-2.5</artifactId>
> >                 </exclusion>
> >                 <exclusion>
> >                     <groupId>tomcat</groupId>
> >                     <artifactId>jasper-runtime</artifactId>
> >                 </exclusion>
> >                 <exclusion>
> >                     <groupId>tomcat</groupId>
> >                     <artifactId>jasper-compiler</artifactId>
> >                 </exclusion>
> >             </exclusions>
> >         </dependency>
> >
> > can you help me out with this issue.
> >
> > thanks,
> > yeshwanth.
> >
> >
> >
> >
> >
> > On Sun, Apr 27, 2014 at 10:32 PM, yeshwanth kumar <yeshwanth43@gmail.com
> > >wrote:
> >
> > > here's the code snippet <http://pastebin.com/AGh7mTNT>
> > >
> > > thanks,
> > > yeshwanth
> > >
> > >
> > > On Sun, Apr 27, 2014 at 10:20 PM, Ted Yu <yuzhihong@gmail.com> wrote:
> > >
> > >> Can you show us code snippet where you add filter to Scan object ?
> > >>
> > >> Thanks
> > >>
> > >> On Apr 27, 2014, at 9:43 AM, yeshwanth kumar <yeshwanth43@gmail.com>
> > >> wrote:
> > >>
> > >> > hi ted,
> > >> >
> > >> > i am using fuzzyrow filter while scanning a table.
> > >> > my cluster is running on HBase 0.94.6-cdh4.5.0
> > >> > but in my webapp i specified hbase 0.94.7. dependency.
> > >> >
> > >> > even after changing the dependency i still see the same error.
> > >> >
> > >> > thanks,
> > >> > yeshwanth.
> > >> >
> > >> >
> > >> >
> > >> >
> > >> > On Sun, Apr 27, 2014 at 10:03 PM, Ted Yu <yuzhihong@gmail.com>
> wrote:
> > >> >
> > >> >> Did the exception below happen when you were performing some query
> on
> > >> the
> > >> >> region server ?
> > >> >>
> > >> >> Can you tell us a bit more whether your query uses FilterList
?
> > >> >>
> > >> >> Thanks
> > >> >>
> > >> >>
> > >> >> On Sun, Apr 27, 2014 at 9:28 AM, yeshwanth kumar <
> > >> yeshwanth43@gmail.com
> > >> >>> wrote:
> > >> >>
> > >> >>> hi jean,
> > >> >>>
> > >> >>> i am using HBase 0.94.6-cdh4.5.0
> > >> >>>
> > >> >>> i found this in regionservers log,
> > >> >>>
> > >> >>> org.apache.hadoop.hbase.io.HbaseObjectWritable
> > >> >>> Error in readFields
> > >> >>> java.lang.ClassCastException:
> > >> >>> org.apache.hadoop.hbase.snapshot.HSnapshotDescription cannot
be
> cast
> > >> to
> > >> >>> org.apache.hadoop.hbase.filter.Filter
> > >> >>> at
> > >> >>>
> > >>
> > org.apache.hadoop.hbase.filter.FilterList.readFields(FilterList.java:276)
> > >> >>> at org.apache.hadoop.hbase.client.Scan.readFields(Scan.java:591)
> > >> >>> at
> > >> >>
> > >>
> >
> org.apache.hadoop.hbase.io.HbaseObjectWritable.readObject(HbaseObjectWritable.java:689)
> > >> >>> at
> > >> org.apache.hadoop.hbase.ipc.Invocation.readFields(Invocation.java:127)
> > >> >>> at
> > >> >>
> > >>
> >
> org.apache.hadoop.hbase.ipc.HBaseServer$Connection.processData(HBaseServer.java:1313)
> > >> >>> at
> > >> >>
> > >>
> >
> org.apache.hadoop.hbase.ipc.HBaseServer$Connection.readAndProcess(HBaseServer.java:1228)
> > >> >>> at
> > >> >>
> > >>
> >
> org.apache.hadoop.hbase.ipc.HBaseServer$Listener.doRead(HBaseServer.java:750)
> > >> >>> at
> > >> >>
> > >>
> >
> org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.doRunLoop(HBaseServer.java:541)
> > >> >>> at
> > >> >>
> > >>
> >
> org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:516)
> > >> >>> at
> > >> >>
> > >>
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > >> >>> at
> > >> >>
> > >>
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > >> >>> at java.lang.Thread.run(Thread.java:744)
> > >> >>>
> > >> >>> how can i fix this dependency issue.
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>> On Fri, Apr 25, 2014 at 9:06 PM, yeshwanth kumar <
> > >> yeshwanth43@gmail.com
> > >> >>>> wrote:
> > >> >>>
> > >> >>>> hi jean,
> > >> >>>>
> > >> >>>> i haven't written any piece of code to workaround znode,
> > >> >>>> one of my rest endpoint in webapp reads data from hbase.
> > >> >>>> it is giving me empty set.
> > >> >>>> all if found in the logs is
> > >> >>>>
> > >> >>>> Reading reply sessionid:0x145974472760023, packet::
> clientPath:null
> > >> >>>> serverPath:null finished:false header:: 42,4 replyHeader::
> > >> >>>> 42,77309411972,-101 request:: '/hbase/table/NCSVs,F response::
> > >> >>>> hconnection-0x145974472760023 Unable to get data of znode
> > >> >>>> /hbase/table/NCSVs because node does not exist (not an
error)
> > >> >>>>
> > >> >>>> this is what i found in zookeeper client
> > >> >>>>
> > >> >>>> *$[zk: localhost:2181(CONNECTED) 14] ls /hbase*
> > >> >>>> *[splitlog, online-snapshot, unassigned, table94,
> > root-region-server,
> > >> >> rs,
> > >> >>>> backup-masters, table, draining, master, shutdown, hbaseid]*
> > >> >>>>
> > >> >>>>
> > >> >>>> -yeshwanth
> > >> >>>>
> > >> >>>>
> > >> >>>> On Fri, Apr 25, 2014 at 8:18 PM, Jean-Marc Spaggiari <
> > >> >>>> jean-marc@spaggiari.org> wrote:
> > >> >>>>
> > >> >>>>> Hi Yeshwanth,
> > >> >>>>>
> > >> >>>>> What is your webapp looking at the ZNode? If you should
the Java
> > >> >> client
> > >> >>>>> and
> > >> >>>>> not look at the ZNode. Not getting why it's looking
there. Do yo
> > >> >> uknow?
> > >> >>>>>
> > >> >>>>> JM
> > >> >>>>>
> > >> >>>>>
> > >> >>>>> 2014-04-25 2:01 GMT-04:00 yeshwanth kumar <
> yeshwanth43@gmail.com
> > >:
> > >> >>>>>
> > >> >>>>>> hi matteo,
> > >> >>>>>>
> > >> >>>>>> my problem isn't solved yet.
> > >> >>>>>> webapp isn't reading data from hbase.
> > >> >>>>>> all i see in logs is znode /hbase/table/mytable
doesn't exist.
> > >> >>>>>> but all my tables are present in /hbase/table94/
> > >> >>>>>>
> > >> >>>>>> so how can i fix this problem.
> > >> >>>>>>
> > >> >>>>>> thanks,
> > >> >>>>>> yeshwanth
> > >> >>>>>>
> > >> >>>>>>
> > >> >>>>>>
> > >> >>>>>>
> > >> >>>>>> On Tue, Apr 22, 2014 at 9:58 PM, Matteo Bertozzi
<
> > >> >>>>> theo.bertozzi@gmail.com
> > >> >>>>>>> wrote:
> > >> >>>>>>
> > >> >>>>>>> that is already done by the server.
> > >> >>>>>>> The ZooKeeperWatcher.java is using conf.get(
> > >> >>>>>>> "zookeeper.znode.masterTableEnableDisable",
"table94"));
> > >> >>>>>>>
> > >> >>>>>>> anyway, why are you looking at the znodes?
> > >> >>>>>>> a client application should never look at
the znodes.
> > >> >>>>>>> The znodes are only carrying transient informations
used for
> > >> >>>>> coordination
> > >> >>>>>>>
> > >> >>>>>>> Matteo
> > >> >>>>>>>
> > >> >>>>>>>
> > >> >>>>>>>
> > >> >>>>>>> On Tue, Apr 22, 2014 at 9:20 AM, yeshwanth
kumar <
> > >> >>>>> yeshwanth43@gmail.com
> > >> >>>>>>>> wrote:
> > >> >>>>>>>
> > >> >>>>>>>> hi matteo,
> > >> >>>>>>>>
> > >> >>>>>>>> how do i specify hbase znode to use /hbase/table94
 instead
> of
> > >> >>>>>>> /hbase/table
> > >> >>>>>>>>
> > >> >>>>>>>> thanks
> > >> >>>>>>>>
> > >> >>>>>>>>
> > >> >>>>>>>> On Tue, Apr 22, 2014 at 9:40 PM, Matteo
Bertozzi <
> > >> >>>>>>> theo.bertozzi@gmail.com
> > >> >>>>>>>>> wrote:
> > >> >>>>>>>>
> > >> >>>>>>>>> On Tue, Apr 22, 2014 at 9:00 AM, yeshwanth
kumar <
> > >> >>>>>>> yeshwanth43@gmail.com
> > >> >>>>>>>>>> wrote:
> > >> >>>>>>>>>
> > >> >>>>>>>>>> @matteo
> > >> >>>>>>>>>> present znode is at /hbase/table
where it is empty.
> > >> >>>>>>>>>> where as all my tables are present
in /hbase/table94
> > >> >>>>>>>>>> now  webapp isn't reading the
data from hbase.
> > >> >>>>>>>>>
> > >> >>>>>>>>> cdh 4.5.0 doesn't write in /hbase/table
due to a
> compatibility
> > >> >>>>> issue
> > >> >>>>>>>>> /hbase/table94
> > >> >>>>>>>>> is used.
> > >> >>>>>>>>> (see HBASE-6710 for details)
> > >> >>>>>>>>>
> > >> >>>>>>>>> On Tue, Apr 22, 2014 at 6:56 PM, Matteo
Bertozzi <
> > >> >>>>>>>> theo.bertozzi@gmail.com
> > >> >>>>>>>>>> wrote:
> > >> >>>>>>>>>
> > >> >>>>>>>>>>
> > >> >>>>>>>>>>> /hbase/table94 is a "compatibility"
znode that replaces
> > >> >>>>>>> /hbase/table
> > >> >>>>>>>>>>> if you want more details take
a look at HBASE-6710.
> > >> >>>>>>>>>>>
> > >> >>>>>>>>>>> what is the problem of looking
into /hbase/table94 instead
> > >> >>> of
> > >> >>>>>>>>>> /hbase/table?
> > >> >>>>>>>>>>>
> > >> >>>>>>>>>>> Matteo
> > >> >>>>>>>>>>>
> > >> >>>>>>>>>>>
> > >> >>>>>>>>>>>
> > >> >>>>>>>>>>> On Tue, Apr 22, 2014 at 5:18
AM, yeshwanth kumar <
> > >> >>>>>>>>> yeshwanth43@gmail.com
> > >> >>>>>>>>>>>> wrote:
> > >> >>>>>>>>>>>
> > >> >>>>>>>>>>>> Hi,
> > >> >>>>>>>>>>>>
> > >> >>>>>>>>>>>>
> > >> >>>>>>>>>>>> i am running webapp written
on jaxrs framework which
> > >> >>>>> performs
> > >> >>>>>>> CRUD
> > >> >>>>>>>>>>>> opereations on hbase.
> > >> >>>>>>>>>>>>
> > >> >>>>>>>>>>>> app was working fine till
last week,
> > >> >>>>>>>>>>>> now when i perform reading
opeartion  from hbase i don't
> > >> >>> see
> > >> >>>>>> any
> > >> >>>>>>>>> data,
> > >> >>>>>>>>>> i
> > >> >>>>>>>>>>>> don't see any errors or
exceptions but i found this
> > >> >> lines
> > >> >>> in
> > >> >>>>>> the
> > >> >>>>>>>> log
> > >> >>>>>>>>>>>>
> > >> >>>>>>>>>>>> *""Unable to get data
of znode /hbase/table/myTable
> > >> >>> because
> > >> >>>>>> node
> > >> >>>>>>>> does
> > >> >>>>>>>>>> not
> > >> >>>>>>>>>>>> exist (not an error)"".*
> > >> >>>>>>>>>>>>
> > >> >>>>>>>>>>>> i followed this<
> > >> >>>>> https://blog.cloudera.com/blog/2013/10/what-are-hbase-znodes/>
> > >> >>>>>>>>>>>> cloudera
> > >> >>>>>>>>>>>> article about znodes and
this is what i found,
> > >> >>>>>>>>>>>>
> > >> >>>>>>>>>>>> *$[zk: localhost:2181(CONNECTED)
14] ls /hbase*
> > >> >>>>>>>>>>>> *[splitlog, online-snapshot,
unassigned, table94,
> > >> >>>>>>>> root-region-server,
> > >> >>>>>>>>>> rs,
> > >> >>>>>>>>>>>> backup-masters, table,
draining, master, shutdown,
> > >> >>> hbaseid]*
> > >> >>>>>>>>>>>>
> > >> >>>>>>>>>>>> all the tables were present
in /hbase/table94, where as
> > >> >>>>>>>> /hbase/table
> > >> >>>>>>>>> is
> > >> >>>>>>>>>>>> empty.
> > >> >>>>>>>>>>>>
> > >> >>>>>>>>>>>> i know what is the problem
now,
> > >> >>>>>>>>>>>> but i don't know how to
solve it.
> > >> >>>>>>>>>>>>
> > >> >>>>>>>>>>>> can someone help me with
this issue.
> > >> >>>>>>>>>>>>
> > >> >>>>>>>>>>>> Thanks,
> > >> >>>>>>>>>>>> Yeshwanth
> > >> >>
> > >>
> > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message