hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Fernando Iwamoto - Plannej <fernando.iwam...@plannej.com.br>
Subject Re: Issue connectiong to HBase using Pig's HBaseStorage: Unable to find region for my_table
Date Tue, 21 Jan 2014 13:40:52 GMT
Hello, I might find a possible cause of this problem (well for my case,
might for you too Rusell), In my classpath, i setup my pig path using
hbase-0.94.0.jar, but I'm using newer version of HBase(0.96.1.1), so I
tried to changing the newest .jar, and I dont know which one is on the lib
to use correctly, because I tried this jar
hbase-hadoop2-compat-0.96.1.1-hadoop2.jar, and giving me an error ERROR
2998: Unhandled internal error.
org/apache/hadoop/hbase/filter/WritableByteArrayComparable.

How about you, Rusell, how did you setup your pig's classpath?


2014/1/20 Russell Jurney <russell.jurney@gmail.com>

> Yes, the table exists on the cluster. Yes, I can see it in hbase shell and
> can scan it.
>
>
> On Mon, Jan 20, 2014 at 1:33 PM, Stack <stack@duboce.net> wrote:
>
> > Does the region/table exist on your cluster?  Can you see it in the UI
> and
> > scan it from shell?
> > St.Ack
> >
> >
> > On Mon, Jan 20, 2014 at 10:12 AM, Russell Jurney
> > <russell.jurney@gmail.com>wrote:
> >
> > > I'm on CDH 4.4, so it is HBase 0.94.6.
> > >
> > >
> > >
> > > On Mon, Jan 20, 2014 at 9:31 AM, Fernando Iwamoto - Plannej <
> > > fernando.iwamoto@plannej.com.br> wrote:
> > >
> > > > What kind of HBase and Pig version are you using? I'm having the same
> > > > problem as you.
> > > >
> > > >
> > > > 2014/1/20 Russell Jurney <russell.jurney@gmail.com>
> > > >
> > > > > I'm having trouble connecting to HBase from Pig's
> > > > > HBaseStorage<
> > > > >
> > > >
> > >
> >
> http://pig.apache.org/docs/r0.12.0/api/org/apache/pig/backend/hadoop/hbase/HBaseStorage.html
> > > > > >command.
> > > > > Any help would be appreciated.
> > > > >
> > > > > I'm running this command:
> > > > >
> > > > > time_series = LOAD '/tmp/time_series.txt' AS (date_time:chararray,
> > > > > time_series:chararray);
> > > > >
> > > > > STORE time_series INTO 'hbase://bluecoat' USING
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.pig.backend.hadoop.hbase.HBaseStorage('bytes_per_hour_time_series:series');
> > > > >
> > > > >
> > > > > The output is thus:
> > > > >
> > > > > 2014-01-20 08:49:51,896 [main] INFO
>  org.apache.zookeeper.ZooKeeper -
> > > > > Client
> > > > >
> > > > >
> > > >
> > >
> >
> environment:java.library.path=/Users/rjurney/Software/hadoop-1.0.3/libexec/../lib/native/Mac_OS_X-x86_64-64
> > > > > 2014-01-20 08:49:51,896 [main] INFO
>  org.apache.zookeeper.ZooKeeper -
> > > > > Client
> > > > >
> > > > >
> > > >
> > >
> >
> environment:java.io.tmpdir=/var/folders/0b/74l_65015_5fcbmbdz1w2xl40000gn/T/
> > > > > 2014-01-20 08:49:51,896 [main] INFO
>  org.apache.zookeeper.ZooKeeper -
> > > > > Client environment:java.compiler=<NA>
> > > > > 2014-01-20 08:49:51,896 [main] INFO
>  org.apache.zookeeper.ZooKeeper -
> > > > > Client environment:os.name=Mac OS X
> > > > > 2014-01-20 08:49:51,897 [main] INFO
>  org.apache.zookeeper.ZooKeeper -
> > > > > Client environment:os.arch=x86_64
> > > > > 2014-01-20 08:49:51,897 [main] INFO
>  org.apache.zookeeper.ZooKeeper -
> > > > > Client environment:os.version=10.9
> > > > > 2014-01-20 08:49:51,897 [main] INFO
>  org.apache.zookeeper.ZooKeeper -
> > > > > Client environment:user.name=rjurney
> > > > > 2014-01-20 08:49:51,897 [main] INFO
>  org.apache.zookeeper.ZooKeeper -
> > > > > Client environment:user.home=/Users/rjurney
> > > > > 2014-01-20 08:49:51,897 [main] INFO
>  org.apache.zookeeper.ZooKeeper -
> > > > > Client
> > > > >
> > environment:user.dir=/Users/rjurney/Software/steel-thread/pig/bluecoat
> > > > > 2014-01-20 08:49:51,899 [main] INFO
>  org.apache.zookeeper.ZooKeeper -
> > > > > Initiating client connection,
> > > > > connectString=hiveapp2:2181,hiveapp1:2181,hiveapp3:2181
> > > > > sessionTimeout=60000 watcher=hconnection
> > > > > 2014-01-20 08:49:51,926 [main] INFO
> > > > >  org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - The
> > > identifier
> > > > of
> > > > > this process is 43006@Russells-MacBook-Pro.local
> > > > > 2014-01-20 08:49:52,993 [main-SendThread(hiveapp1:2181)] INFO
> > > > >  org.apache.zookeeper.ClientCnxn - Opening socket connection to
> > server
> > > > > hiveapp1/10.10.30.200:2181. Will not attempt to authenticate using
> > > SASL
> > > > > (unknown error)
> > > > > 2014-01-20 08:49:53,000 [main-SendThread(hiveapp1:2181)] INFO
> > > > >  org.apache.zookeeper.ClientCnxn - Socket connection established
to
> > > > > hiveapp1/10.10.30.200:2181, initiating session
> > > > > 2014-01-20 08:49:53,030 [main-SendThread(hiveapp1:2181)] INFO
> > > > >  org.apache.zookeeper.ClientCnxn - Session establishment complete
> on
> > > > server
> > > > > hiveapp1/10.10.30.200:2181, sessionid = 0x34397f09f6c25aa,
> > negotiated
> > > > > timeout = 60000
> > > > > 2014-01-20 09:00:44,711 [main] ERROR
> > > > > org.apache.hadoop.hbase.mapreduce.TableOutputFormat -
> > > > > org.apache.hadoop.hbase.client.NoServerForRegionException: Unable
> to
> > > find
> > > > > region for bluecoat,,99999999999999 after 10 tries.
> > > > > 2014-01-20 09:00:44,714 [main] ERROR
> > org.apache.pig.tools.grunt.Grunt -
> > > > > ERROR 2999: Unexpected internal error.
> > > > > org.apache.hadoop.hbase.client.NoServerForRegionException: Unable
> to
> > > find
> > > > > region for bluecoat,,99999999999999 after 10 tries.
> > > > > 2014-01-20 09:00:44,714 [main] ERROR
> > org.apache.pig.tools.grunt.Grunt -
> > > > > java.lang.RuntimeException:
> > > > > org.apache.hadoop.hbase.client.NoServerForRegionException: Unable
> to
> > > find
> > > > > region for bluecoat,,99999999999999 after 10 tries.
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.mapreduce.TableOutputFormat.setConf(TableOutputFormat.java:206)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.pig.backend.hadoop.hbase.HBaseStorage.getOutputFormat(HBaseStorage.java:826)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.pig.newplan.logical.rules.InputOutputFileValidator$InputOutputFileVisitor.visit(InputOutputFileValidator.java:80)
> > > > > at
> > > > >
> > >
> org.apache.pig.newplan.logical.relational.LOStore.accept(LOStore.java:66)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.pig.newplan.DepthFirstWalker.depthFirst(DepthFirstWalker.java:64)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.pig.newplan.DepthFirstWalker.depthFirst(DepthFirstWalker.java:66)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.pig.newplan.DepthFirstWalker.depthFirst(DepthFirstWalker.java:66)
> > > > > at
> > > org.apache.pig.newplan.DepthFirstWalker.walk(DepthFirstWalker.java:53)
> > > > > at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:52)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.pig.newplan.logical.rules.InputOutputFileValidator.validate(InputOutputFileValidator.java:45)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.compile(HExecutionEngine.java:303)
> > > > > at org.apache.pig.PigServer.compilePp(PigServer.java:1382)
> > > > > at
> > > >
> > org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1307)
> > > > > at org.apache.pig.PigServer.execute(PigServer.java:1299)
> > > > > at org.apache.pig.PigServer.executeBatch(PigServer.java:377)
> > > > > at org.apache.pig.PigServer.executeBatch(PigServer.java:355)
> > > > > at
> > > > >
> > >
> org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:140)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:202)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:173)
> > > > > at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
> > > > > at org.apache.pig.Main.run(Main.java:607)
> > > > > at org.apache.pig.Main.main(Main.java:156)
> > > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > > > at java.lang.reflect.Method.invoke(Method.java:606)
> > > > > at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> > > > > Caused by:
> org.apache.hadoop.hbase.client.NoServerForRegionException:
> > > > > Unable to find region for bluecoat,,99999999999999 after 10 tries.
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:980)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:885)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:987)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:889)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:846)
> > > > > at
> org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:271)
> > > > > at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:211)
> > > > > at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:170)
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.mapreduce.TableOutputFormat.setConf(TableOutputFormat.java:201)
> > > > > ... 26 more
> > > > >
> > > > >
> > > > > --
> > > > > Russell Jurney twitter.com/rjurney russell.jurney@gmail.com
> > > > > datasyndrome.com
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Russell Jurney twitter.com/rjurney russell.jurney@gmail.com
> > > datasyndrome.com
> > >
> >
>
>
>
> --
> Russell Jurney twitter.com/rjurney russell.jurney@gmail.com
> datasyndrome.com
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message