hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Daniel Dai <dai...@gmail.com>
Subject Re: Error while loading bulk data from pig to hbase
Date Wed, 04 Nov 2015 17:59:20 GMT
Will need to change ivy/libraries.properties, specify the right hbase
version and compile again.

On Wed, Nov 4, 2015 at 6:31 AM, Ted Yu <yuzhihong@gmail.com> wrote:

> ... 22 moreCaused by: java.lang.NoSuchMethodError:
> org.apache.hadoop.hbase.client.Scan.setCacheBlocks(Z)V    at
>
> Looks like the version of Pig you use is not compiled against hbase 1.1.2
>
> This is related:
> Author: Enis Soztutar <enis@apache.org>
> Date:   Fri Sep 5 18:48:38 2014 -0700
>
>     HBASE-10841 Scan,Get,Put,Delete,etc setters should consistently return
> this
>
> FYI
>
> On Tue, Nov 3, 2015 at 10:36 PM, Naresh Reddy <
> naresh.reddy@aletheconsulting.com> wrote:
>
>> Hi
>> Thanks for the reply.Below is the full error log.
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> *Pig Stack Trace---------------ERROR 1200: Pig script failed to parse:
>> <line 2, column 0> pig script failed to validate:
>> java.lang.RuntimeException: could not instantiate
>> 'org.apache.pig.backend.hadoop.hbase.HBaseStorage' with arguments
>> '[info:fname info:lname]'Failed to parse: Pig script failed to parse:
>> <line
>> 2, column 0> pig script failed to validate: java.lang.RuntimeException:
>> could not instantiate 'org.apache.pig.backend.hadoop.hbase.HBaseStorage'
>> with arguments '[info:fname info:lname]'    at
>> org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:199)
>> at org.apache.pig.PigServer$Graph.validateQuery(PigServer.java:1707)    at
>> org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1680)    at
>> org.apache.pig.PigServer.registerQuery(PigServer.java:623)    at
>> org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:1063)
>> at
>>
>> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:501)
>> at
>>
>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:230)
>> at
>>
>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205)
>> at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66)    at
>> org.apache.pig.Main.run(Main.java:558)    at
>> org.apache.pig.Main.main(Main.java:170)    at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)    at
>>
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>> at
>>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:606)    at
>> org.apache.hadoop.util.RunJar.main(RunJar.java:212)Caused by: <line 2,
>> column 0> pig script failed to validate: java.lang.RuntimeException: could
>> not instantiate 'org.apache.pig.backend.hadoop.hbase.HBaseStorage' with
>> arguments '[info:fname info:lname]'    at
>>
>> org.apache.pig.parser.LogicalPlanBuilder.buildStoreOp(LogicalPlanBuilder.java:1009)
>> at
>>
>> org.apache.pig.parser.LogicalPlanGenerator.store_clause(LogicalPlanGenerator.java:7775)
>> at
>>
>> org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1669)
>> at
>>
>> org.apache.pig.parser.LogicalPlanGenerator.general_statement(LogicalPlanGenerator.java:1102)
>> at
>>
>> org.apache.pig.parser.LogicalPlanGenerator.statement(LogicalPlanGenerator.java:560)
>> at
>>
>> org.apache.pig.parser.LogicalPlanGenerator.query(LogicalPlanGenerator.java:421)
>> at
>> org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:191)
>> ... 15 moreCaused by: java.lang.RuntimeException: could not instantiate
>> 'org.apache.pig.backend.hadoop.hbase.HBaseStorage' with arguments
>> '[info:fname info:lname]'    at
>>
>> org.apache.pig.impl.PigContext.instantiateFuncFromSpec(PigContext.java:772)
>> at
>>
>> org.apache.pig.parser.LogicalPlanBuilder.buildStoreOp(LogicalPlanBuilder.java:988)
>> ... 21 moreCaused by: java.lang.reflect.InvocationTargetException    at
>> sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>> at
>>
>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>> at
>>
>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)    at
>>
>> org.apache.pig.impl.PigContext.instantiateFuncFromSpec(PigContext.java:740)
>> ... 22 moreCaused by: java.lang.NoSuchMethodError:
>> org.apache.hadoop.hbase.client.Scan.setCacheBlocks(Z)V    at
>>
>> org.apache.pig.backend.hadoop.hbase.HBaseStorage.initScan(HBaseStorage.java:405)
>> at
>>
>> org.apache.pig.backend.hadoop.hbase.HBaseStorage.<init>(HBaseStorage.java:346)
>> at
>>
>> org.apache.pig.backend.hadoop.hbase.HBaseStorage.<init>(HBaseStorage.java:235)
>> ... 27
>>
>> more================================================================================*
>>
>> Regards
>> Naresh
>>
>> On Wed, Nov 4, 2015 at 11:46 AM, Naresh Reddy <
>> naresh.reddy@aletheconsulting.com> wrote:
>>
>> > Hi
>> > Thanks for the reply.PFA for the full error.
>> >
>> > Regard
>> > Naresh
>> >
>> >
>> > On Wed, Nov 4, 2015 at 11:29 AM, Ted Yu <yuzhihong@gmail.com> wrote:
>> >
>> >> Naresh:
>> >> Can you pastebin the full error ?
>> >> It should be in pig_XXXX.log
>> >>
>> >> Cheers
>> >>
>> >> > On Nov 3, 2015, at 9:07 PM, Naresh Reddy <
>> >> naresh.reddy@aletheconsulting.com> wrote:
>> >> >
>> >> > Hi
>> >> >
>> >> > I am getting the below error while loading bulk data from pig to
>> hbase
>> >> > through HBaseStorage.Please help me to resolve this issue.Thanks in
>> >> advance.
>> >> >
>> >> >
>> >> > *ERROR:pig script failed to validate: java.lang.RuntimeException:
>> could
>> >> not
>> >> > instantiate 'org.apache.pig.backend.hadoop.hbase.HBaseStorage' with
>> >> > arguments.*
>> >> >
>> >> > Below is my pig script.
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> > *register '/home/hduser/hbase-1.1.2/lib/zookeeper-3.4.6.jar';register
>> >> > '/home/hduser/hbase-1.1.2/lib/guava-12.0.1.jar';register
>> >> > '/home/hduser/hbase-1.1.2/lib/hbase-common-1.1.2.jar';register
>> >> > '/home/hduser/hbase-1.1.2/lib/hbase-client-1.1.2.jar';register
>> >> > '/home/hduser/hbase-1.1.2/lib/protobuf-java-2.5.0.jar';raw_data =
>> LOAD
>> >> > '/user/hduser/input.csv' USING PigStorage(',') AS (id:chararray,
>> >> > fname:chararray, lname:chararray);STORE raw_data INTO
>> >> > 'hbase://sample_names' USING
>> >> > org.apache.pig.backend.hadoop.hbase.HBaseStorage ('info:fname
>> >> info:lname');*
>> >> >
>> >> >
>> >> > Regards
>> >> > Naresh
>> >>
>> >
>> >
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message