Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6487817EE3 for ; Thu, 5 Nov 2015 12:58:51 +0000 (UTC) Received: (qmail 65981 invoked by uid 500); 5 Nov 2015 12:58:49 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 65913 invoked by uid 500); 5 Nov 2015 12:58:49 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 65896 invoked by uid 99); 5 Nov 2015 12:58:49 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Nov 2015 12:58:49 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 958471A2327 for ; Thu, 5 Nov 2015 12:58:48 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.001 X-Spam-Level: *** X-Spam-Status: No, score=3.001 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=3, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=aletheconsulting_com.20150623.gappssmtp.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id sGMH9VgXCdh8 for ; Thu, 5 Nov 2015 12:58:35 +0000 (UTC) Received: from mail-wi0-f180.google.com (mail-wi0-f180.google.com [209.85.212.180]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 86C8244501 for ; Thu, 5 Nov 2015 12:58:34 +0000 (UTC) Received: by wimw2 with SMTP id w2so9577983wim.1 for ; Thu, 05 Nov 2015 04:58:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=aletheconsulting_com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=OXSUXAgy5SCMvesUE8LKWuXX+hXJHpNyDl57vSDuKFE=; b=iMA43FDpo8JRNdhIc4/uVqp5Xd5SypCy2MNXjaEMaGudSINJBPRRly7EZHJapfYV4V pJshauhFNxA8PlwYrI1XNiYT0nyAjyWdeC25+YQlKmap8Nocw5WqiMnItu+JoArqDstA HLvx93JQSofCqvZpJvLheZOquKsYcAi/sxQieR0dRUmWYdOBb7T3jZpkW9OKdsDp9kKe YOgWifchd8h3ReUfbsAhJaPyQFEYWFMgyoMVKaQyO9VDxCWGOYpRSHwSc7FbsjhDHADc 63/ucxY4vQ9898Z5JH4d2x4VSVfQF+UGRYjX1EE5KneVY5SbL32lIFPDBqrvXMEgKNrs ES1A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=OXSUXAgy5SCMvesUE8LKWuXX+hXJHpNyDl57vSDuKFE=; b=OM+eGnPi9WC0l7xagDhYSGVPb94T/xId4yyF1eEGQeN5RY27r+9Jp6n78piCHslTBG bE2JJQsvL63Ko09Fk+E+B6nSQndZKD0lH6aUJZxPLTRUboDKYSafXB8RWisxZo8rJkeo LV1lQZAstu1rIgv4dnnqPLygY9tDBCTR6pfRpzbajUEEaJGwJHp2YL3Nqtdyh3kE1rsL Cy7s6aCAWfGWpEcgEQ219Mn4z90JJf9cbUA8OXT0bx/bthb/VdGdLIOco045vRMUHIWp VQUWJjNOXot8ow6cZlhaeMEgr0iL7qYzABzX5KPM1XdlPJZYFDiU5RpX/UTY4w5BxicA AMdQ== X-Gm-Message-State: ALoCoQkx5vFGNujHHPe4pHYj0z0tv6Ae9ArF40QyRmVVhdIPEQGEOugL+HVMfXZqnT+fxMVzWEq8 MIME-Version: 1.0 X-Received: by 10.194.205.130 with SMTP id lg2mr8431628wjc.9.1446728307311; Thu, 05 Nov 2015 04:58:27 -0800 (PST) Received: by 10.28.165.12 with HTTP; Thu, 5 Nov 2015 04:58:27 -0800 (PST) X-Originating-IP: [103.245.119.26] In-Reply-To: References: <43F0DFA8-6E0B-40FD-91AF-C9E1A4D723FE@gmail.com> Date: Thu, 5 Nov 2015 18:28:27 +0530 Message-ID: Subject: Re: Error while loading bulk data from pig to hbase From: Naresh Reddy To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=047d7bb04d74d81ffc0523caae42 --047d7bb04d74d81ffc0523caae42 Content-Type: text/plain; charset=UTF-8 Hi I have already replaced the hbase version with "*hbase95.version=1.1.2*" in libraries.properties file and compiled it, but I am getting the same error. Regards Naresh On Wed, Nov 4, 2015 at 11:29 PM, Daniel Dai wrote: > Will need to change ivy/libraries.properties, specify the right hbase > version and compile again. > > On Wed, Nov 4, 2015 at 6:31 AM, Ted Yu wrote: > > > ... 22 moreCaused by: java.lang.NoSuchMethodError: > > org.apache.hadoop.hbase.client.Scan.setCacheBlocks(Z)V at > > > > Looks like the version of Pig you use is not compiled against hbase 1.1.2 > > > > This is related: > > Author: Enis Soztutar > > Date: Fri Sep 5 18:48:38 2014 -0700 > > > > HBASE-10841 Scan,Get,Put,Delete,etc setters should consistently > return > > this > > > > FYI > > > > On Tue, Nov 3, 2015 at 10:36 PM, Naresh Reddy < > > naresh.reddy@aletheconsulting.com> wrote: > > > >> Hi > >> Thanks for the reply.Below is the full error log. > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> *Pig Stack Trace---------------ERROR 1200: Pig script failed to parse: > >> pig script failed to validate: > >> java.lang.RuntimeException: could not instantiate > >> 'org.apache.pig.backend.hadoop.hbase.HBaseStorage' with arguments > >> '[info:fname info:lname]'Failed to parse: Pig script failed to parse: > >> >> 2, column 0> pig script failed to validate: java.lang.RuntimeException: > >> could not instantiate 'org.apache.pig.backend.hadoop.hbase.HBaseStorage' > >> with arguments '[info:fname info:lname]' at > >> > org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:199) > >> at org.apache.pig.PigServer$Graph.validateQuery(PigServer.java:1707) > at > >> org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1680) at > >> org.apache.pig.PigServer.registerQuery(PigServer.java:623) at > >> org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:1063) > >> at > >> > >> > org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:501) > >> at > >> > >> > org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:230) > >> at > >> > >> > org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205) > >> at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66) at > >> org.apache.pig.Main.run(Main.java:558) at > >> org.apache.pig.Main.main(Main.java:170) at > >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at > >> > >> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > >> at > >> > >> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > >> at java.lang.reflect.Method.invoke(Method.java:606) at > >> org.apache.hadoop.util.RunJar.main(RunJar.java:212)Caused by: >> column 0> pig script failed to validate: java.lang.RuntimeException: > could > >> not instantiate 'org.apache.pig.backend.hadoop.hbase.HBaseStorage' with > >> arguments '[info:fname info:lname]' at > >> > >> > org.apache.pig.parser.LogicalPlanBuilder.buildStoreOp(LogicalPlanBuilder.java:1009) > >> at > >> > >> > org.apache.pig.parser.LogicalPlanGenerator.store_clause(LogicalPlanGenerator.java:7775) > >> at > >> > >> > org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1669) > >> at > >> > >> > org.apache.pig.parser.LogicalPlanGenerator.general_statement(LogicalPlanGenerator.java:1102) > >> at > >> > >> > org.apache.pig.parser.LogicalPlanGenerator.statement(LogicalPlanGenerator.java:560) > >> at > >> > >> > org.apache.pig.parser.LogicalPlanGenerator.query(LogicalPlanGenerator.java:421) > >> at > >> > org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:191) > >> ... 15 moreCaused by: java.lang.RuntimeException: could not instantiate > >> 'org.apache.pig.backend.hadoop.hbase.HBaseStorage' with arguments > >> '[info:fname info:lname]' at > >> > >> > org.apache.pig.impl.PigContext.instantiateFuncFromSpec(PigContext.java:772) > >> at > >> > >> > org.apache.pig.parser.LogicalPlanBuilder.buildStoreOp(LogicalPlanBuilder.java:988) > >> ... 21 moreCaused by: java.lang.reflect.InvocationTargetException at > >> sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) > >> at > >> > >> > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) > >> at > >> > >> > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > >> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at > >> > >> > org.apache.pig.impl.PigContext.instantiateFuncFromSpec(PigContext.java:740) > >> ... 22 moreCaused by: java.lang.NoSuchMethodError: > >> org.apache.hadoop.hbase.client.Scan.setCacheBlocks(Z)V at > >> > >> > org.apache.pig.backend.hadoop.hbase.HBaseStorage.initScan(HBaseStorage.java:405) > >> at > >> > >> > org.apache.pig.backend.hadoop.hbase.HBaseStorage.(HBaseStorage.java:346) > >> at > >> > >> > org.apache.pig.backend.hadoop.hbase.HBaseStorage.(HBaseStorage.java:235) > >> ... 27 > >> > >> > more================================================================================* > >> > >> Regards > >> Naresh > >> > >> On Wed, Nov 4, 2015 at 11:46 AM, Naresh Reddy < > >> naresh.reddy@aletheconsulting.com> wrote: > >> > >> > Hi > >> > Thanks for the reply.PFA for the full error. > >> > > >> > Regard > >> > Naresh > >> > > >> > > >> > On Wed, Nov 4, 2015 at 11:29 AM, Ted Yu wrote: > >> > > >> >> Naresh: > >> >> Can you pastebin the full error ? > >> >> It should be in pig_XXXX.log > >> >> > >> >> Cheers > >> >> > >> >> > On Nov 3, 2015, at 9:07 PM, Naresh Reddy < > >> >> naresh.reddy@aletheconsulting.com> wrote: > >> >> > > >> >> > Hi > >> >> > > >> >> > I am getting the below error while loading bulk data from pig to > >> hbase > >> >> > through HBaseStorage.Please help me to resolve this issue.Thanks in > >> >> advance. > >> >> > > >> >> > > >> >> > *ERROR:pig script failed to validate: java.lang.RuntimeException: > >> could > >> >> not > >> >> > instantiate 'org.apache.pig.backend.hadoop.hbase.HBaseStorage' with > >> >> > arguments.* > >> >> > > >> >> > Below is my pig script. > >> >> > > >> >> > > >> >> > > >> >> > > >> >> > > >> >> > > >> >> > > >> >> > *register > '/home/hduser/hbase-1.1.2/lib/zookeeper-3.4.6.jar';register > >> >> > '/home/hduser/hbase-1.1.2/lib/guava-12.0.1.jar';register > >> >> > '/home/hduser/hbase-1.1.2/lib/hbase-common-1.1.2.jar';register > >> >> > '/home/hduser/hbase-1.1.2/lib/hbase-client-1.1.2.jar';register > >> >> > '/home/hduser/hbase-1.1.2/lib/protobuf-java-2.5.0.jar';raw_data = > >> LOAD > >> >> > '/user/hduser/input.csv' USING PigStorage(',') AS (id:chararray, > >> >> > fname:chararray, lname:chararray);STORE raw_data INTO > >> >> > 'hbase://sample_names' USING > >> >> > org.apache.pig.backend.hadoop.hbase.HBaseStorage ('info:fname > >> >> info:lname');* > >> >> > > >> >> > > >> >> > Regards > >> >> > Naresh > >> >> > >> > > >> > > >> > > > > > --047d7bb04d74d81ffc0523caae42--