Return-Path: Delivered-To: apmail-hbase-user-archive@www.apache.org Received: (qmail 70531 invoked from network); 7 Dec 2010 09:31:10 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 7 Dec 2010 09:31:10 -0000 Received: (qmail 43604 invoked by uid 500); 7 Dec 2010 09:31:09 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 43319 invoked by uid 500); 7 Dec 2010 09:31:08 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 43311 invoked by uid 99); 7 Dec 2010 09:31:08 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Dec 2010 09:31:08 +0000 X-ASF-Spam-Status: No, hits=1.5 required=10.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of gkhncpn@gmail.com designates 209.85.216.169 as permitted sender) Received: from [209.85.216.169] (HELO mail-qy0-f169.google.com) (209.85.216.169) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Dec 2010 09:31:03 +0000 Received: by qyk7 with SMTP id 7so4487967qyk.14 for ; Tue, 07 Dec 2010 01:30:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:content-type; bh=slPsxVG1qGO+LK0RhZW6X53CE7QNSpy0rY+xaQ3wz7c=; b=mhw6dwn7sdFCl8MC5kGL8rZR439mcnnzzkkw4dRXR9T4aXAMTrPEMok2XwKuhadGfV VsbNcd9MmMW3ALgDFddeLebWjtfflB5PQzVoizRS72WR35yM31Cca/Oi3+jMdpWYJTXL h4GRhLj2hc5EOLLWR5T3K40AiLhV+t/GaWD1g= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=oB4O0l2bwabeniuDErVsDYmR/B5NOk5lgwi6gta2WFCsbs1P70AmO1ApcvkSUD3wOJ jJZT68sW0nsE4AVcXDKZBiDjzcbbCYG8qxLA+uOo3XH7bxsYuaBlV7Ot+57VdqMfMJdA 9WAcSQZvmyr/X0g/+B6aM8PcV32B+6Yg2rHU0= MIME-Version: 1.0 Received: by 10.224.2.208 with SMTP id 16mr5521749qak.315.1291714242202; Tue, 07 Dec 2010 01:30:42 -0800 (PST) Received: by 10.220.172.199 with HTTP; Tue, 7 Dec 2010 01:30:42 -0800 (PST) In-Reply-To: References: Date: Tue, 7 Dec 2010 11:30:42 +0200 Message-ID: Subject: Re: Importing to HBase from Java problem From: =?UTF-8?B?R8O2a2hhbiDDh2FwYW4=?= To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=0015175ce0f48ecd430496cea837 --0015175ce0f48ecd430496cea837 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable I had forgotten add HBase-conf to MapReduce ClassPath. That solved the problem, Thanks. On Mon, Dec 6, 2010 at 8:40 PM, G=C3=B6khan =C3=87apan = wrote: > > > On Mon, Dec 6, 2010 at 7:54 PM, Stack wrote: > >> That looks like a mismatch between client and server hbase versions. >> Ensure you have same running all over your cluster. Make sure you >> don't have a mix of 0.20.x and 0.89... or 0.90 release candidates. >> >> You seem to be feeling your way. Have you seen >> >> https://hudson.apache.org/hudson/view/G-L/view/HBase/job/hbase-0.90/ws/t= runk/target/site/apidocs/org/apache/hadoop/hbase/mapreduce/package-summary.= html#package_description >> ? >> >> You added zookeeper. Be sure to add the hbase conf directory to your >> MapReduce CLASSPATH. >> >> St.Ack >> > > I hadn't added the hbase conf directory to my MapReduce CLASSPATH. > Unfortunately, now I am not able to try. I will try tomorrow, and let you > know. > > Thanks. > >> >> >> On Mon, Dec 6, 2010 at 8:12 AM, G=C3=B6khan =C3=87apan wrote: >> > Hi, >> > >> > I am facing with some issues when I try to write the results of my >> Reducer >> > to an HBase table, in pseudo-distributed mode. >> > >> > HBase version: 0.20.6 >> > Hadoop version: 0.20.2 >> > >> > I let HBase manage Zookeeper. >> > >> > After starting HBase, I can successfully start HBase shell, and create= a >> > table. >> > >> > In my MapReduce app, I have a dependency to HBase 0.20.2. >> > > Sorry, that was also HBase 0.20.6 > > >> > >> > However, it gave me the following error: >> > Error: java.lang.ClassNotFoundException: org.apache.zookeeper.Watcher >> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202) >> > at java.security.AccessController.doPrivileged(Native Method) >> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190) >> > at java.lang.ClassLoader.loadClass(ClassLoader.java:307) >> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) >> > at java.lang.ClassLoader.loadClass(ClassLoader.java:248) >> > at java.lang.ClassLoader.defineClass1(Native Method) >> > at java.lang.ClassLoader.defineClassCond(ClassLoader.java:632) >> > at java.lang.ClassLoader.defineClass(ClassLoader.java:616) >> > at >> > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141= ) >> > at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) >> > at java.net.URLClassLoader.access$000(URLClassLoader.java:58) >> > at java.net.URLClassLoader$1.run(URLClassLoader.java:197) >> > at java.security.AccessController.doPrivileged(Native Method) >> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190) >> > at java.lang.ClassLoader.loadClass(ClassLoader.java:307) >> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) >> > at java.lang.ClassLoader.loadClass(ClassLoader.java:248) >> > at >> > >> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnect= ionManager.java:93) >> > at org.apache.hadoop.hbase.client.HTable.(HTable.java:119) >> > at org.apache.hadoop.hbase.client.HTable.(HTable.java:101) >> > at >> > >> org.apache.hadoop.hbase.mapreduce.TableOutputFormat.getRecordWriter(Tabl= eOutputFormat.java:116) >> > at >> > org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:553) >> > at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408) >> > at org.apache.hadoop.mapred.Child.main(Child.java:170) >> > . >> > . >> > . >> > >> > >> > >> > So I have added ZooKeeper as a dependency. Now it throws the following >> > Exception for ZooKeeper 3.2.2, 3.3.0, and 3.3.1: >> > >> > 10/12/06 17:51:53 INFO mapred.JobClient: map 100% reduce 27% >> > 10/12/06 17:51:58 INFO mapred.JobClient: Task Id : >> > attempt_201012061721_0002_r_000000_2, Status : FAILED >> > java.lang.reflect.UndeclaredThrowableException >> > at $Proxy2.getRegionInfo(Unknown Source) >> > at >> > >> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRoo= tRegion(HConnectionManager.java:874) >> > at >> > >> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateReg= ion(HConnectionManager.java:515) >> > at >> > >> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateReg= ion(HConnectionManager.java:491) >> > at >> > >> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateReg= ionInMeta(HConnectionManager.java:565) >> > at >> > >> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateReg= ion(HConnectionManager.java:524) >> > at >> > >> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateReg= ion(HConnectionManager.java:491) >> > at >> > >> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateReg= ionInMeta(HConnectionManager.java:565) >> > at >> > >> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateReg= ion(HConnectionManager.java:528) >> > at >> > >> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateReg= ion(HConnectionManager.java:491) >> > at org.apache.hadoop.hbase.client.HTable.(HTable.java:123) >> > at org.apache.hadoop.hbase.client.HTable.(HTable.java:101) >> > at >> > >> org.apache.hadoop.hbase.mapreduce.TableOutputFormat.getRecordWriter(Tabl= eOutputFormat.java:116) >> > at >> > org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:553) >> > at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408) >> > at org.apache.hadoop.mapred.Child.main(Child.java:170) >> > Caused by: org.apache.hadoop.ipc.RemoteException: java.io.IOException: >> > java.io.IOException: Could not find requested method, the usual cause = is >> a >> > version mismatch between client and server. >> > at >> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:648) >> > at >> > >> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915= ) >> > >> > at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:72= 3) >> > at >> > org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:328) >> > ... 16 more >> > >> > >> > I guess this is a compatibility issue between HBase and ZooKeeper, but= I >> > couldn't find the right version of ZooKeeper to add as a dependency. >> > >> > >> > Thanks in advance, >> > >> > Gokhan >> > >> > > > > -- > Gokhan > --=20 Gokhan --0015175ce0f48ecd430496cea837--