hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From tim robertson <timrobertson...@gmail.com>
Subject Re: Mapreduce classpath issues.
Date Mon, 20 Jul 2009 16:34:00 GMT
Hmmm... I must have been doing something stupid.  I added zookeeper
and the CP error disappeared - I guess I hadn't restarted properly.

Now trying to find the next issue ;o)

Cheers,

Tim


2009-07-20 18:31:22,669 WARN org.apache.zookeeper.ClientCnxn:
Exception closing session 0x0 to sun.nio.ch.SelectionKeyImpl@6929ae9b
java.net.ConnectException: Connection refused
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:885)
2009-07-20 18:31:22,669 WARN org.apache.zookeeper.ClientCnxn: Ignoring
exception during shutdown input
java.nio.channels.ClosedChannelException
	at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:638)
	at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360)
	at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:951)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:922)
2009-07-20 18:31:22,669 WARN org.apache.zookeeper.ClientCnxn: Ignoring
exception during shutdown output
java.nio.channels.ClosedChannelException
	at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:649)
	at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:368)
	at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:956)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:922)
2009-07-20 18:31:22,770 WARN
org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper: Failed to create
/hbase:
org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hbase
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:90)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:522)
	at org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.ensureExists(ZooKeeperWrapper.java:342)
	at org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.ensureParentExists(ZooKeeperWrapper.java:363)
	at org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.checkOutOfSafeMode(ZooKeeperWrapper.java:476)
	at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:848)
	at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:517)
	at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.relocateRegion(HConnectionManager.java:499)
	at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
	at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:526)
	at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.relocateRegion(HConnectionManager.java:499)
	at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
	at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:530)
	at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:493)
	at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:124)
	at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:102)
	at org.gbif.occurrencestore.mapreduce.DwCTabFileLoader$MapLoad.setup(DwCTabFileLoader.java:64)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303)
	at org.apache.hadoop.mapred.Child.main(Child.java:170)







On Mon, Jul 20, 2009 at 6:17 PM, Jonathan Gray<jgray@apache.org> wrote:
> Not sure why HBC was not found.  Perhaps you need the hadoop jar?
>
> But yes, you need the zookeeper jar in the classpath that ships with hbase.
>
> tim robertson wrote:
>>
>> Hi all,
>>
>> I am trying to bulk import using my own mapreduce code (doing the
>> insert in my map()).
>>
>> I have modified my hadoop-env.sh to have the following:
>>  export
>> HADOOP_CLASSPATH=/var/root/hbase-0.20.0/hbase-0.20.0-dev.jar:/var/root/hbase-0.20.0/conf
>>
>> the paths are correct, and I copied it around the cluster and
>> restarted all demons.
>>
>> When trying to load in using mapreduce I get the following 2 errors
>> java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/HBaseConfiguration
>> java.lang.ClassNotFoundException: org.apache.zookeeper.Watcher
>>
>> Does zookeeper now have to be on the CP?
>> I am not sure why HBaseConfiguration is not found though... could it
>> be a permission thing as I am running everything as root user?
>>
>> Thanks for any pointers,
>>
>> Tim
>>
>

Mime
View raw message