hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From tim robertson <timrobertson...@gmail.com>
Subject Re: Mapreduce classpath issues.
Date Mon, 20 Jul 2009 16:49:46 GMT
Just spotted that in the other thread stack.  Just making changes to
let HBase manage zookeeper

Cheers

Tim


On Mon, Jul 20, 2009 at 6:37 PM, stack<stack@duboce.net> wrote:
> Zookeeper is running?
>
> The hbase-site.xml is pointing at your quorum?
>
> St.Ack
>
> On Mon, Jul 20, 2009 at 9:34 AM, tim robertson <timrobertson100@gmail.com>wrote:
>
>> Hmmm... I must have been doing something stupid.  I added zookeeper
>> and the CP error disappeared - I guess I hadn't restarted properly.
>>
>> Now trying to find the next issue ;o)
>>
>> Cheers,
>>
>> Tim
>>
>>
>> 2009-07-20 18:31:22,669 WARN org.apache.zookeeper.ClientCnxn:
>> Exception closing session 0x0 to sun.nio.ch.SelectionKeyImpl@6929ae9b
>> java.net.ConnectException: Connection refused
>>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>>        at
>> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
>>        at
>> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:885)
>> 2009-07-20 18:31:22,669 WARN org.apache.zookeeper.ClientCnxn: Ignoring
>> exception during shutdown input
>> java.nio.channels.ClosedChannelException
>>        at
>> sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:638)
>>        at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360)
>>        at
>> org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:951)
>>        at
>> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:922)
>> 2009-07-20 18:31:22,669 WARN org.apache.zookeeper.ClientCnxn: Ignoring
>> exception during shutdown output
>> java.nio.channels.ClosedChannelException
>>        at
>> sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:649)
>>        at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:368)
>>        at
>> org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:956)
>>        at
>> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:922)
>> 2009-07-20 18:31:22,770 WARN
>> org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper: Failed to create
>> /hbase:
>> org.apache.zookeeper.KeeperException$ConnectionLossException:
>> KeeperErrorCode = ConnectionLoss for /hbase
>>        at
>> org.apache.zookeeper.KeeperException.create(KeeperException.java:90)
>>        at
>> org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
>>        at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:522)
>>        at
>> org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.ensureExists(ZooKeeperWrapper.java:342)
>>        at
>> org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.ensureParentExists(ZooKeeperWrapper.java:363)
>>        at
>> org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.checkOutOfSafeMode(ZooKeeperWrapper.java:476)
>>        at
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:848)
>>        at
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:517)
>>        at
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.relocateRegion(HConnectionManager.java:499)
>>        at
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
>>        at
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:526)
>>        at
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.relocateRegion(HConnectionManager.java:499)
>>        at
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
>>        at
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:530)
>>        at
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:493)
>>        at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:124)
>>        at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:102)
>>        at
>> org.gbif.occurrencestore.mapreduce.DwCTabFileLoader$MapLoad.setup(DwCTabFileLoader.java:64)
>>        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)
>>        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518)
>>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303)
>>        at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>
>>
>>
>>
>>
>>
>>
>> On Mon, Jul 20, 2009 at 6:17 PM, Jonathan Gray<jgray@apache.org> wrote:
>> > Not sure why HBC was not found.  Perhaps you need the hadoop jar?
>> >
>> > But yes, you need the zookeeper jar in the classpath that ships with
>> hbase.
>> >
>> > tim robertson wrote:
>> >>
>> >> Hi all,
>> >>
>> >> I am trying to bulk import using my own mapreduce code (doing the
>> >> insert in my map()).
>> >>
>> >> I have modified my hadoop-env.sh to have the following:
>> >>  export
>> >>
>> HADOOP_CLASSPATH=/var/root/hbase-0.20.0/hbase-0.20.0-dev.jar:/var/root/hbase-0.20.0/conf
>> >>
>> >> the paths are correct, and I copied it around the cluster and
>> >> restarted all demons.
>> >>
>> >> When trying to load in using mapreduce I get the following 2 errors
>> >> java.lang.NoClassDefFoundError:
>> org/apache/hadoop/hbase/HBaseConfiguration
>> >> java.lang.ClassNotFoundException: org.apache.zookeeper.Watcher
>> >>
>> >> Does zookeeper now have to be on the CP?
>> >> I am not sure why HBaseConfiguration is not found though... could it
>> >> be a permission thing as I am running everything as root user?
>> >>
>> >> Thanks for any pointers,
>> >>
>> >> Tim
>> >>
>> >
>>
>

Mime
View raw message