hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Configurations for running a M/R job remotely with HBase
Date Thu, 28 Apr 2011 19:15:15 GMT
I believe 60000 is your HBase HMaster IPC port, not the NameNode one.
What are you attempting to do here?

See this package's docs on proper docs for running regular MR jobs
using HBase as Sink/Source:
http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/package-summary.html

On Fri, Apr 29, 2011 at 12:29 AM, sulabh choudhury <sulabhc@gmail.com> wrote:
> I am trying to run a M/R job remotely on a HBAse table.
>
> I have added the conf.set("fs.default.name","hdfs://10.0.0.3:60000") to the
> code hence now it does go to the cluster there I see the error
>
> WARN org.apache.hadoop.ipc.HBaseServer: IPC Server listener on 60000:
> readAndProcess threw exception java.io.EOFException. Count of bytes read: 0
>
> jjava.io.EOFException
>
>
>        at java.io.DataInputStream.readFully(DataInputStream.java:180)
>        at org.apache.hadoop.io.DataOutputBuffer$Buffer.write(DataOutputBuffer.java:63)
>        at org.apache.hadoop.io.DataOutputBuffer.write(DataOutputBuffer.java:101)
>        at org.apache.hadoop.io.UTF8.readChars(UTF8.java:216)
>        at org.apache.hadoop.io.UTF8.readString(UTF8.java:208)
>        at org.apache.hadoop.io.ObjectWritable.readObject(ObjectWritable.java:179)
>        at org.apache.hadoop.io.ObjectWritable.readObject(ObjectWritable.java:171)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Connection.processHeader(HBaseServer.java:966)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Connection.readAndProcess(HBaseServer.java:950)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Listener.doRead(HBaseServer.java:522)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:316)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>        at java.lang.Thread.run(Thread.java:662)
>
> and at the client side I see
>
> Exception in thread "main" java.io.IOException: Call to
> /10.0.0.3:60000failed on local exception: java.io.IOException:
> Connection reset by peer
>
> at org.apache.hadoop.ipc.Client.wrapException(Client.java:775)
>
> at org.apache.hadoop.ipc.Client.call(Client.java:743)
>
> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
>
> at $Proxy4.getProtocolVersion(Unknown Source)
>
> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
>
> at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:106)
>
> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:207)
>
>        etc
>
>
>
> I am pretty sure I am missing configuration pieces to achieve the same..What
> could be those ?
>



-- 
Harsh J

Mime
View raw message