hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marcos Luis Ortiz Valmaseda <marcosluis2...@gmail.com>
Subject Re: scan very slow in hbase
Date Wed, 07 Aug 2013 01:48:00 GMT
Regards, ch.
I was looking a post about this topic and I found it. It was posted in the
Ericsson Labs´s blog, and it talked about the approach they followed to
improve HBase performance in several ways, including Scans. You can read it
here:
http://labs.ericsson.com/blog/hbase-performance-tuners

Other resources:
Ameya´s talk about the HBase´s use at Groupon (See his last slide):
http://www.slideshare.net/cloudera/case-studies-session-3b<http://es.slideshare.net/cloudera/case-studies-session-3b>

Manoj and Goving talk:
http://www.slideshare.net/cloudera/hbasecon-2013-evolving-a-firstgeneration-apache-hbase-deployment-to-second-generation-and-beyond<http://es.slideshare.net/cloudera/hbasecon-2013-evolving-a-firstgeneration-apache-hbase-deployment-to-second-generation-and-beyond>



2013/8/6 Marcos Luis Ortiz Valmaseda <marcosluis2186@gmail.com>

> Regards, ch.
> Which version of HBase are you using?
> HBase´s development group have worked very hard in Scans improvements
>
> http://www.slideshare.net/cloudera/hbase-consistency-and-performance-final<http://es.slideshare.net/cloudera/hbase-consistency-and-performance-final>
>
> http://www.slideshare.net/cloudera/6-real-time-analytics-with-h-base-alex-baranau-sematext-final-3-updated-last-minute<http://es.slideshare.net/cloudera/6-real-time-analytics-with-h-base-alex-baranau-sematext-final-3-updated-last-minute>
>
> http://www.slideshare.net/cloudera/3-learning-h-base-internals-lars-hofhansl-salesforce-final<http://es.slideshare.net/cloudera/3-learning-h-base-internals-lars-hofhansl-salesforce-final>
>
>
> ---------- Forwarded message ----------
> From: ch huang <justlooks@gmail.com>
> Date: 2013/8/6
> Subject: Re: scan very slow in hbase
> To: user@hbase.apache.org
>
>
> i find the error is because i stop the running java code,i have not found
> why the scan is so slow
>
> On Tue, Aug 6, 2013 at 10:38 PM, Stack <stack@duboce.net> wrote:
>
> > I would suggest you search the mail archives before posting first (you
> will
> > usually get your answer faster if you go this route).
> >
> > The below has been answered in the recent past.  See
> > http://search-hadoop.com/m/5tk8QnhFqw
> >
> > Thanks,
> > St.Ack
> >
> >
> > On Tue, Aug 6, 2013 at 12:39 AM, ch huang <justlooks@gmail.com> wrote:
> >
> > > my workmate  tell me hbase is very slow for scan something ,i check the
> > > region server find the following information,anyone can help?
> > >
> > >
> > > 13/08/06 15:30:34 WARN ipc.HBaseServer: IPC Server listener on 60020:
> > > readAndProcess threw exception java.io.IOException: Connection reset by
> > > peer. Count of bytes read: 0
> > > java.io.IOException: Connection reset by peer
> > >         at sun.nio.ch.FileDispatcher.read0(Native Method)
> > >         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:21)
> > >         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:198)
> > >         at sun.nio.ch.IOUtil.read(IOUtil.java:171)
> > >         at
> sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:245)
> > >         at
> > >
> >
> org.apache.hadoop.hbase.ipc.HBaseServer.channelRead(HBaseServer.java:1796)
> > >         at
> > >
> > >
> >
> org.apache.hadoop.hbase.ipc.HBaseServer$Connection.readAndProcess(HBaseServer.java:1179)
> > >         at
> > >
> > >
> >
> org.apache.hadoop.hbase.ipc.HBaseServer$Listener.doRead(HBaseServer.java:748)
> > >         at
> > >
> > >
> >
> org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.doRunLoop(HBaseServer.java:539)
> > >         at
> > >
> > >
> >
> org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:514)
> > >         at
> > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> > >         at
> > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> > >         at java.lang.Thread.run(Thread.java:662)
> > > 13/08/06 15:30:34 ERROR regionserver.HRegionServer:
> > > org.apache.hadoop.hbase.ipc.CallerDisconnectedException: Aborting call
> > > next(1916648340315433886, 1), rpc version=1, client version=29,
> > > methodsFingerPrint=-1368823753 from 192.168.2.209:1150 after 8504 ms,
> > > since
> > > caller disconnected
> > >         at
> > >
> > >
> >
> org.apache.hadoop.hbase.ipc.HBaseServer$Call.throwExceptionIfCallerDisconnected(HBaseServer.java:436)
> > >         at
> > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3856)
> > >         at
> > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3776)
> > >         at
> > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3768)
> > >         at
> > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2513)
> > >         at sun.reflect.GeneratedMethodAccessor25.invoke(Unknown Source)
> > >         at
> > >
> > >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> > >         at java.lang.reflect.Method.invoke(Method.java:597)
> > >         at
> > >
> > >
> >
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:320)
> > >         at
> > >
> >
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1426)
> > >
> >
>
>
>
> --
> Marcos Ortiz Valmaseda
> Product Manager at PDVSA
> http://about.me/marcosortiz
>
>


-- 
Marcos Ortiz Valmaseda
Product Manager at PDVSA
http://about.me/marcosortiz

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message