hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hari Sreekumar <hsreeku...@clickable.com>
Subject Re: Hbase insertion process cause to region server down.
Date Tue, 09 Nov 2010 04:26:19 GMT
Hi Jonathan,

             I have faced the exact same issue as Oleg and it seems to
happen randomly. Sometimes I get this exception and the task fails,
sometimes I don't and it succeeds. Do you mean that this is normal behavior?

hari

On Tue, Nov 9, 2010 at 12:25 AM, Jonathan Gray <jgray@facebook.com> wrote:

> NSRE is normal, this happens when regions move around and your client needs
> to update the location.
>
> That seems like an awful lot of mappers/reducers on a 5 server / dual core
> setup... You have only 2 cores per server but you have a DataNode,
> RegionServer, and 4 map tasks and 3 reduce tasks?  That may be over
> extending things a bit.
>
> JG
>
> > -----Original Message-----
> > From: Oleg Ruchovets [mailto:oruchovets@gmail.com]
> > Sent: Monday, November 08, 2010 7:52 AM
> > To: user@hbase.apache.org
> > Subject: Hbase insertion process cause to region server down.
> >
> > Hi ,
> >
> > I run map/reduce job which from reducers writes to hbase. I have to
> > write
> > 8-9 million raws.
> >
> >   My environment:
> >   5 servers dual core , 8G ram.
> >   HDFS -- 9TB
> >
> >   hadoop has 1000 heap_size ,
> >   hbase has 2000 heap_size
> >   zookeeper has 1000 heap_size
> >   20 map / 16 reducers while running the job
> >
> > Allmost all the time get such exception
> >
> >    org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException: Region URLs_sanity,
> > 20101106_www.homemade-chinese-soups.com/conch-soup.html,1289163460337
> > closed
> >    at
> > org.apache.hadoop.hbase.regionserver.HRegion.obtainRowLock(HRegion.java
> > :1607)
> >    at
> > org.apache.hadoop.hbase.regionserver.HRegion.getLock(HRegion.java:1671)
> >    at
> > org.apache.hadoop.hbase.regionserver.HRegion.get(HRegion.java:2380)
> >    at
> > org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.ja
> > va:1731)
> >    at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
> >    at
> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso
> > rImpl.java:25)
> >    at java.lang.reflect.Method.invoke(Method.java:597)
> >    at
> > org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:657)
> >    at
> > org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:91
> > 5)
> >
> >
> >
> > Thanks in advance.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message