hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: HBase is not ready for Primetime
Date Tue, 12 Apr 2011 17:37:14 GMT
In another terminal, you can see which region server(s) is still running.
Checking region server log on that region server would help.

On Tue, Apr 12, 2011 at 10:34 AM, Robert Gonzalez <
gonz@maxpointinteractive.com> wrote:

> You mean like this:
>
> hbase@c1-m02:/usr/lib/hbase-0.90.0/bin$ ./stop-hbase.sh
> stopping
> hbase...........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
>
> Still going.....   :(
>
> On Tue, Apr 12, 2011 at 12:01 PM, Jinsong Hu <jinsong_hu@hotmail.com>
> wrote:
> > You probably should stop all master/regionservers, then start one master,
> > tail -f the log to confirm all the hlogs are handled,
> >
> > then start the first regionserver, and then other regionservers.
> >
> > I have encountered this issues before.
> > hbase is not as good as what you want, but not as bad as you say either.
> The
> > truth is in between.
> >
> > Jimmy
> >
> > --------------------------------------------------
> > From: "Robert Gonzalez" <gonz@maxpointinteractive.com>
> > Sent: Tuesday, April 12, 2011 9:49 AM
> > To: <user@hbase.apache.org>
> > Subject: HBase is not ready for Primetime
> >
> >> We've been using HBase for about a year, consistenly running into
> >> problems where we lost data.  After reading forums and some back and
> >> forth with other Hbase users, we changed our data methodology to save
> >> less data per row.  This last time, we upgraded to 0.90 at the
> >> recommendation of the hbase community, cleared off all our data, and
> >> started over.  Seemed to be running ok for a couple of months, until
> >> this morning.  One of the regionservers stopped responding to data
> >> requests and we tried to restart it to no avail.  Then we shutdown our
> >> processes so that nothing was using HBase and we shut down HBase and
> >> brought it back up.  We waited a little bit, until hbase status
> >> indicated that all the servers were back up.  We turned on our
> >> processes and lo and behold, HBase is broken, getting
> >> org.apache.hadoop.hbase.
> >> NotServingRegionException:
> >> org.apache.hadoop.hbase.NotServingRegionException: Region is not
> >> online: -ROOT-,,0
> >>    at
> >>
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2319)
> >>    at
> >>
> org.apache.hadoop.hbase.regionserver.HRegionServer.getClosestRowBefore(HRegionServer.java:1607)
> >>    at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
> >>    at
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >>    at java.lang.reflect.Method.invoke(Method.java:597)
> >>    at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
> >>    at
> >>
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1036)
> >>
> >> And now we can't even shut it down.
> >>
> >> Seems that Hbase is just too flaky to depend on for a serious system,
> >> we've not had this type of problem to this degree with conventional DB
> >> systems. Now that we are not saving that much data (we are using large
> >> hdfs files for that) in Hbase, we are probably going to move back to a
> >> conventional SQL system for our control data.  We just can't afford to
> >> be constantly fighting problems like this.
> >>
> >>
> >> --
> >>
> >> Robert Gonzalez
> >>
> >> Maxpoint Interactive
> >>
> >
>
>
>
> --
>
>
>     Robert Gonzalez / Senior Software Architect
>
>     7600 Burnet Road, Suite 500
>     Austin, TX 78757
>     T 512 981 9561    F 919 882 8529
>     gonz@maxpointinteractive.com
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message