Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
MIME-Version: 1.0
In-Reply-To: <5E993C94-2A75-439E-B024-044229F758F0@digitalenvoy.net>
References: <CD129FB9-789F-4390-B3E2-B237BCBAC9B3@digitalenvoy.net>
	<CALte62wz_LGehRo3mnxRJhxqLcho0bzQyaqOJguRvtUvnv8uYw@mail.gmail.com>
	<552F68EF-1469-4E23-83F0-0294AADFE521@digitalenvoy.net>
	<512A4548-13CA-4B62-8223-0DA7C9E0AF66@gmail.com>
	<CALte62wQhMppYWOfiKu7-AXEbguaqWmHRyUZCNuFQPj2bUKyWw@mail.gmail.com>
	<CAKrkF=tsDkzd3BCyCyP2okYY7TQ72rzp108Bwa1SmaridmC-yA@mail.gmail.com>
	<5E993C94-2A75-439E-B024-044229F758F0@digitalenvoy.net>
Date: Tue, 22 Dec 2015 12:12:12 -0500
Message-ID: 
 <CAKrkF=usS6NbLMC1iqhaQvnV6MiSCNTuhz9s+ADC8rQF2pQEZA@mail.gmail.com>
Subject: Re: regions in transition
From: Geovanie Marquez <geovanie.marquez@gmail.com>
To: "user@hbase.apache.org" <user@hbase.apache.org>
Content-Type: multipart/alternative; boundary=001a1139d752dbfb2905277fb4ae

--001a1139d752dbfb2905277fb4ae
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

You should really find out where you hmaster ui lives (there is a master UI
for every node provided by the apache project) because it gives you
information on the state of your system, but if you want to skip all that,
here are the instructions for OfflineRepair, without knowing what is
happening with your system (logs, master ui info) you can try this but at
your own risk.

OfflineMetaRepair.
Description Below:
This code is used to rebuild meta off line from file system data. If there
   * are any problem detected, it will fail suggesting actions for the user
to do
   * to "fix" problems. If it succeeds, it will backup the previous
hbase:meta and
   * -ROOT- dirs and write new tables in place.

Stop HBase
zookeeper-client rmr /hbase
HADOOP_USER_NAME=3Dhbase hbase
org.apache.hadoop.hbase.util.hbck.OfflineMetaRepair
start hbase

^ This has worked for me in some situations where I understood HDFS and
Zookeeper disagreed on region locations, but keep in mind I have tried this
on hbase 1.0.0 and your mileage may vary.

We don't have your hbase version (you can even find this on the hbase shell=
)
We don't have logs msgs
We don't have master's view of your RITs


On Tue, Dec 22, 2015 at 11:52 AM, Brian Jeltema <bdjeltema@gmail.com> wrote=
:

> I=E2=80=99m running Ambari 2.0.2 and HPD 2.2. I don=E2=80=99t see any of =
this displayed at
> master:60010.
>
> I really think this problem is the result of cruft in ZooKeeper. Does
> anybody know
> if it=E2=80=99s safe to delete the node?
>
>
> > On Dec 22, 2015, at 11:40 AM, Geovanie Marquez <
> geovanie.marquez@gmail.com> wrote:
> >
> > check hmaster:60010 under TASKS (between Software Attributes and Tables=
)
> > you will see if you have regions in transition. This will tell you whic=
h
> > regions are transitioning and you can go to those region server logs an=
d
> > check them, I've run into a couple of these and every time they've talk
> to
> > me about their problem.
> >
> > Also, under Software Attributes you can check the HBase version.
> >
> > On Tue, Dec 22, 2015 at 11:29 AM, Ted Yu <yuzhihong@gmail.com> wrote:
> >
> >> From RegionListTmpl.jamon :
> >>
> >> <%if (onlineRegions !=3D null && onlineRegions.size() > 0) %>
> >> ...
> >> <%else>
> >>    <p>Not serving regions</p>
> >> </%if>
> >>
> >> The message means that there was no region online on the underlying
> server.
> >>
> >> FYI
> >>
> >> On Tue, Dec 22, 2015 at 7:18 AM, Brian Jeltema <bdjeltema@gmail.com>
> >> wrote:
> >>
> >>> Following up, if I look at the MBase Master UI in the Ambari console =
I
> >> see
> >>> links to
> >>> all of the region servers. If I click on those links, the Region Serv=
er
> >>> page comes
> >>> up and in the Regions section, is displays =E2=80=98Not serving regio=
ns=E2=80=99. I=E2=80=99m
> not
> >>> sure
> >>> if that means something is disabled, or it just doesn=E2=80=99t have =
any
> regions
> >>> to server.
> >>>
> >>>> On Dec 22, 2015, at 6:19 AM, Brian Jeltema <bdjeltema@gmail.com>
> >> wrote:
> >>>>
> >>>>>
> >>>>> Can you pick a few regions stuck in transition and check related
> >> region
> >>>>> server logs to see why they couldn't be assigned ?
> >>>>
> >>>> I don=E2=80=99t see anything in the region logs relating any regions=
.
> >>>>
> >>>>>
> >>>>> Which release were you using previously ?
> >>>>
> >>>> HDP 2.1 -> HDP 2.2
> >>>>
> >>>> So is it safe to stop HBase and delete the ZK node?
> >>>>
> >>>>>
> >>>>> Thanks
> >>>>>
> >>>>> On Mon, Dec 21, 2015 at 3:54 PM, Brian Jeltema <bdjeltema@gmail.com=
>
> >>> wrote:
> >>>>>
> >>>>>> I am doing a cluster upgrade to the HDP 2.2 stack. For some reason=
,
> >>> after
> >>>>>> the upgrade HBase
> >>>>>> cannot find any regions for existing tables. I believe the HDFS fi=
le
> >>>>>> system is OK. But looking at the ZooKeeper
> >>>>>> nodes, I noticed that many (maybe all) of the regions were listed =
in
> >>> the
> >>>>>> ZooKeeper
> >>>>>> /hbase-unsecure/region-in-transition node. I suspect this could be
> >>> causing
> >>>>>> a problem. Is it
> >>>>>> safe to stop HBase and delete that node?
> >>>>>>
> >>>>>> Thanks
> >>>>>> Brian
> >>>>
> >>>
> >>>
> >>
>
>

--001a1139d752dbfb2905277fb4ae--