Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of jmozah@gmail.com designates
 209.85.160.169 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CADfhF1GKSSjkDdoMHDhybBor170ryCb-tSTPks=oCh2Kj_i0xg@mail.gmail.com>
References: 
 <CADfhF1GJq5uX6zh9yUq=QdX58_uqUZeEV0pS5YN-LaVMM21FKQ@mail.gmail.com>
	<CADcMMgHNCtzu1K4emkDOzfwEpYLhUZ9754-yxy4Pqiy8yNiqWA@mail.gmail.com>
	<CADfhF1GzeVeV_Hb6Qwx+UKVU9Gh1UBVs0D6E+uYpbH0qYzgSTQ@mail.gmail.com>
	<CADcMMgF=O3Rohfn5yDHvRRK6L9-Wc_dCn=WySexgbyYyPnqkWw@mail.gmail.com>
	<CALte62xuhSzFXK9pTMSt+O9axGk_OjQ8z1ksDnqCiY-dQdsn+g@mail.gmail.com>
	<CADfhF1GKSSjkDdoMHDhybBor170ryCb-tSTPks=oCh2Kj_i0xg@mail.gmail.com>
Date: Thu, 9 Aug 2012 14:33:08 +0530
Message-ID: 
 <CADrVvWU17qnXkC1yDMirdOePER5hYRcfJH9PaG9mXOhGOYp8Zw@mail.gmail.com>
Subject: Re: Hbase- Hadoop DFS size not decreased even after deleting a column
 family
From: J Mohamed Zahoor <jmozah@gmail.com>
To: user@hbase.apache.org
Content-Type: multipart/alternative; boundary=e89a8f23579d0d679804c6d17f8e

--e89a8f23579d0d679804c6d17f8e
Content-Type: text/plain; charset=ISO-8859-1

Hi

I see this atleast in trunk... in TableDeleteFamilyHandler's constructor..

 public TableDeleteFamilyHandler(byte[] tableName, byte [] familyName,

      Server server, final MasterServices masterServices) throwsIOException {

    super(EventType.C_M_ADD_FAMILY, tableName, server, masterServices);

    HTableDescriptor htd = getTableDescriptor();

    this.familyName = hasColumnFamily(htd, familyName);

  }


The event type is added as C_M_ADD_FAMILY....
May be this is the problem and it is there in 0.94.1 also !!!

./zahoor


On Wed, Aug 8, 2012 at 5:33 PM, prem yadav <ipremyadav@gmail.com> wrote:

> Hi Stack,
> we have got a lot of these in the logs after we deleted the column family.
>
> org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: Column
> family ol does not exist in region <region>
>         at
> org.apache.hadoop.hbase.regionserver.HRegion.checkFamily(HRegion.java:4759)
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegion.checkFamilies(HRegion.java:2639)
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2065)
>         at
> org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:1962)
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegionServer.multi(HRegionServer.java:3428)
>         at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source)
>         at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:601)
>         at
>
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
>         at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1386)
> 2012-08-05 00:11:37,697 DEBUG org.apache.hadoop.hbase.regionserver.HRegion:
> rollbackMemstore rolled back 0 keyvalues from start:0 to end:1
>
>
>
>
> On Tue, Aug 7, 2012 at 10:27 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>
> > Looking at TableDeleteFamilyHandler, I see:
> >
> >   protected void handleTableOperation(List<HRegionInfo> hris) throws
> > IOException {
> >     // Update table descriptor in HDFS
> >     HTableDescriptor htd =
> >       this.masterServices.getMasterFileSystem().deleteColumn(tableName,
> > familyName);
> >     // Update in-memory descriptor cache
> >     this.masterServices.getTableDescriptors().add(htd);
> >
> > MasterFileSystem.deleteColumn() calls:
> >
> >     HTableDescriptor htd =
> > this.services.getTableDescriptors().get(tableName);
> >     htd.removeFamily(familyName);
> >
> > I will dig some more.
> >
> > But looks like there is a bug.
> >
> > On Tue, Aug 7, 2012 at 9:21 AM, Stack <stack@duboce.net> wrote:
> >
> > > On Tue, Aug 7, 2012 at 9:59 AM, prem yadav <ipremyadav@gmail.com>
> wrote:
> > > > Hi Stack,
> > > > yes . I can still see the column family.
> > > >
> > > > we ran the following command too:
> > > >
> > > > fs -dus /hbase/<table name>/<region hash>/<cf that was deleted> and
> it
> > > > returned a large value which means that the space has not been
> > reclaimed.
> > > > The hbase version we are running is 0.94.1.
> > > >
> > > > is there  a manual way to force reclaim the space?
> > > >
> > >
> > > You could delete the column family from hdfs under each region.
> > > Anything in the logs around the remove of the column family?  Maybe we
> > > just don't do the delete cleanup in hdfs when we drop a cf (I've not
> > > checked)?
> > >
> > > St.Ack
> > >
> >
>

--e89a8f23579d0d679804c6d17f8e--