Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of sergey@hortonworks.com
 designates 74.125.82.173 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAGpTDNdi982DtvYv0BVWoqKPT93mtkTTZpYURGwnH4yijgCELQ@mail.gmail.com>
References: 
 <CAAT7Mkpb=Jq1HGqJEa0=1hmSiPH2HR_ySwdEyv99z8+1NKAmrw@mail.gmail.com>
	<CAPQV63WaAz+C5rqX4VGR_AbGA40a87MqUmrAmy9L7KWz7UhUmg@mail.gmail.com>
	<CAAT7MkqDye1Fai6XB9wiKKzBTwdzkRWHHZXC7_vP+TOU1MzNDg@mail.gmail.com>
	<CAGpTDNdi982DtvYv0BVWoqKPT93mtkTTZpYURGwnH4yijgCELQ@mail.gmail.com>
Date: Fri, 5 Apr 2013 10:25:10 -0700
Message-ID: 
 <CAHXxaiBQeqRriVkGrJM=5+AxJ2WskOruXTXWRCmmv-PndiD90Q@mail.gmail.com>
Subject: Re: Should compaction be triggered even if User periodically flushes
From: Sergey Shelukhin <sergey@hortonworks.com>
To: dev@hbase.apache.org
Content-Type: multipart/alternative; boundary=f46d043c094e8609d404d9a05e57

--f46d043c094e8609d404d9a05e57
Content-Type: text/plain; charset=ISO-8859-1

+1... logs would be interesting to see, unless there was configuration
difference it should be the same.
The only thing that comes to mind if off-peak hours starting maybe?

On Fri, Apr 5, 2013 at 9:57 AM, Jean-Daniel Cryans <jdcryans@apache.org>wrote:

> That sounds like a bug to me. Can you find why it's not being compacted?
> Was this behavior changed at some point?
>
> Thx,
>
> J-D
>
>
> On Fri, Apr 5, 2013 at 9:50 AM, ramkrishna vasudevan <
> ramkrishna.s.vasudevan@gmail.com> wrote:
>
> > Hi JM
> > Thanks for your reply.  My concern is not with respect to compaction
> > happening when a region is opening in another RS, my point was though the
> > flushes were happening and more storefiles are created
> > by user initiated flushing, the compaction were not getting triggered.
> >
> >
> > On Fri, Apr 5, 2013 at 4:50 PM, Jean-Marc Spaggiari <
> > jean-marc@spaggiari.org
> > > wrote:
> >
> > > Hi Ram,
> > >
> > > What do you think is wrong with the approach below?
> > >
> > > Doing the compaction when the region is opened in another RS will
> > > improve data locality.
> > >
> > > JM
> > >
> > > 2013/4/5 ramkrishna vasudevan <ramkrishna.s.vasudevan@gmail.com>:
> > > > Hi devs
> > > >
> > > > If user periodically flushes the memstore we keep creating Store
> files.
> > > >  Now if the number of store files  satisfies the compaction policy we
> > > dont
> > > > do compaction.
> > > >
> > > > We print the msg saying compaction_requested=true but do not include
> > into
> > > > the compactsplitthread.
> > > >
> > > > But when the RS goes down and the region gets opened in another RS as
> > > part
> > > > of postOpenDeployTasks we do compaction because the store file count
> > has
> > > > satisfied the compaction criteria.
> > > >
> > > > What could be the right approach here?
> > > >
> > > > Regards
> > > > Ram
> > >
> >
>

--f46d043c094e8609d404d9a05e57--