Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: local policy includes SPF record at
 spf.trusted-forwarder.org)
MIME-Version: 1.0
In-Reply-To: 
 <CA+vHzD9pMd2uh3Ps=eJQ+CmONfR0eK55WCmg64hnttTFU8TyVw@mail.gmail.com>
References: 
 <CA+vHzD-Qcytdc_L8t2E2JAAU-5bYEEAnGaSi-bN0GQzm-HGZrA@mail.gmail.com>
 <CAFWiQHY=4UFVstaDm9_PXf9BBC-jkFw5UFttDUZK9WCh34uLPA@mail.gmail.com>
 <CAFWiQHbNF+_zydjjDibWJ4R4OLGi465vb=1i=XXbDf2nB+zfJg@mail.gmail.com>
 <CA+vHzD9pMd2uh3Ps=eJQ+CmONfR0eK55WCmg64hnttTFU8TyVw@mail.gmail.com>
From: Jean-Marc Spaggiari <jean-marc@spaggiari.org>
Date: Tue, 25 Feb 2014 07:13:14 -0500
Message-ID: 
 <CAPQV63WeQRqtvjE91C-k4sJMaYdQmD4JvDjomJ69NZcEi6PPAA@mail.gmail.com>
Subject: Re: Is hbase call delete request for old hfile(storeFile) file if
 minor/major compaction happen for them
To: user <user@hbase.apache.org>
Content-Type: multipart/alternative; boundary=089e013a12f06a415004f33a0417

--089e013a12f06a415004f33a0417
Content-Type: text/plain; charset=UTF-8

Hi Upendra,

Olds files are moved by HBase later.  Take a look at
org.apache.hadoop.hbase.master.CatalogJanitor

JM


2014-02-25 6:25 GMT-05:00 Upendra Yadav <upendra1024@gmail.com>:

> Thanks...
>
>
> On Tue, Feb 25, 2014 at 2:18 PM, Bharath Vissapragada <
> bharathv@cloudera.com
> > wrote:
>
> > In short, it needn't "download" files, that metadata is stored and
> exposed
> > in the API of a StoreFile and regionserver just calls that method!
> >
> >
> > On Tue, Feb 25, 2014 at 2:16 PM, Bharath Vissapragada <
> > bharathv@cloudera.com
> > > wrote:
> >
> > > Not sure what you are asking but if you want to know the size of a
> store
> > > file, you can use this method,
> > >
> > >
> > >
> >
> https://github.com/apache/hbase/blob/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java#L1440
> > >
> > > One such usage is here,
> > >
> > >
> > >
> >
> https://github.com/apache/hbase/blob/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/RatioBasedCompactionPolicy.java#L292
> > >
> > > It gets the sizes of all the store files, I believe thats what you are
> > > asking! Please correct me if I'm wrong,
> > >
> > >
> > > On Tue, Feb 25, 2014 at 12:37 PM, Upendra Yadav <upendra1024@gmail.com
> > >wrote:
> > >
> > >> Is hbase call delete request for old hfile(storeFile) file if
> > minor/major
> > >> compaction happen for them and generate new hfile and store it in
> hdfs.
> > >>
> > >> for minor compaction how it will get size of every hfile. lets we have
> > 20
> > >> no. of hfiles for a CF and minor compaction wants to perform. Will it
> > >> download all hfile and decide compaction have to do or not. Or it have
> > >> in-memory hfile's size information for all hfile.
> > >>
> > >
> > >
> > >
> > > --
> > > Bharath Vissapragada
> > > <http://www.cloudera.com>
> > >
> >
> >
> >
> > --
> > Bharath Vissapragada
> > <http://www.cloudera.com>
> >
>

--089e013a12f06a415004f33a0417--