hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Upendra Yadav <upendra1...@gmail.com>
Subject Re: Is hbase call delete request for old hfile(storeFile) file if minor/major compaction happen for them
Date Tue, 25 Feb 2014 11:25:05 GMT
Thanks...


On Tue, Feb 25, 2014 at 2:18 PM, Bharath Vissapragada <bharathv@cloudera.com
> wrote:

> In short, it needn't "download" files, that metadata is stored and exposed
> in the API of a StoreFile and regionserver just calls that method!
>
>
> On Tue, Feb 25, 2014 at 2:16 PM, Bharath Vissapragada <
> bharathv@cloudera.com
> > wrote:
>
> > Not sure what you are asking but if you want to know the size of a store
> > file, you can use this method,
> >
> >
> >
> https://github.com/apache/hbase/blob/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java#L1440
> >
> > One such usage is here,
> >
> >
> >
> https://github.com/apache/hbase/blob/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/RatioBasedCompactionPolicy.java#L292
> >
> > It gets the sizes of all the store files, I believe thats what you are
> > asking! Please correct me if I'm wrong,
> >
> >
> > On Tue, Feb 25, 2014 at 12:37 PM, Upendra Yadav <upendra1024@gmail.com
> >wrote:
> >
> >> Is hbase call delete request for old hfile(storeFile) file if
> minor/major
> >> compaction happen for them and generate new hfile and store it in hdfs.
> >>
> >> for minor compaction how it will get size of every hfile. lets we have
> 20
> >> no. of hfiles for a CF and minor compaction wants to perform. Will it
> >> download all hfile and decide compaction have to do or not. Or it have
> >> in-memory hfile's size information for all hfile.
> >>
> >
> >
> >
> > --
> > Bharath Vissapragada
> > <http://www.cloudera.com>
> >
>
>
>
> --
> Bharath Vissapragada
> <http://www.cloudera.com>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message