hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jason Rutherglen <jason.rutherg...@gmail.com>
Subject Re: Major compactions and OS cache
Date Thu, 17 Feb 2011 02:35:43 GMT
> There is a patch that causes us to evict the block cache on close of
> hfile, and populate the block cache during compaction write out.  This
> is included in 0.90.

That's good!

> HDFS-347, which is a huge
> clear win but still no plans to include it in any hadoop version.

Why's that?  It seems to be fairly logical.  Does it affect the
'over-the-wire' protocol?

On Wed, Feb 16, 2011 at 6:23 PM, Ryan Rawson <ryanobjc@gmail.com> wrote:
> There is a patch that causes us to evict the block cache on close of
> hfile, and populate the block cache during compaction write out.  This
> is included in 0.90.
>
> So that helps.  Fixing VFS issues is quite a bit longer term, since
> the on-wire format of HDFS rpc is kind of "fixed", petitioning for
> changes will be a little tricky. Again, see HDFS-347, which is a huge
> clear win but still no plans to include it in any hadoop version.
>
> -ryan
>

Mime
View raw message