hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jason Rutherglen <jason.rutherg...@gmail.com>
Subject Re: Major compactions and OS cache
Date Wed, 16 Feb 2011 20:09:12 GMT
This comment https://issues.apache.org/jira/browse/HDFS-347?focusedCommentId=12991734&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-12991734
is interesting as in Lucene the IO cache is relied on, one would
assume that HBase'd be the same?

On Wed, Feb 16, 2011 at 11:48 AM, Ryan Rawson <ryanobjc@gmail.com> wrote:
> That would be cool, I think we should probably also push for HSDF-347
> while we are at it as well. The situation for HDFS improvements has
> not been good, but might improve in the mid-future.
>
> Thanks for the pointer!
> -ryan
>
> On Wed, Feb 16, 2011 at 11:40 AM, Jason Rutherglen
> <jason.rutherglen@gmail.com> wrote:
>>> One of my coworker is reminding me that major compactions do have the
>>> well know side effect of slowing down a busy system.
>>
>> I think where this is going is the system IO cache problem could be
>> solved with something like DirectIOLinuxDirectory:
>> https://issues.apache.org/jira/browse/LUCENE-2500  Of course the issue
>> would be integrating DIOLD or it's underlying native implementation
>> into HDFS somehow?
>>
>

Mime
View raw message