hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ryan Rawson <ryano...@gmail.com>
Subject Re: Major compactions and OS cache
Date Wed, 16 Feb 2011 19:48:29 GMT
That would be cool, I think we should probably also push for HSDF-347
while we are at it as well. The situation for HDFS improvements has
not been good, but might improve in the mid-future.

Thanks for the pointer!
-ryan

On Wed, Feb 16, 2011 at 11:40 AM, Jason Rutherglen
<jason.rutherglen@gmail.com> wrote:
>> One of my coworker is reminding me that major compactions do have the
>> well know side effect of slowing down a busy system.
>
> I think where this is going is the system IO cache problem could be
> solved with something like DirectIOLinuxDirectory:
> https://issues.apache.org/jira/browse/LUCENE-2500  Of course the issue
> would be integrating DIOLD or it's underlying native implementation
> into HDFS somehow?
>

Mime
View raw message