hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Colin Patrick McCabe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-10052) use HDFS advisory caching to avoid caching HFiles that are not going to be read again (because they are being compacted)
Date Wed, 27 Nov 2013 22:00:35 GMT

    [ https://issues.apache.org/jira/browse/HBASE-10052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13834203#comment-13834203
] 

Colin Patrick McCabe commented on HBASE-10052:
----------------------------------------------

[~andrew.purtell@gmail.com] : sorry.  I did mean DFSInputStream, since the files not being
used again would be the compactees.  And yeah, reflection would be a good way to do this and
support older Hadoops  (see {{CanSetDropBehind}} interface)

> use HDFS advisory caching to avoid caching HFiles that are not going to be read again
(because they are being compacted)
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-10052
>                 URL: https://issues.apache.org/jira/browse/HBASE-10052
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Colin Patrick McCabe
>
> HBase can benefit from doing dropbehind during compaction since compacted files are not
read again.  HDFS advisory caching, introduced in HDFS-4817, can help here.  The right API
here is {{DataOutputStream#setDropBehind}}.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message