hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "binlijin (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-4184) Add new interface for Client to provide more hint information for DataNode to manage the OS buffer cache more accurate
Date Tue, 13 Nov 2012 03:43:12 GMT

     [ https://issues.apache.org/jira/browse/HDFS-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

binlijin updated HDFS-4184:
---------------------------

    Description: 
HDFS now has the ability to use posix_fadvise and sync_data_range syscalls to manage the OS
buffer cache.
When hbase read hlog the data we can set dfs.datanode.drop.cache.behind.reads to true to drop
data out of the buffer cache when performing sequential reads.
When hbase write hlog we can set dfs.datanode.drop.cache.behind.writes to true to drop data
out of the buffer cache after writing
When hbase read hfile during compaction we can set dfs.datanode.readahead.bytes to a non-zero
value to trigger readahead for sequential reads.
and so on... 

  was:When hbase read or write hlog we can use dfs.datanode.drop.cache.behind.reads、dfs.datanode.drop.cache.behind.writes,
when hbase read hfile during compaction we can use readahead and so on... 

        Summary: Add new interface for Client to provide more hint information for DataNode
to manage the OS buffer cache more accurate  (was: Add new interface for Client to provide
more information)
    
> Add new interface for Client to provide more hint information for DataNode to manage
the OS buffer cache more accurate
> ----------------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-4184
>                 URL: https://issues.apache.org/jira/browse/HDFS-4184
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>            Reporter: binlijin
>
> HDFS now has the ability to use posix_fadvise and sync_data_range syscalls to manage
the OS buffer cache.
> When hbase read hlog the data we can set dfs.datanode.drop.cache.behind.reads to true
to drop data out of the buffer cache when performing sequential reads.
> When hbase write hlog we can set dfs.datanode.drop.cache.behind.writes to true to drop
data out of the buffer cache after writing
> When hbase read hfile during compaction we can set dfs.datanode.readahead.bytes to a
non-zero value to trigger readahead for sequential reads.
> and so on... 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message