hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pritam Damania (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-8714) Have an option to perform sync_file_range on HFiles
Date Mon, 10 Jun 2013 18:10:20 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679712#comment-13679712
] 

Pritam Damania commented on HBASE-8714:
---------------------------------------

[~lhofhansl]I'm not sure if any Apache version of HDFS supports this. This is supported in
Facebook's version of HDFS. You can find the code on github here : https://github.com/facebook/hadoop-20
and here is an example of where it is used : https://github.com/facebook/hadoop-20/blob/master/src/hdfs/org/apache/hadoop/hdfs/server/datanode/BlockInlineChecksumWriter.java#L306
                
> Have an option to perform sync_file_range on HFiles
> ---------------------------------------------------
>
>                 Key: HBASE-8714
>                 URL: https://issues.apache.org/jira/browse/HBASE-8714
>             Project: HBase
>          Issue Type: New Feature
>            Reporter: Pritam Damania
>            Priority: Minor
>
> In HDFS we use sync_file_range(WRITE) to periodically sync data to disks to ensure we
have smooth IO and not huge bursts to the disk. We need to allow HBase to enable sync_file_range(WAIT_AFTER
| WRITE) to ensure that HFiles are throttled and can write only as fast as disks can.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message