hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pritam Damania (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-8714) Have an option to perform sync_file_range on HFiles
Date Mon, 10 Jun 2013 18:10:20 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679712#comment-13679712

Pritam Damania commented on HBASE-8714:

[~lhofhansl]I'm not sure if any Apache version of HDFS supports this. This is supported in
Facebook's version of HDFS. You can find the code on github here : https://github.com/facebook/hadoop-20
and here is an example of where it is used : https://github.com/facebook/hadoop-20/blob/master/src/hdfs/org/apache/hadoop/hdfs/server/datanode/BlockInlineChecksumWriter.java#L306
> Have an option to perform sync_file_range on HFiles
> ---------------------------------------------------
>                 Key: HBASE-8714
>                 URL: https://issues.apache.org/jira/browse/HBASE-8714
>             Project: HBase
>          Issue Type: New Feature
>            Reporter: Pritam Damania
>            Priority: Minor
> In HDFS we use sync_file_range(WRITE) to periodically sync data to disks to ensure we
have smooth IO and not huge bursts to the disk. We need to allow HBase to enable sync_file_range(WAIT_AFTER
| WRITE) to ensure that HFiles are throttled and can write only as fast as disks can.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message