hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase
Date Sun, 23 Nov 2014 06:03:12 GMT

    [ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14222326#comment-14222326
] 

Lars Hofhansl commented on HBASE-5954:
--------------------------------------

Other related setting that would be absolutely required is HDFS's sync on close. Originally
I thought we only need to put the WAL into sync on close mode (see HDFS-744), but since any
compaction can randomly re-write old data and not sync it to disk unless instructed, it does
not make much sense, unless we review every write in HBase and tag the DFS stream with the
correct flags.
(If sync on close is paired with sync behind writes its performance effect is not too bad)


> Allow proper fsync support for HBase
> ------------------------------------
>
>                 Key: HBASE-5954
>                 URL: https://issues.apache.org/jira/browse/HBASE-5954
>             Project: HBase
>          Issue Type: Improvement
>          Components: HFile, wal
>            Reporter: Lars Hofhansl
>            Assignee: Lars Hofhansl
>            Priority: Critical
>             Fix For: 2.0.0
>
>         Attachments: 5954-WIP-trunk.txt, 5954-trunk-hdfs-trunk-v2.txt, 5954-trunk-hdfs-trunk-v3.txt,
5954-trunk-hdfs-trunk-v4.txt, 5954-trunk-hdfs-trunk-v5.txt, 5954-trunk-hdfs-trunk-v6.txt,
5954-trunk-hdfs-trunk.txt, hbase-hdfs-744.txt
>
>
> At least get recommendation into 0.96 doc and some numbers running w/ this hdfs feature
enabled.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message