hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suresh Srinivas (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-3020) Auto-logSync based on edit log buffer size broken
Date Tue, 28 Feb 2012 17:27:47 GMT

    [ https://issues.apache.org/jira/browse/HDFS-3020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13218373#comment-13218373
] 

Suresh Srinivas commented on HDFS-3020:
---------------------------------------

Does this mean that the editlog is being synced only during rolling of editlogs?

Since you are touching this part of the code, can you please remove throwing unnecessary IOException
from FSEditlog#getEditLogManifest, FSEditlog#releaseBackupStream.

This patch should be committed to 0.23.2.
                
> Auto-logSync based on edit log buffer size broken
> -------------------------------------------------
>
>                 Key: HDFS-3020
>                 URL: https://issues.apache.org/jira/browse/HDFS-3020
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: name-node
>    Affects Versions: 0.22.0, 0.23.0
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>            Priority: Critical
>         Attachments: hdfs-3020.txt
>
>
> HDFS-1112 added a feature whereby the edit log automatically calls logSync() if the buffered
data crosses a threshold. However, the code checks {{bufReady.size()}} rather than {{bufCurrent.size()}}
-- which is incorrect since the writes themselves go into {{bufCurrent}}.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message