hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephen Chu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6773) MiniDFSCluster should skip edit log fsync by default
Date Tue, 26 Aug 2014 17:07:59 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110953#comment-14110953

Stephen Chu commented on HDFS-6773:

The above two test failures aren't related to this patch. I ran them locally successfully
to double-check.

> MiniDFSCluster should skip edit log fsync by default
> ----------------------------------------------------
>                 Key: HDFS-6773
>                 URL: https://issues.apache.org/jira/browse/HDFS-6773
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: namenode
>    Affects Versions: 2.0.0-alpha, 3.0.0
>            Reporter: Daryn Sharp
>            Assignee: Stephen Chu
>         Attachments: HDFS-6773.1.patch, HDFS-6773.2.patch, HDFS-6773.2.patch
> The mini cluster is unnecessarily running with durable edit logs.  The following change
cut runtime of a single test from ~30s to ~10s.
> {code}EditLogFileOutputStream.setShouldSkipFsyncForTesting(true);{code}
> The mini cluster should default to this behavior after identifying the few edit log tests
that probably depend on durable logs.

This message was sent by Atlassian JIRA

View raw message