hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhe Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8178) QJM doesn't move aside stale inprogress edits files
Date Thu, 30 Apr 2015 06:55:08 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14521005#comment-14521005

Zhe Zhang commented on HDFS-8178:

Oops last paragraph was added by mistake, please ignore it.

> QJM doesn't move aside stale inprogress edits files
> ---------------------------------------------------
>                 Key: HDFS-8178
>                 URL: https://issues.apache.org/jira/browse/HDFS-8178
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: qjm
>            Reporter: Zhe Zhang
>            Assignee: Zhe Zhang
>         Attachments: HDFS-8178.000.patch
> When a QJM crashes, the in-progress edit log file at that time remains in the file system.
When the node comes back, it will accept new edit logs and those stale in-progress files are
never cleaned up. QJM treats them as regular in-progress edit log files and tries to finalize
them, which potentially causes high memory usage. This JIRA aims to move aside those stale
edit log files to avoid this scenario.

This message was sent by Atlassian JIRA

View raw message