hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yongjun Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11306) Print remaining edit logs from buffer if edit log can't be rolled.
Date Tue, 17 Jan 2017 21:17:26 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826829#comment-15826829
] 

Yongjun Zhang commented on HDFS-11306:
--------------------------------------

I saw [~jojochuang] has committed to trunk and branch-2 on 1/13/2017.

Thanks Wei-Chiu!



> Print remaining edit logs from buffer if edit log can't be rolled.
> ------------------------------------------------------------------
>
>                 Key: HDFS-11306
>                 URL: https://issues.apache.org/jira/browse/HDFS-11306
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: ha, namenode
>            Reporter: Wei-Chiu Chuang
>            Assignee: Wei-Chiu Chuang
>             Fix For: 2.9.0, 3.0.0-alpha2
>
>         Attachments: HDFS-11306.001.patch, HDFS-11306.002.patch, HDFS-11306.003.patch
>
>
> In HDFS-10943 [~yzhangal] reported that edit log can not be rolled due to unexpected
edit logs lingering in the buffer.
> Unable to root cause the bug, I propose that we dump the remaining edit logs in the buffer
into namenode log, before crashing namenode. Use this new capability to find the ops that
sneaks into the buffer unexpectedly, and hopefully catch the bug.
> This effort is orthogonal, but related to HDFS-11292, which adds additional informational
logs to help debug this issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message