hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wei-Chiu Chuang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-11306) Dump remaining edit logs from buffer if edit log can't be rolled.
Date Mon, 09 Jan 2017 21:38:58 GMT

     [ https://issues.apache.org/jira/browse/HDFS-11306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Wei-Chiu Chuang updated HDFS-11306:
-----------------------------------
    Attachment: HDFS-11306.001.patch

Upload patch v001. This patch adds a private method that dumps edit logs in human readable
formation into namenode log. A test case is also added.

Any suggestion is greatly appreciated. I honestly do not have much experience in edit logs
and HA.

> Dump remaining edit logs from buffer if edit log can't be rolled.
> -----------------------------------------------------------------
>
>                 Key: HDFS-11306
>                 URL: https://issues.apache.org/jira/browse/HDFS-11306
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: ha, namenode
>            Reporter: Wei-Chiu Chuang
>            Assignee: Wei-Chiu Chuang
>         Attachments: HDFS-11306.001.patch
>
>
> In HDFS-10943 [~yzhangal] reported that edit log can not be rolled due to unexpected
edit logs lingering in the buffer.
> Unable to root cause the bug, I propose that we dump the remaining edit logs in the buffer
into namenode log, before crashing namenode. Use this new capability to find the ops that
sneaks into the buffer unexpectedly, and hopefully catch the bug.
> This effort is orthogonal, but related to HDFS-11292, which adds additional informational
logs to help debug this issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message