hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wei-Chiu Chuang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-11306) Print remaining edit logs from buffer if edit log can't be rolled.
Date Fri, 13 Jan 2017 12:30:26 GMT

     [ https://issues.apache.org/jira/browse/HDFS-11306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Wei-Chiu Chuang updated HDFS-11306:
-----------------------------------
    Attachment: HDFS-11306.003.patch

Jira is back, and here's my v003 patch to address checkstyle issue, and update warning messages.

Thanks again for reviewing the patch!

> Print remaining edit logs from buffer if edit log can't be rolled.
> ------------------------------------------------------------------
>
>                 Key: HDFS-11306
>                 URL: https://issues.apache.org/jira/browse/HDFS-11306
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: ha, namenode
>            Reporter: Wei-Chiu Chuang
>            Assignee: Wei-Chiu Chuang
>         Attachments: HDFS-11306.001.patch, HDFS-11306.002.patch, HDFS-11306.003.patch
>
>
> In HDFS-10943 [~yzhangal] reported that edit log can not be rolled due to unexpected
edit logs lingering in the buffer.
> Unable to root cause the bug, I propose that we dump the remaining edit logs in the buffer
into namenode log, before crashing namenode. Use this new capability to find the ops that
sneaks into the buffer unexpectedly, and hopefully catch the bug.
> This effort is orthogonal, but related to HDFS-11292, which adds additional informational
logs to help debug this issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message