hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhe Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-8480) Fix performance and timeout issues in HDFS-7929: use hard-links instead of copying edit logs
Date Fri, 19 Jun 2015 04:46:02 GMT

     [ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Zhe Zhang updated HDFS-8480:
----------------------------
    Attachment: HDFS-8480.03.patch

Patch 02 actually made a very silly mistake and emulates an old layout version by {{CURRENT_LAYOUT_VERSION
- 1}} instead of incrementing it by 1.

So the conclusion is {{EditLogInputStream}} has the logic of reading from _older_ layout versions.
And it works for both upgrade and inotify scenarios.

> Fix performance and timeout issues in HDFS-7929: use hard-links instead of copying edit
logs
> --------------------------------------------------------------------------------------------
>
>                 Key: HDFS-8480
>                 URL: https://issues.apache.org/jira/browse/HDFS-8480
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 2.7.0
>            Reporter: Zhe Zhang
>            Assignee: Zhe Zhang
>            Priority: Critical
>         Attachments: HDFS-8480.00.patch, HDFS-8480.01.patch, HDFS-8480.02.patch, HDFS-8480.03.patch
>
>
> HDFS-7929 copies existing edit logs to the storage directory of the upgraded {{NameNode}}.
This slows down the upgrade process. This JIRA aims to use hard-linking instead of per-op
copying to achieve the same goal.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message