hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yanbo Liang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-3878) Add an administrative command to download finalized edit log segments from the NN
Date Mon, 03 Sep 2012 10:13:08 GMT

    [ https://issues.apache.org/jira/browse/HDFS-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13447191#comment-13447191

Yanbo Liang commented on HDFS-3878:

The workflow of fetchEditLogs is the same as fetchImage. However, there are  many EditLog
files, and we just need to download the EditLog files which is unapplied to the latest FsImage
file. Otherwise we will waste too much storage volume. So we need to get the startTxId and
endTxId which can specified some EditLog files whose TxIds are all located in this range [startTxId,
endTxId]. How to get the startTxId and endTxId? Do we need a new api which asks NameNode to
get this information? Or just indicated by administrator? 
> Add an administrative command to download finalized edit log segments from the NN
> ---------------------------------------------------------------------------------
>                 Key: HDFS-3878
>                 URL: https://issues.apache.org/jira/browse/HDFS-3878
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: hdfs client, name-node
>    Affects Versions: 2.0.0-alpha
>            Reporter: Aaron T. Myers
> Similarly to the `hdfs dfsadmin -fetchImage' command added in HDFS-2941, it would be
nice to have an admin command capable of fetching edit log segments. This could be useful,
for example, for use in a script designed to back up the NN on-disk metadata.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message