hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Haohui Mai (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6673) Add Delimited format supports for PB OIV tool
Date Sat, 24 Jan 2015 01:24:37 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14290331#comment-14290331

Haohui Mai commented on HDFS-6673:

bq. Also, even a 40GB image easily fits in memory on server these days.

The whole point of this tool is to run the oiv on machines that do not have the luxury of
abundant memory. Can you clarify what point you are trying to make?

bq. These seem like pretty big drawbacks to me, and are addressed by this tool. I think calling
it "half-baked" is unfair considering it provides greater functionality.

Can you clarify what the greater functionality are? The Delimiter only outputs mtime/atime
and other information available from legacy fsimage.

BTW, if you really want to commit this please update the document to explicit state that the
tool will not work for large fsimage, so that the users won't be caught by surprise.

> Add Delimited format supports for PB OIV tool
> ---------------------------------------------
>                 Key: HDFS-6673
>                 URL: https://issues.apache.org/jira/browse/HDFS-6673
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>    Affects Versions: 2.4.0
>            Reporter: Lei (Eddy) Xu
>            Assignee: Lei (Eddy) Xu
>            Priority: Minor
>         Attachments: HDFS-6673.000.patch, HDFS-6673.001.patch, HDFS-6673.002.patch, HDFS-6673.003.patch,
HDFS-6673.004.patch, HDFS-6673.005.patch, HDFS-6673.006.patch
> The new oiv tool, which is designed for Protobuf fsimage, lacks a few features supported
in the old {{oiv}} tool. 
> This task adds supports of _Delimited_ processor to the oiv tool. 

This message was sent by Atlassian JIRA

View raw message